Information processing method and apparatus

Abstract

This disclosure provides an information processing method applied to a first electronic device, comprising: obtaining first information in response to a first application in the first electronic device, and / or obtaining second information in response to the first electronic device, generating first target information; the first target information having at least a portion of the same meaning as multimedia information collected by the first electronic device and / or a second electronic device; determining at least one second application in the first electronic device, the first application being different from the second application, the second application running in both the first electronic device and a third electronic device, the first application being used for real-time audio and / or video transmission between the first electronic device and the second electronic device, and the second application being used for real-time audio and / or video transmission between the first electronic device and the third electronic device; and transmitting the first target information to the third electronic device through the second application, such that the second application of the third electronic device outputs the first target information.

Description

Technical Field

[0001] This disclosure relates to the field of electronic technology, and more specifically, to an information processing method and apparatus. Background Technology

[0002] With the widespread adoption of remote work and online meetings, more and more businesses and individuals rely on various office communication software for work communication and collaboration. However, incompatibility between different applications often leads to difficulties in cross-platform communication. When multiple users of different applications need to hold meetings, they need to ensure that all participants are using the same application or platform to achieve effective communication. Especially when multiple companies, teams, or external clients are involved, the use of a single, standardized tool is often difficult to implement due to the different organizations' choices and usage habits regarding communication tools, thus affecting efficient cross-platform communication. Summary of the Invention

[0003] In view of this, the present disclosure provides an information processing method and apparatus.

[0004] One aspect of this disclosure provides an information processing method applied to a first electronic device, comprising: obtaining first information in response to a first application in the first electronic device, and / or obtaining second information in response to the first electronic device; generating first target information, wherein the first application runs in both the first and second electronic devices; the first information includes multimedia information acquired by hardware in the second electronic device and transmitted to the first electronic device via the first application; the second information includes multimedia information acquired by hardware in the first electronic device; the first target information has at least a portion of the meaning of the multimedia information acquired by the first and / or second electronic devices; determining at least one second application in the first electronic device, wherein the first application is different from the second application, the second application runs in both the first and third electronic devices; the first application is used for real-time audio and / or video transmission between the first and second electronic devices, and the second application is used for real-time audio and / or video transmission between the first and third electronic devices; and transmitting the first target information to the third electronic device via the second application, such that the second application of the third electronic device outputs the first target information.

[0005] According to embodiments of this disclosure, the first information and / or the second information are acquired in real time. Generating the first target information includes: generating the first target information in real time based on the first information and / or the second information; transmitting the first target information to a third electronic device through a second application includes: transmitting the real-time generated first target information to the third electronic device in real time through the second application, so that the second application of the third electronic device outputs the first target information in real time.

[0006] According to embodiments of this disclosure, multimedia information includes at least one of audio information, video information, text information, and image information. Generating first target information includes: generating first target information based on at least one of audio information, video information, text information, and image information collected by hardware in the second electronic device, and / or at least one of audio information, video information, text information, and image information collected by hardware in the first electronic device.

[0007] According to embodiments of this disclosure, the first target information includes at least one of audio information, video information, text information, and image information. Transmitting the first target information to a third electronic device through a second application includes: determining a first type of multimedia information for which the second application has transmission permissions; and transmitting the audio information, and / or video information, and / or text information, and / or image information of the first target information that conforms to the first type to the third electronic device through the second application.

[0008] According to embodiments of this disclosure, generating first target information includes: determining a second type of multimedia information that the second application can transmit; converting at least part of the first information and / or the second information that does not conform to the second type of multimedia information into multimedia information with the same meaning and conforming to the second type; and generating first target information based on the converted multimedia information and the first information and / or the second information that conforms to the second type of multimedia information.

[0009] According to embodiments of this disclosure, the information processing method further includes: obtaining third information in response to a second application, and / or obtaining first information in response to a first application; generating second target information, wherein the third information includes multimedia information collected by hardware in a third electronic device and transmitted to a first electronic device through the second application; and the second target information has the same meaning as at least part of the multimedia information collected by the second electronic device and / or the third electronic device; and outputting the second target information.

[0010] According to embodiments of this disclosure, the second target information includes at least one of audio information, video information, text information, and image information. Outputting the second target information includes: determining the communication permissions of the first electronic device, wherein the communication permissions characterize the types of multimedia information that the first electronic device has the permission to output; and outputting the audio information, and / or video information, and / or text information, and / or image information in the second target information that conform to the communication permissions.

[0011] According to embodiments of this disclosure, the information processing method further includes: in response to the launch of a third application, determining whether the third application meets preset communication conditions; the third application runs in a first electronic device and a fourth electronic device, and the third application is different from the first application and the second application; if the third application meets the preset communication conditions, when the third application obtains fourth information, the third application is regarded as the first application, the fourth information is regarded as the first information, and the same operations as the first application and the first information are performed; the fourth information includes multimedia information collected by hardware in the fourth electronic device and transmitted to the first electronic device through the first application; if the third application meets the preset communication conditions, when it is necessary to transmit multimedia information to the fourth electronic device based on the third application, the third application is regarded as the second application, and the same operations as the second application are performed.

[0012] Another aspect of this disclosure provides an information processing apparatus, comprising: a generation module, configured to generate first target information in response to a first application in a first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device; the first application running in the first electronic device and a second electronic device; the first information including multimedia information acquired by hardware in the second electronic device and transmitted to the first electronic device via the first application; the second information including multimedia information acquired by hardware in the first electronic device; the first target information having at least a portion of the meaning of the multimedia information acquired by the first electronic device and / or the second electronic device; a determination module, configured to determine at least one second application in the first electronic device, the first application being different from the second application, the second application running in both the first electronic device and a third electronic device; the first application being used for real-time multimedia information transmission between the first electronic device and the second electronic device; and a transmission module, configured to transmit the first target information to the third electronic device via the second application, such that the second application of the third electronic device outputs the first target information.

[0013] Another aspect of this disclosure provides a first electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein, when the one or more programs are executed by the one or more processors, the one or more processors cause the one or more processors to perform the method as described above.

[0014] Another aspect of this disclosure provides a computer-readable storage medium storing computer-executable instructions that, when executed, are used to implement the method described above.

[0015] Another aspect of this disclosure provides a computer program product including computer-executable instructions that, when executed, are used to implement the method described above. Attached Figure Description

[0016] The above and other objects, features and advantages of this disclosure will become clearer from the following description of embodiments with reference to the accompanying drawings, in which:

[0017] Figure 1 The illustration shows exemplary application scenarios where information processing methods can be applied according to embodiments of the present disclosure;

[0018] Figure 2 This diagram illustrates another exemplary application scenario in which the information processing method can be applied according to embodiments of the present disclosure.

[0019] Figure 3 The schematic illustration shows the information flow in a first electronic device according to an embodiment of the present disclosure;

[0020] Figure 4 A flowchart illustrating an information processing method according to an embodiment of the present disclosure is shown schematically.

[0021] Figure 5 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically;

[0022] Figure 6 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically;

[0023] Figure 7 A flowchart illustrating the transmission of first target information in an information processing method according to an embodiment of the present disclosure is shown schematically.

[0024] Figure 8 This illustration schematically shows a flowchart of generating first target information in an information processing method according to an embodiment of the present disclosure;

[0025] Figure 9 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically;

[0026] Figure 10 This schematically illustrates a flowchart of the information processing method for outputting second target information according to an embodiment of the present disclosure;

[0027] Figure 11 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically;

[0028] Figure 12 A block diagram schematically illustrates an information processing apparatus according to embodiments of the present disclosure; and

[0029] Figure 13 A block diagram of an electronic device suitable for implementing the methods described above, according to embodiments of the present disclosure, is illustrated schematically. Detailed Implementation

[0030] The embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.

[0031] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0032] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0033] When using expressions such as "at least one of A, B and C", they should generally be interpreted in accordance with the meaning that is commonly understood by those skilled in the art (e.g., "a system having at least one of A, B and C" should include, but is not limited to, a system having A alone, a system having B alone, a system having C alone, a system having A and B, a system having A and C, a system having B and C, and / or a system having A, B and C, etc.).

[0034] In the embodiments disclosed herein, the collection, updating, analysis, processing, use, transmission, provision, disclosure, and storage of data (e.g., including but not limited to user personal information) comply with relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. In particular, necessary measures have been taken to prevent unauthorized access to user personal information data and to safeguard user personal information security, network security, and national security.

[0035] In the embodiments disclosed herein, user authorization or consent is obtained before acquiring or collecting user personal information.

[0036] Embodiments of this disclosure provide an information processing method applied to a first electronic device, comprising: generating first target information in response to a first application in the first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device; wherein the first application runs in both the first and second electronic devices; the first information includes multimedia information acquired by hardware in the second electronic device and transmitted to the first electronic device via the first application; the second information includes multimedia information acquired by hardware in the first electronic device; the first target information has at least a portion of the meaning of the multimedia information acquired by the first and / or second electronic devices; determining at least one second application in the first electronic device, wherein the first application is different from the second application, the second application runs in both the first and third electronic devices; the first application is used for real-time audio and / or video transmission between the first and second electronic devices, and the second application is used for real-time audio and / or video transmission between the first and third electronic devices; and transmitting the first target information to the third electronic device via the second application, such that the second application of the third electronic device outputs the first target information.

[0037] Figure 1 An exemplary application scenario 100 in which the information processing method can be applied according to embodiments of this disclosure is illustrated. It should be noted that... Figure 1 The examples shown are merely examples of application scenarios that can be applied to the embodiments of this disclosure, in order to help those skilled in the art understand the technical content of this disclosure, but do not mean that the embodiments of this disclosure cannot be used in other devices, systems, environments or scenarios.

[0038] like Figure 1 As shown, application scenario 100 according to this embodiment may include a first electronic device 110, a second electronic device 120, a third electronic device 130, and a network 140. The network 140 serves as a medium for providing a communication link between the first electronic device 110, the second electronic device 120, and the third electronic device 130. The network 140 may include various connection types, such as wired and / or wireless communication links, etc.

[0039] The first electronic device 110 can be configured with a first application 111 and a second application 112, the second electronic device 120 can be configured with the first application 111, and the third electronic device can be configured with the second application 112. The first application 111 and the second application 112 can be used for real-time communication between different devices, such as real-time text transmission, audio transmission, video transmission, and image transmission. The first application 111 and the second application 112 are different real-time transmission applications.

[0040] Real-time communication is established between the first application 111 in the second electronic device 120 and the first application 111 in the first electronic device 110, enabling real-time interaction between the user of the first electronic device and the user of the second electronic device. Real-time communication is also established between the second application 112 in the third electronic device 130 and the second application 112 in the first electronic device 110, enabling real-time interaction between the user of the first electronic device and the user of the third electronic device.

[0041] The first electronic device 110 can process the information received by the first application 111 and / or the information that the first application 111 needs to send, and transmit the processed information through the second application 112, so that the first application 111 and the second application 112 can achieve real-time communication.

[0042] Figure 2 The diagram illustrates another exemplary application scenario in which the information processing method can be applied according to embodiments of the present disclosure.

[0043] like Figure 2 As shown, user A inputs information A based on the first application 111 in the second electronic device 120, and the first application 111 in the second electronic device 120 transmits information A to the first application 111 in the first electronic device 110; user B inputs information B based on the second application 112 in the third electronic device 130, and the second application 112 in the third electronic device 130 transmits information B to the second application 112 in the first electronic device 110; the first electronic device 110 processes the information A obtained by the first application 111 and the information B obtained by the second application 112 to obtain processed information, for example, superimposing information A and information B, and outputting the processed information based on the output signal and the output device in the first electronic device, so that user C using the first electronic device 110 can know information A and information B.

[0044] User C inputs information C based on the hardware in the first electronic device. The first electronic device 110 processes information C and information B to obtain processed information, such as superimposing information C and information B, and transmits it to the first application 111 in the second electronic device 120 based on the first application 111 in the first electronic device 110. After obtaining the information, the first application 111 in the second electronic device 120 outputs it to the user based on the output device in the second electronic device, so that user A can obtain information B and information C.

[0045] User C inputs information C based on the hardware in the first electronic device. The first electronic device 110 processes information C and information A to obtain processed information, such as superimposing information C and information A, and transmits it to the second application 112 in the third electronic device 130 based on the first application 112 in the first electronic device 110. After obtaining the information, the second application 112 in the third electronic device 130 outputs it to the user based on the output device in the third electronic device, so that user B can obtain information A and information C.

[0046] Figure 3 The illustration schematically shows the information flow in a first electronic device according to an embodiment of the present disclosure.

[0047] like Figure 3 As shown, when the first application 111 in the first electronic device 110 outputs information 1, it will be output by the first electronic device through the output device in the first electronic device. When the second application 112 outputs information 2, information 2 will be output by the first electronic device through the output device. When information 1 and information 2 are output by the corresponding applications at the same time, information 1 and information 2 will be processed, for example, information 1 and information 2 will be superimposed and output through the output device. When the hardware of the first electronic device collects information 3, it will process information 3 and information 2, for example, information 2 and information 3 will be superimposed and then input into the first application 111 so that the first application 111 can transmit information 2 and information 3. Correspondingly, information 3 and information 1 can be processed, for example, information 1 and information 3 will be superimposed and then input into the second application 112 so that the second application 112 can transmit information 1 and information 3.

[0048] The first electronic device 110, the second electronic device 120, and the third electronic device 130 can be various electronic devices with communication functions, including but not limited to smartphones, tablets, laptops, and desktop computers.

[0049] It should be noted that the information processing method provided in this embodiment can generally be executed by the first electronic device 110. Correspondingly, the information processing system provided in this embodiment can generally be located within the first electronic device 110. The information processing method provided in this embodiment can also be executed by a server or server cluster that is different from the first electronic device 110 but capable of communicating with it. Correspondingly, the information processing system provided in this embodiment can also be located within a server or server cluster that is different from the first electronic device 110 but capable of communicating with it.

[0050] It should be understood that Figure 1 The number of electronic devices and networks shown is merely illustrative. Any number of electronic devices and networks can be included depending on implementation needs.

[0051] Figure 4 A flowchart illustrating an information processing method according to an embodiment of the present disclosure is shown schematically.

[0052] like Figure 4 As shown, the method includes operations S410~S430.

[0053] In operation S410, in response to a first application in the first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device, first target information is generated. The first application runs in both the first and second electronic devices. The first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application. The second information includes multimedia information collected by hardware in the first electronic device. The first target information has at least a portion of the same meaning as the multimedia information collected by the first and / or second electronic devices.

[0054] The first application is an application running on both the first and second electronic devices, enabling real-time communication between them. The second application is an application running on both the first and third electronic devices, different from the first application, enabling real-time communication between them.

[0055] The first information is multimedia information collected by the second electronic device and transmitted to the first electronic device through the first application. For example, user voice collected on the second electronic device is transmitted to the first electronic device through the first application.

[0056] The second information is multimedia information collected by the hardware of the first electronic device, such as images captured by the camera or sounds captured by the microphone on the first electronic device, which is obtained directly without being transmitted through other applications.

[0057] The first target information is information processed based on the first information and the second information. It is generated by combining or processing the first information and / or the second information to create first target information with a specific meaning. The first target information with a specific meaning includes at least a portion of the meaning of the first information and / or the second information; it is a combination or extraction of these information. For example, after receiving audio (first information) from a second electronic device, the first electronic device combines locally captured video footage (second information) with the audio information to form a complete audio-visual stream, which is the first target information.

[0058] In operation S420, at least one second application in a first electronic device is determined. The first application is different from the second application. The second application runs in both the first electronic device and the third electronic device. The first application is used for real-time multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for real-time multimedia information transmission between the first electronic device and the third electronic device.

[0059] The first electronic device identifies an application different from the first application (i.e., the second application) for audio and video transmission with the third electronic device. A whitelist can be used to pre-determine which applications can be identified for subsequent information transmission. After the first target information is generated, the first electronic device checks whether any applications in the whitelist are running; if so, they are considered the second application.

[0060] In operation S430, the first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

[0061] Since different applications may handle different types of multimedia information—for example, the first application might be used for real-time audio transmission while the second application is used for real-time text transmission—the first information obtained by the first application is audio information. However, when transmitting this first target information to the third electronic device via the second application, which can only process text information, the data type of the first target information must also be text information. To ensure successful transmission, the first target information must have at least a partial meaning identical to the multimedia information acquired by the first and / or second electronic devices, thus achieving the goal of correctly transmitting the information to the third electronic device.

[0062] Based on the above, the following are specific examples:

[0063] For example, a host needs to conduct video calls simultaneously with two different participants (a first electronic device). The host (first electronic device) needs to conduct video calls with two different participants (a second electronic device and a third electronic device), each using a different application. The first electronic device (host) runs a first application and conducts a video conference with the second electronic device (participant A). The audio captured by the second electronic device is transmitted to the first electronic device via the first application, i.e., the first information. Simultaneously, the first electronic device uses its local camera to capture video, i.e., the second information. After obtaining the first information (participant A's audio) and the second information (locally captured video), the first electronic device combines them into a first target information. The host needs to send the combined first target information (audio and video stream) to another participant (participant B) on the third electronic device, who is using the second application. Therefore, after determining that the second application is running on the device, the first electronic device transmits the combined first target information through the second application. Finally, the second application on the third electronic device receives and outputs the audio and video stream, achieving real-time multi-party audio and video communication with different applications.

[0064] Figure 5 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically.

[0065] According to embodiments of this disclosure, based on the foregoing embodiments, the first information and / or the second information are acquired in real time. For example... Figure 5 As shown, operation S410 may include operation S510.

[0066] During operation of S510, first target information is generated in real time based on first information and / or second information.

[0067] Based on this, operation S430 may include operation S520.

[0068] During operation S520, the first target information generated in real time is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information in real time.

[0069] To ensure normal communication between the first electronic device, the second electronic device, and the third electronic device, the first target information is generated in real time based on the first information and / or the second information acquired in real time.

[0070] Since the first target information is generated in real time, the first information and / or the second information can be processed as follows:

[0071] Data buffering and preprocessing are performed on the first and / or second information to handle unavoidable minor delays and irregular packet arrivals during network transmission. Specifically, a buffer is created in the first electronic device to temporarily store arriving packets to smooth network jitter and provide a continuous data stream for subsequent processing. The first and / or second information undergoes processes including, but not limited to, denoising, automatic gain control (AGC), sound clarity enhancement, brightness adjustment, contrast optimization, and preliminary motion compensation.

[0072] Data synchronization of the first and / or second information is performed to prevent audio-visual asynchrony. Specifically, a timestamping algorithm can be used, where each audio / video data packet is timestamped. During processing, the first electronic device synchronizes the audio and video streams based on the timestamps. Alternatively, a synchronization algorithm can be used; for example, cross-referencing can be performed using data in a buffer to ensure that video frames are time-aligned with their corresponding audio segments.

[0073] Data conversion is necessary because the first and / or second information may contain a large amount of data during acquisition to ensure acquisition quality. Since an intermediate conversion step exists in this embodiment, data conversion is required to ensure real-time transmission of the information. For example, the sampling rate of the audio information in the first and / or second information is determined. When the sampling rate is greater than or equal to a preset sampling rate threshold, the audio information in the first and / or second information is down-converted based on the preset sampling rate threshold. The keyframe interval and / or bit rate of the video information in the first and / or second information are determined. When the keyframe interval and / or bit rate meet the adjustment requirements, the video information in the first and / or second information is adjusted to reduce the data footprint of the first and / or second information without losing its meaning.

[0074] To ensure that the process of transmitting the first target information generated in real time to the third electronic device via the second application is also performed in real time, the following processing can be performed:

[0075] The first electronic device continuously monitors network bandwidth and latency. If network bandwidth and latency do not meet requirements, it reduces the transmission bit rate of audio and / or video data in the first and / or second information. Building upon the buffer used in the foregoing embodiments, the method may further include dynamically adjusting the buffer based on the amount of data in the first and / or second information.

[0076] Figure 6 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically.

[0077] According to embodiments of this disclosure, multimedia information includes at least one of audio information, video information, text information, and image information, and operation S410 may include operation S610.

[0078] In operation S610, first target information is generated based on at least one of the audio information, video information, text information, and image information collected by the hardware in the second electronic device, and / or at least one of the audio information, video information, text information, and image information collected by the hardware in the first electronic device.

[0079] Specifically, based on preset communication scenario settings, the current communication type can be determined, and the first target information can be generated accordingly. For example, if the current scenario only requires audio communication, assuming the first application will transmit audio, video, and text information simultaneously as the first information, then the video and text information within the video information will not participate in the communication. Based on this, audio-related information can be extracted from the first information, and the extracted information can be used to generate the first target information.

[0080] Figure 7 A flowchart illustrating the transmission of first target information in an information processing method according to an embodiment of the present disclosure is shown.

[0081] According to embodiments of this disclosure, the first target information may include at least one of audio information, video information, text information, and image information. Operation S430 may include operations S710-S720.

[0082] In operation S710, a first type of multimedia information for which the second application has transmission rights is determined.

[0083] During operation of S720, through a second application, audio information and / or video information and / or text information and / or image information conforming to the first type in the first target information are transmitted to a third electronic device.

[0084] The first type represents the multimedia information type that the second application has communication permissions for in the current scenario. For example, the first application is a real-time audio / video communication application, and the second application is also a real-time audio / video communication application. Suppose that the third electronic device using the second application to communicate with the first electronic device is the electronic device used by the speaker. The speaker needs to display video footage and communicate with other participants. In this communication scenario, each communicating party only needs to see the video footage transmitted by the second application, and does not need to see the video footage transmitted by the first application. Therefore, when the first application obtains first information containing video information, the first target information generated based on the first information and / or the second information may contain video information. If the first target information is transmitted through the second application at this time, it may interfere with the footage displayed by the speaker. Therefore, it is necessary to determine the multimedia information type that the second application has transmission permissions for based on preset communication permissions, and transmit the audio information and / or video information, and / or text information, and / or image information in the first target information that conforms to this type to the third electronic device to avoid interfering with the multimedia information being transmitted by the second application.

[0085] Figure 8 The flowchart illustrating the generation of first target information in an information processing method according to an embodiment of the present disclosure is shown schematically.

[0086] like Figure 8 As shown, based on the aforementioned embodiments, operation S410 may include operations S810 to S830.

[0087] In operation S810, a second type of multimedia information that the second application can transmit is determined.

[0088] The second type represents the types of multimedia information that the second application supports and is capable of transmitting. For example, if the second application is a voice call application whose function is only to transmit audio information, then the second type corresponding to this second application is the audio information type.

[0089] In operation S820, at least part of the first information and / or the second information that does not conform to the second type of multimedia information is converted into multimedia information with the same meaning that conforms to the second type.

[0090] The first and / or second information may contain multimedia information that does not conform to the second type. For example, the first and / or second information may also contain text information, video information, etc., which cannot be transmitted through the second application. Therefore, at least some of the multimedia information in the first and / or second information can be converted into multimedia information with the same meaning that conforms to the second type. For example, the text information in the first and / or second information can be converted into audio information corresponding to the text.

[0091] In operation S830, first target information is generated based on the converted multimedia information, and the first information, and / or the second information that conforms to the second type of multimedia information.

[0092] Based on the converted multimedia information, and the multimedia information that conforms to the second type in the first information and / or the second information, first target information is generated. All the generated first target information conforms to the second type, so that the first target information can be transmitted by the second application.

[0093] Figure 9 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically.

[0094] like Figure 9 As shown, the information processing method may also include operations S910~S920.

[0095] In operation S910, in response to the second application obtaining third information and / or in response to the first application obtaining first information, second target information is generated. The third information includes multimedia information collected by hardware in the third electronic device and transmitted to the first electronic device through the second application. The second target information has the same meaning as at least part of the multimedia information collected by the second electronic device and / or the third electronic device.

[0096] When operating the S920, output the second target information.

[0097] The third information is multimedia information collected by the third electronic device and transmitted to the first electronic device through the first application. For example, user voice collected on the third electronic device is transmitted to the first electronic device through the first application.

[0098] Similar to the first target information, the second target information is generated based on the first information and / or the third information. After acquiring the second target information, the first electronic device outputs the second target information. Specifically, the first electronic device outputs at least a portion of the second target information based on a multimedia output device configured on the first electronic device. For example, it outputs audio information from the second target information based on an audio output device configured on the first electronic device; or it outputs video information and / or text information from the second target information based on a display device on the first electronic device.

[0099] Figure 10 A flowchart illustrating the output of second target information in an information processing method according to an embodiment of the present disclosure is shown.

[0100] According to embodiments of this disclosure, the second target information includes at least one of audio information, video information, text information, and image information. For example... Figure 10As shown, based on the aforementioned embodiments, operation S920 may include operations S1010 to S1020.

[0101] In operation S1010, the communication permissions of the first electronic device are determined. The communication permissions represent the types of multimedia information that the first electronic device has the right to output.

[0102] In operation S1020, audio information and / or video information and / or text information and / or image information that meet the communication permissions in the second target information are output.

[0103] and Figure 7 The embodiments shown are similar, in Figure 7 In the illustrated embodiment, the second application has corresponding communication permissions, and correspondingly, the first electronic device may also have corresponding output permissions. For example, if the first electronic device acts as an intermediary, and assuming that the audio communication between the user of the second electronic device and the user of the third electronic device needs to be kept confidential and cannot be known by the intermediary using the first electronic device, then the first electronic device does not have audio output permissions. Figure 9 In the second target information obtained in the Chinese embodiment, audio information cannot be output; only other information, such as text information, can be output.

[0104] According to embodiments of this disclosure, the information processing method may further include: the third information being acquired in real time; generating the second target information may include: generating the second target information in real time based on the first information and / or the third information; outputting the second target information may include: outputting the second target information in real time. Its specific content and explanation are consistent with... Figure 5 The generation of the first target information in real time based on the first information and / or the second information, as well as the real-time transmission of the first target information, are similar in the embodiments shown and will not be described in detail here.

[0105] According to embodiments of this disclosure, the information processing method for outputting second target information may include: determining a third type of multimedia information that a first electronic device can output; converting at least part of the multimedia information in the first information and / or the third information that does not conform to the third type into multimedia information with the same meaning but conforming to the third type; and generating second target information based on the converted multimedia information and the multimedia information in the first information and / or the third information that conforms to the third type. Its specific content and explanation are consistent with... Figure 8 The content regarding the second type and the data conversion based on the second type to generate the first target information in the illustrated embodiment is similar and will not be repeated here.

[0106] According to embodiments of this disclosure, the information processing method may further include: generating third target information in response to a second application in a second electronic device obtaining fourth information, and / or in response to a first electronic device obtaining second information; the third target information having at least a portion of the meaning of multimedia information collected by the first electronic device and / or the third electronic device; determining at least one second application in the first electronic device; and transmitting the third target information to the second electronic device through the first application, causing the first application of the second electronic device to output the third target information. Its specific content and explanation are consistent with... Figure 4 The content regarding the generation of the first target information and the transmission of the first target information based on the first application in the illustrated embodiment is similar and will not be repeated here.

[0107] According to embodiments of this disclosure, the information processing method may further include, based on the foregoing embodiments: the fourth information is acquired in real time; third target information is generated in real time based on the second information and / or the fourth information; the third target information is transmitted to the second electronic device via a first application, including: transmitting the real-time generated third target information to the second electronic device via the first application in real time, so that the first application of the second electronic device outputs the third target information in real time. Its specific content and explanation are consistent with... Figure 5 The generation of the first target information in real time based on the first information and / or the second information, as well as the real-time transmission of the first target information, are similar in the embodiments shown and will not be described in detail here.

[0108] According to embodiments of this disclosure, based on the foregoing embodiments, the information processing method may further include: the third target information includes at least one of audio information, video information, text information, and image information; transmitting the third target information to a second electronic device through a first application includes: determining a fifth type of multimedia information for which the first application has transmission permissions; and transmitting, through the first application, the audio information and / or video information and / or text information and / or image information conforming to the fifth type in the third target information to the second electronic device. Its specific content and explanation are consistent with... Figure 7 The content regarding the transmission of the first target information in the illustrated embodiment is similar and will not be repeated here.

[0109] According to embodiments of this disclosure, based on the foregoing embodiments, generating third target information may include: determining a sixth type of multimedia information that the first application can transmit; converting at least part of the fourth information and / or the second information that does not conform to the sixth type of multimedia information into multimedia information with the same meaning but conforming to the sixth type; and generating third target information based on the converted multimedia information and the fourth information and / or the second information that conforms to the sixth type of multimedia information. The sixth type represents the types of multimedia information that the first application supports and is capable of transmitting. Its specific content and explanation are consistent with... Figure 8The content regarding the generation of the first target information in the illustrated embodiment is similar and will not be repeated here.

[0110] Figure 11 Another flowchart of an information processing method according to an embodiment of the present disclosure is illustrated schematically.

[0111] like Figure 11 As shown, based on the foregoing embodiments, the information processing method may further include operations S1110 to S1130.

[0112] In operation S1110, in response to the startup of the third application, it is determined whether the third application meets the preset communication conditions. The third application runs in the first electronic device and the fourth electronic device. The third application is different from the first application and the second application.

[0113] In operation S1120, if the third application meets the preset communication conditions, when the third application obtains the fourth information, the third application is treated as the first application, and the fourth information is treated as the first information. The same operations as those performed on the first application and the first information are then performed. The fourth information includes multimedia information acquired by the hardware in the fourth electronic device and transmitted to the first electronic device through the first application.

[0114] In operation S1130, if the third application meets the preset communication conditions, when it is necessary to transmit multimedia information to the fourth electronic device based on the third application, the third application is regarded as the second application and the same operation as the second application is performed.

[0115] For example, Person A, acting as an intermediary, uses the first and second applications via a first electronic device; Person B uses the first application via a second electronic device; and Person C uses the second application via a third electronic device. Persons A, B, and C can achieve real-time multi-party cross-device and cross-application communication based on the method provided in the aforementioned embodiments. While Persons A, B, and C are communicating, Person D, using the third application on a fourth electronic device, wishes to join the meeting. In this case, the third application is launched on the first electronic device, and in response to its launch, it is determined whether the third application meets preset communication conditions. These preset communication conditions indicate that the third application has the permission to communicate with the first and second applications; in terms of personnel, this means that Person D is eligible to join the meeting. When the third application meets the preset communication conditions, when the fourth electronic device receives information, it is treated as the second application, and the operations for the second application in the aforementioned embodiments are executed; when the third application on the fourth electronic device sends information, it is treated as the first application, and the operations for the first application in the aforementioned embodiments are executed. In this way, the third application on the fourth electronic device joins the communication scenario of the first and second applications.

[0116] Figure 12A block diagram of an information processing apparatus according to an embodiment of the present disclosure is shown schematically.

[0117] like Figure 12 As shown, the information processing device 1200 includes a generation module 1210, a determination module 1220, and a transmission module 1230.

[0118] The generation module 1210 is configured to generate first target information in response to a first application in the first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device. The first application runs in both the first and second electronic devices. The first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application. The second information includes multimedia information collected by hardware in the first electronic device. The first target information has at least a portion of the same meaning as the multimedia information collected by the first and / or second electronic devices. In some embodiments, the generation module 1210 may be used to perform operation S410 in the aforementioned method, which will not be elaborated here.

[0119] The determining module 1220 is used to determine at least one second application in the first electronic device. The first application is different from the second application. The second application runs in both the first electronic device and the third electronic device. The first application is used for real-time audio and / or video transmission between the first electronic device and the second electronic device, and the second application is used for real-time audio and / or video transmission between the first electronic device and the third electronic device. In some embodiments, the determining module 1220 may be used to perform operation S420 in the aforementioned method, which will not be described in detail here.

[0120] The transmission module 1230 is used to transmit the first target information to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information. In some embodiments, the transmission module 1230 can be used to perform operation S430 in the aforementioned method, which will not be described in detail here.

[0121] Any one or more of the modules, submodules, units, and subunits according to embodiments of the present disclosure, or at least part of the functions of any one or more of them, can be implemented in one module. Any one or more of the modules, submodules, units, and subunits according to embodiments of the present disclosure can be implemented by dividing them into multiple modules. Any one or more of the modules, submodules, units, and subunits according to embodiments of the present disclosure can be at least partially implemented as hardware circuitry, such as a Field-Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a System-on-Chip, a System-on-a-Substrate, a System-on-Package, an Application-Specific Integrated Circuit (ASIC), or implemented in hardware or firmware by any other reasonable means of integrating or packaging circuitry, or implemented in software, hardware, or firmware, or in any suitable combination of any of these three implementation methods. Alternatively, one or more of the modules, submodules, units, and subunits according to embodiments of the present disclosure can be at least partially implemented as computer program modules, which, when run, can perform corresponding functions.

[0122] For example, any plurality of the generation module 1210, determination module 1220, and transmission module 1230 may be combined into one module / unit / subunit, or any one of these modules / units / subunits may be split into multiple modules / units / subunits. Alternatively, at least part of the functionality of one or more of these modules / units / subunits may be combined with at least part of the functionality of other modules / units / subunits and implemented in one module / unit / subunit. According to embodiments of the present disclosure, at least one of the generation module 1210, determination module 1220, and transmission module 1230 may be at least partially implemented as hardware circuitry, such as a field-programmable gate array (FPGA), a programmable logic array (PLA), a system-on-a-chip, a system-on-a-substrate, a system-on-package, an application-specific integrated circuit (ASIC), or any other reasonable means of integrating or packaging circuitry, or implemented in software, hardware, or firmware, or in any suitable combination of any of these three implementation methods. Alternatively, at least one of the generation module 1210, the determination module 1220, and the transmission module 1230 may be implemented at least partially as a computer program module, which can perform corresponding functions when the computer program module is run.

[0123] It should be noted that the data processing system part in the embodiments of this disclosure corresponds to the data processing method part in the embodiments of this disclosure. The specific description of the data processing system part is referred to in the data processing method part, and will not be repeated here.

[0124] Figure 13A block diagram of an electronic device suitable for implementing the methods described above, according to embodiments of the present disclosure, is illustrated schematically. Figure 13 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0125] like Figure 13 As shown, an electronic device 1300 according to an embodiment of the present disclosure includes a processor 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage portion 1308 into a random access memory (RAM) 1303. The processor 1301 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 1301 may also include onboard memory for caching purposes. The processor 1301 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0126] RAM 1303 stores various programs and data required for the operation of electronic device 1300. Processor 1301, ROM 1302, and RAM 1303 are interconnected via bus 1304. Processor 1301 performs various operations of the method flow according to embodiments of the present disclosure by executing programs in ROM 1302 and / or RAM 1303. It should be noted that the programs may also be stored in one or more memories other than ROM 1302 and RAM 1303. Processor 1301 may also perform various operations of the method flow according to embodiments of the present disclosure by executing programs stored in said one or more memories.

[0127] According to embodiments of this disclosure, the electronic device 1300 may further include an input / output (I / O) interface 1305, which is also connected to a bus 1304. The electronic device 1300 may also include one or more of the following components connected to the input / output (I / O) interface 1305: an input section 1306 including a keyboard, mouse, etc.; an output section 1307 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1308 including a hard disk, etc.; and a communication section 1309 including a network interface card such as a LAN card, modem, etc. The communication section 1309 performs communication processing via a network such as the Internet. A drive 1310 is also connected to the input / output (I / O) interface 1305 as needed. A removable medium 1311, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 1310 as needed so that computer programs read from it can be installed into the storage section 1308 as needed.

[0128] According to embodiments of this disclosure, the method flow according to embodiments of this disclosure can be implemented as a computer software program. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable storage medium, the computer program containing program code for performing the methods shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1309, and / or installed from removable medium 1311. When the computer program is executed by processor 1301, it performs the functions defined in the system of embodiments of this disclosure. According to embodiments of this disclosure, the systems, devices, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0129] This disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs that, when executed, implement the method according to the embodiments of this disclosure.

[0130] According to embodiments of this disclosure, the computer-readable storage medium can be a non-volatile computer-readable storage medium. Examples include, but are not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0131] For example, according to embodiments of this disclosure, a computer-readable storage medium may include one or more memories other than the ROM 1302 and / or RAM 1303 described above.

[0132] Embodiments of this disclosure also include a computer program product comprising a computer program containing program code for performing the methods provided in the embodiments of this disclosure. When the computer program product is run on an electronic device, the program code is used to enable the electronic device to implement the information processing methods provided in the embodiments of this disclosure.

[0133] When the computer program is executed by the processor 1301, it performs the functions defined in the system / apparatus of this disclosure embodiments. According to embodiments of this disclosure, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0134] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of signals over a network medium, and may be downloaded and installed via the communication section 1309, and / or installed from the removable medium 1311. The program code contained in the computer program can be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination thereof.

[0135] According to embodiments of this disclosure, program code for executing the computer programs provided in embodiments of this disclosure can be written in any combination of one or more programming languages. Specifically, these computational programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C", or similar programming languages. The program code can execute entirely on a user's computing device, partially on a user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions. Those skilled in the art will understand that the features described in the various embodiments of the present disclosure can be combined and / or combined in various ways, even if such combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments of this disclosure may be combined and / or combined in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0137] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.

Claims

1. An information processing method, applied to a first electronic device, comprising: In response to a first application in a first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device, first target information is generated, wherein the first application runs in both the first and second electronic devices, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by hardware in the first electronic device. The first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device. The first target information is obtained by combining or extracting at least part of the meaning of the first information and / or the second information. Identify at least one second application in the first electronic device, the first application being different from the second application, the second application running in both the first electronic device and the third electronic device, the first application being used for real-time multimedia information transmission between the first electronic device and the second electronic device, and the second application being used for real-time multimedia information transmission between the first electronic device and the third electronic device; The first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

2. The method according to claim 1, wherein the first information and / or the second information are acquired in real time, and the generation of the first target information includes: The first target information is generated in real time based on the first information and / or the second information; The step of transmitting the first target information to the third electronic device through the second application includes: The first target information generated in real time is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information in real time.

3. The method according to claim 1, wherein the multimedia information includes at least one of audio information, video information, text information, and image information, and the generation of the first target information includes: The first target information is generated based on at least one of the audio information, video information, text information, and image information collected by the hardware in the second electronic device, and / or at least one of the audio information, video information, text information, and image information collected by the hardware in the first electronic device.

4. The method according to any one of claims 1-3, wherein the first target information includes at least one of audio information, video information, text information, and image information, and the step of transmitting the first target information to the third electronic device through the second application includes: Determine the first type of multimedia information that the second application has transmission rights for; Through the second application, audio information and / or video information and / or text information and / or image information that conform to the first type in the first target information are transmitted to the third electronic device.

5. The method according to any one of claims 1-3, wherein generating the first target information comprises: Determine the second type of multimedia information that the second application can transmit; The first information and / or at least part of the second information that does not conform to the second type of multimedia information are converted into multimedia information with the same meaning that conforms to the second type; The first target information is generated based on the converted multimedia information, the first information, and / or the multimedia information in the second information that conforms to the second type.

6. The method according to claim 1, further comprising: In response to the second application obtaining third information, and / or in response to the first application obtaining first information, second target information is generated, the third information including multimedia information collected by hardware in the third electronic device and transmitted to the first electronic device through the second application, and the second target information has the same meaning as at least part of the multimedia information collected by the second electronic device and / or the third electronic device; Output the second target information.

7. The method according to claim 6, wherein the second target information includes at least one of audio information, video information, text information, and image information, and the step of outputting the second target information includes: The communication permissions of the first electronic device are determined, wherein the communication permissions characterize the types of multimedia information that the first electronic device has the right to output; Output the audio information, and / or video information, and / or text information, and / or image information in the second target information that meet the communication permissions.

8. The method according to claim 1, further comprising: In response to the launch of a third application, it is determined whether the third application meets preset communication conditions. The third application runs in the first electronic device and the fourth electronic device. The third application is different from the first application and the second application. When the third application meets the preset communication conditions, when the third application obtains the fourth information, the third application is regarded as the first application and the fourth information is regarded as the first information. The same operation as the first application and the first information is performed. The fourth information includes multimedia information collected by the hardware in the fourth electronic device and transmitted to the first electronic device through the first application. When the third application meets the preset communication conditions, and when it is necessary to transmit multimedia information to the fourth electronic device based on the third application, the third application is regarded as the second application and the same operation as the second application is performed.

9. An information processing apparatus, comprising: A generation module is configured to generate first target information in response to a first application in a first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device. The first application runs in both the first electronic device and the second electronic device. The first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application. The second information includes multimedia information collected by hardware in the first electronic device. The first target information has the same meaning as at least part of the multimedia information collected by the first electronic device and / or the second electronic device. The first target information is obtained by combining or extracting at least part of the meaning of the first information and / or the second information. A determining module is configured to determine at least one second application in the first electronic device, the first application being different from the second application, the second application running in both the first electronic device and the third electronic device, the first application being used for real-time multimedia information transmission between the first electronic device and the second electronic device, and the second application being used for real-time multimedia information transmission between the first electronic device and the third electronic device; as well as A transmission module is configured to transmit the first target information to the third electronic device via the second application, so that the second application of the third electronic device outputs the first target information.

10. A first electronic device, the first electronic device being configured with a first application and a second application, the first electronic device comprising: One or more processors; Memory, used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the following method: In response to a first application in a first electronic device obtaining first information, and / or in response to a second information obtained by the first electronic device, first target information is generated, wherein the first application runs in both the first and second electronic devices, the first information includes multimedia information collected by hardware in the second electronic device and transmitted to the first electronic device through the first application, and the second information includes multimedia information collected by hardware in the first electronic device. The first target information has the same meaning as at least a portion of the multimedia information collected by the first electronic device and / or the second electronic device. The first target information is obtained by combining or extracting at least a portion of the meaning of the first information and / or the second information. At least one second application is determined in the first electronic device. The first application is different from the second application. The second application runs in both the first electronic device and the third electronic device. The first application is used for real-time multimedia information transmission between the first electronic device and the second electronic device, and the second application is used for real-time multimedia information transmission between the first electronic device and the third electronic device. The first target information is transmitted to the third electronic device through the second application, so that the second application of the third electronic device outputs the first target information.

Images