Information processing methods, apparatus, devices, storage media, and computer programs
The method assigns identifiers to subtitle information in live broadcasts with multiple microphone users, ensuring accurate and enhanced subtitle display, thereby improving user experience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2024-04-10
- Publication Date
- 2026-05-11
AI Technical Summary
In live broadcast scenarios with multiple microphone-connected users speaking simultaneously, the subtitle display effect fails to meet user needs, affecting the viewing experience.
An information processing method and apparatus that assigns a microphone-connected client identifier and/or a target identifier to subtitle information, enabling accurate display of multiple subtitle pieces based on audio data from each client.
Improves the accuracy of subtitle display in live broadcast microphone connections by distinguishing and displaying subtitle information correctly, enhancing user experience.
Smart Images

Figure 2026514520000001_ABST
Abstract
Description
Technical Field
[0001] This application claims the priority of a Chinese patent application with an application number of 202310474964.9 and an invention title of "Information Processing Method, Apparatus, Device, and Storage Medium", which was proposed on April 27, 2023. All the contents of this application are incorporated into this application by reference.
[0002] Embodiments of the present disclosure relate to the technical field of live broadcast information processing, and particularly to an information processing method, apparatus, device, and storage medium.
Background Art
[0003] In the scenario of live broadcast microphone connection (collaborative live broadcast), subtitles are added to the live broadcast to improve the viewing experience of users. In the related art, when multiple microphone-connected users speak simultaneously, the subtitle display effect cannot meet the needs of users and affects the user experience.
Summary of the Invention
Problems to be Solved by the Invention
[0004] Embodiments of the present disclosure provide an information processing method, apparatus, device, and storage medium that can improve the accuracy of subtitle display in the live broadcast microphone connection process.
Means for Solving the Problems
[0005] According to a first aspect, embodiments of the present disclosure provide an information processing method, which includes obtaining a plurality of subtitle information corresponding to a plurality of microphone connection clients, where the subtitle information is attached with a microphone connection client identifier and / or a target identifier corresponding to the microphone connection client, and the subtitle information is determined by the audio data of the microphone connection client; This includes transmitting the multiple subtitle pieces to a target client, causing the target client to distinguish and display the multiple subtitle pieces based on the target identifier.
[0006] According to a second aspect, embodiments of the present disclosure further provide an information processing apparatus, which is A subtitle information acquisition module for acquiring multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client; The system includes a subtitle information transmission module that transmits the aforementioned multiple subtitle information to a target client, causing the target client to distinguish and display the aforementioned multiple subtitle information based on the target identifier.
[0007] According to a third aspect, embodiments of the present disclosure further provide electronic devices, said electronic devices, One or more processors, A storage device for storing one or more programs, The one or more programs are executed by the one or more processors, causing the one or more processors to implement the information processing method described in the embodiments of this disclosure.
[0008] According to a fourth aspect, embodiments of the present disclosure further provide a storage medium including computer executable instructions, which is used to perform the information processing method described in embodiments of the present disclosure when the computer executable instructions are executed by a computer processor. [Effects of the Invention]
[0009] Embodiments of this disclosure disclose an information processing method, apparatus, device, and storage medium that acquire multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, the subtitle information is determined by the audio data of the microphone-connected client, and the multiple subtitle information is transmitted to a target client so that the target client can distinguish and display the multiple subtitle information based on the microphone-connected client identifier and / or the target identifier. [Brief explanation of the drawing]
[0010] Referring to the embodiments for carrying out the invention described below, while linking the drawings, will make the above and other features, advantages and aspects of each embodiment of the present disclosure more apparent. Throughout the drawings, the same or similar symbols represent the same or similar elements. It should be understood that the drawings are schematic and parts and elements are not necessarily depicted in proportion. [Figure 1] This is a flowchart of the information processing method according to the embodiments of this disclosure. [Figure 2] This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. [Figure 3] This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. [Figure 4] This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. [Figure 5] This is an illustrative diagram of the subtitle information display according to an embodiment of the present disclosure. [Figure 6] This is an illustrative diagram of the subtitle information display according to an embodiment of the present disclosure. [Figure 7] This is a schematic diagram of the structure of an information processing device according to an embodiment of the present disclosure. [Figure 8] This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]
[0011] The following describes embodiments of the present disclosure in more detail with reference to the drawings. While the drawings show several embodiments of the present disclosure, it should be understood that the present disclosure may be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should also be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0012] It should be understood that the steps described in the method embodiments of this disclosure may be performed in a different order and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the execution of the indicated steps. The scope of this disclosure is not limited in this respect.
[0013] As used herein, the term “including” and its variations are open inclusions, i.e., “including, but not limited to.” The term “based on” means “based at least partially.” The term “one embodiment” means “at least one embodiment,” the term “another embodiment” means “at least one other embodiment,” and the term “several embodiments” means “at least several embodiments.” Relevant definitions of other terms are given in the following description.
[0014] It should be noted that the concepts of “first,” “second,” etc., as used in this disclosure are used solely to distinguish between different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.
[0015] It should be noted that the modifications “one” and “plural” as used in this disclosure are general rather than restrictive, and should be understood as “one or plural” unless otherwise explicitly stated in the context, as should be understood by those skilled in the art.
[0016] The names of messages or information that are interacted between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and do not limit the scope of these messages or information.
[0017] As can be understood, before using the technical solutions disclosed in each embodiment of the present disclosure, users should be informed in an appropriate manner about the types, usage scopes, usage scenarios, etc. of personal information related to the present disclosure in accordance with relevant laws and regulations, and the permission of the users should be obtained.
[0018] For example, when responding to a user's voluntary request, sending prompt information to the user to clearly prompt the user, and the operation of requesting its execution requires obtaining and using the user's personal information. Accordingly, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that executes the operation of the technical solution of the present disclosure according to the prompt information.
[0019] As a selectable but non-limiting implementation manner, the method of sending prompt information to the user in response to receiving the user's voluntary request may be, for example, in the form of a pop-up window, and the prompt information may be presented in text form in the pop-up window. In addition, the pop-up window may be provided with a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0020] As can be understood, the above notification and user permission acquisition process are only schematic and do not constitute a limitation to the implementation manner of the present disclosure. Other methods that meet the relevant laws and regulations may also be used in the implementation manner of the present disclosure.
[0021] As can be understood, the data related to the present technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws and regulations and related regulations.
[0022] Figure 1 is a flowchart of an information processing method according to an embodiment of the present disclosure, the embodiment of the present disclosure applies to the display of subtitles in a live streaming microphone connection process, the method may be performed by an information processing device, which may be implemented in the form of software and / or hardware, or optionally by electronic equipment, which may be a mobile terminal, PC terminal or server, etc.
[0023] As shown in Figure 1, the method includes the following:
[0024] The S110 retrieves multiple subtitle information files for multiple microphone-connected clients.
[0025] S120 sends multiple subtitle pieces to the target client, causing the target client to distinguish and display the multiple subtitle pieces based on the microphone-connected client identifier and / or target identifier.
[0026] Here, the subtitle information is associated with a microphone connection client identifier and / or a target identifier corresponding to the microphone connection client, and the subtitle information is determined by the audio data of the microphone connection client. The target identifier corresponding to the microphone connection client may be understood as the user identifier that performs the live streaming microphone connection through this microphone connection client. The subtitle information may be represented as target identifier:subtitle content.
[0027] Here, a microphone connection client may be understood as a client participating in a microphone connection. In one application scenario, multiple microphone connection clients may all be microphone connection caster sides. For example, multiple casters may each create a live streaming studio on their respective clients, and multiple casters may perform microphone connections, which may be microphone connection battles (PK), such as game PK or singing PK. In another application scenario, multiple microphone connection clients may include one microphone connection caster side and at least one microphone connection guest side. For example, a caster may perform a live stream from a client-created live streaming studio, and other users may enter this live streaming studio to watch the caster's live stream. These users become viewers, and if a viewer requests a microphone connection from the caster and the connection is successful, this viewer becomes a guest, and their client is the microphone connection guest side. In another application scenario, multiple microphone connection clients include multiple microphone connection caster sides and at least one microphone connection guest side, and exemplary, multiple casters each create a live streaming studio in their respective clients, and multiple casters may perform microphone connections, which may also be microphone connection battles (PK), and viewers of the live streaming studio where each caster is located may apply to participate in a microphone connection and become microphone connection guests, with the client where they are located being the microphone connection guest side.
[0028] In one embodiment, the multiple microphone connection clients include a target microphone connection caster, and the method is performed by the target microphone connection caster. Here, the process of obtaining multiple subtitle information corresponding to the multiple microphone connection clients may involve determining a first subtitle information based on the audio data from the target microphone connection caster and receiving a second subtitle information transmitted by the other microphone connection clients among the multiple microphone connection clients, excluding the target microphone connection caster.
[0029] Here, other microphone-connected clients may be microphone-connected casters or microphone-connected guests. The first subtitle information is obtained from the audio data of the target microphone-connected caster. The second subtitle information is obtained from the audio data of other microphone-connected clients, and this second subtitle information is transmitted to the target microphone-connected caster. The subtitle information of each microphone-connected client may be obtained from its own audio data, and known techniques may be used to obtain subtitles from audio data, which will not be explained further here.
[0030] Selectively, multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The process of receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster side among the multiple microphone connection clients may also be receiving second subtitle information transmitted by a microphone connection caster side other than the target microphone connection caster side among the multiple microphone connection caster sides, and accordingly, the process of transmitting multiple subtitle information to the target client may be transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone connection caster side.
[0031] Here, the viewer side corresponding to the target microphone-connected caster side may be understood as the client where the viewer is located in the live streaming studio created by the target microphone-connected caster side. In this application scenario, multiple microphone-connected clients are multiple microphone-connected caster sides, and for each microphone-connected caster side, each microphone-connected caster side processes its audio data, obtains corresponding subtitle information, and transmits the subtitle information to the other microphone-connected caster sides. Each caster side transmits the locally determined first subtitle information and the received second subtitle information to its corresponding viewer side.
[0032] Exemplary, Figure 2 is an exemplary diagram of subtitle information processing in this embodiment. As shown in Figure 2, in this application scenario, the two microphone-connected clients are both microphone-connected caster sides, designated as Caster A and Caster B. Caster A processes its audio data, obtains subtitle information, and sends the subtitle information to Caster B in the format {"Identifier of Caster A": "Subtitle Content"}. Similarly, Caster B processes its audio data, obtains subtitle information, and sends the subtitle information to Caster A in the format {"Identifier of Caster B": "Subtitle Content"}. Caster A then transmits {"Identifier of Caster A": "Subtitle Content"} and the {"Identifier of Caster B": "Subtitle Content"} transmitted by Caster B to the viewers in the live streaming studio where Caster A is located. Similarly, Caster B sends {"Identifier of Caster B": "Subtitle Content"} and {"Identifier of Caster A": "Subtitle Content"} sent by Caster A to the viewers in the live streaming studio where Caster B is located.
[0033] Selectively, multiple microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is one microphone connection caster side. The process of receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster side among the multiple microphone connection clients may also be the process of receiving second subtitle information transmitted by at least one guest microphone connection end, and accordingly, the process of transmitting multiple subtitle information to the target client may be the process of transmitting the first subtitle information and the second subtitle information to the viewer side and at least one microphone connection guest side corresponding to the target microphone connection caster side.
[0034] In this application scenario, the microphone-connected caster processes the audio data and obtains the first subtitle information. Each microphone-connected guest processes their own audio data and obtains the second subtitle information, which they then transmit to the microphone-connected caster. The microphone-connected caster then transmits both the first and second subtitle information to the viewers and microphone-connected guests in the same live streaming studio via a server.
[0035] For illustrative purposes, Figure 3 is an exemplary diagram of subtitle information processing in this embodiment. As shown in Figure 3, in this application scenario, multiple microphone-connected clients include one microphone-connected caster side and two microphone-connected guest sides, namely Caster Side A, Guest Side B, and Guest Side C. Caster Side A processes its audio data and obtains subtitle information, Guest Side B processes its audio data and obtains subtitle information, and sends the subtitle information to Caster Side A in the format {"Guest Side B identifier": "Subtitle content"}. Similarly, Guest Side C processes its audio data and obtains subtitle information, and sends the subtitle information to Caster Side A in the format {"Guest Side C identifier": "Subtitle content"}. Caster Side A transmits {"Caster Side A identifier": "Subtitle content"}, {"Guest Side B identifier": "Subtitle content"} transmitted by Guest Side B, and {"Guest Side C identifier": "Subtitle content"} transmitted by Guest Side C to the viewer side and Guest Sides B and C in the live streaming studio.
[0036] Selectively, multiple microphone connection clients include multiple microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The process of receiving second subtitle information transmitted by other microphone connection clients other than the target microphone connection caster side among the multiple microphone connection clients may also be receiving second subtitle information transmitted by other microphone connection caster sides other than the target microphone connection caster side and at least one microphone connection guest side, and accordingly, transmitting multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side and the corresponding microphone connection guest side corresponding to the target microphone connection caster side.
[0037] Specifically, when multiple microphone connection clients include multiple microphone connection caster sides, each microphone connection caster side performs the following process: namely, it determines the first subtitle information based on its own audio data and receives the second subtitle information transmitted by the other end (the other end of the microphone connection clients other than its own). In other words, each microphone connection caster side, acting as a target microphone connection caster side, performs the following process: namely, it determines the first subtitle information based on the audio data of the target microphone connection caster side and receives the second subtitle information transmitted by the other microphone connection clients among the multiple microphone connection clients other than the target microphone connection caster side.
[0038] In this application scenario, multiple microphone-connected casters and at least one microphone-connected guest each process their audio data and obtain subtitle information. Each microphone-connected caster receives its locally determined subtitle information as the first subtitle information, and subtitle information transmitted by other microphone-connected casters and microphone-connected guest devices as the second subtitle information. Finally, the first and second subtitle information are transmitted to the corresponding viewer and microphone-connected guest devices.
[0039] Specifically, when the method described above is performed by the target microphone connected caster, transmitting multiple subtitle information to the target client may mean that the target microphone connected caster transmits multiple subtitle information to the target client via the service terminal, that is, transmits multiple subtitle information to the service terminal, and the service terminal then transmits even more subtitle information to the target client.
[0040] For illustrative purposes, Figure 4 is an exemplary diagram of subtitle information processing in this embodiment, and as shown in Figure 4, in this application scenario, the multiple microphone-connected clients include two microphone-connected caster sides and two microphone-connected guest sides, namely Caster Side A, Caster Side B, Guest Side C, and Guest D, respectively, with Guest Side C located in the live streaming studio of Caster Side A, and Guest D located in the live streaming studio where Caster Side B is located. Caster A processes the audio data, obtains subtitle information, and sends it to Caster B in the format {"Caster A's identifier": "Subtitle content"}. Caster B processes the audio data, obtains subtitle information, and sends the subtitle information to Caster A in the format {"Caster B's identifier": "Subtitle content"}. Guest C processes the audio data, obtains subtitle information, and sends the subtitle information to Caster A and Caster B in the format {"Guest C's identifier": "Subtitle content"}. Guest D processes the audio data, obtains subtitle information, and sends the subtitle information to Caster A and Caster B in the format {"Guest D's identifier": "Subtitle content"}. Caster A transmits {"Identifier of Caster A": "Subtitle Content"}, {"Identifier of Caster B": "Subtitle Content"} transmitted by Caster B, {"Identifier of Guest C": "Subtitle Content"} transmitted by Guest C, and {"Identifier of Guest D": "Subtitle Content"} transmitted by Guest D to the viewer and guest C located in the live streaming studio where Caster A is located, thereby displaying multiple subtitle information to Caster A, the viewer and guest C located in the live streaming studio where Caster A is located. Caster B displays multiple subtitle information to Caster B, the viewers in the live streaming studio where Caster B is located, and Guest D by transmitting {"Identifier of Caster A": "Subtitle Content"}, {"Identifier of Caster B": "Subtitle Content"} transmitted by Caster B, {"Identifier of Guest C": "Subtitle Content"} transmitted by Guest C, and {"Identifier of Guest D": "Subtitle Content"} transmitted by Guest D.
[0041] Selectively, this method may be performed by the service end, and the process of obtaining multiple subtitle information corresponding to multiple microphone-connected clients may involve receiving subtitle information transmitted by each of the multiple microphone-connected clients and obtaining multiple subtitle information. Accordingly, the method for integrating multiple subtitle information may involve the service end integrating the multiple subtitle information. Accordingly, the method for sending multiple subtitle information to a target client and having the target client distinguish and display the multiple subtitle information based on the target identifier may involve the service end sending multiple subtitle information to the target client and having the target client distinguish and display the multiple subtitle information based on the target identifier. Specifically, when the above method is performed by the service end, sending multiple subtitle information to a target client may mean that the service end directly sends multiple subtitle information to the target client.
[0042] In this embodiment, multiple clients participating in the microphone connection process their audio data, obtain subtitle information, add the microphone connection client identifier and / or target identifier to the subtitle information, and then transmit the subtitle information with the microphone connection client identifier and / or target identifier to the service end. After receiving the subtitle information transmitted by the multiple microphone connection clients, the service end transmits the multiple subtitle information to the target client, causing the target client to distinguish and display the subtitle information according to the microphone connection client identifier and / or target identifier. In this embodiment, by integrating the subtitle information at the service end, the number of data stream transmissions can be reduced, saving bandwidth.
[0043] Selectively, this method further includes the step of obtaining a combined audio-video (audio and video) stream corresponding to multiple microphone-connected clients. Here, the combined audio-video stream may be understood as a combined stream of the audio-video streams of the multiple microphone-connected clients.
[0044] Selectively, multiple microphone connection clients include a target microphone connection caster side, and the method is performed by the target microphone connection caster side, and the audio-video composite stream includes a first audio-video stream and a second audio-video stream. The method for obtaining the audio-video composite stream corresponding to multiple microphone connection clients may be to obtain the first audio-video stream from the target microphone connection caster side and receive the second audio-video stream transmitted by the other microphone connection clients among the multiple microphone connection clients other than the target microphone connection caster side.
[0045] Here, the other microphone connection client may be either a microphone connection caster or a microphone connection guest. The first audio / video stream is the audio / video stream from the target microphone connection caster. The second subtitle information is the audio / video stream from the other microphone connection client, which transmits the second audio / video stream to the target microphone connection caster. The target microphone connection caster combines the first audio / video stream and the second audio / video stream to obtain a combined audio / video stream.
[0046] Selectively, multiple microphone connection clients are multiple microphone connection caster sides, the target microphone connection caster side is any of the multiple microphone connection caster sides, and the process of receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster side among the multiple microphone connection clients may be receiving a second audio / video stream transmitted by a microphone connection caster side other than the target microphone connection caster side among the multiple microphone connection caster sides.
[0047] In this application scenario, multiple microphone connection clients are multiple microphone connection caster sides, and each microphone connection caster side transmits its own audio / video stream to the other microphone connection caster sides. Each microphone connection caster side combines its local first audio / video stream with the received second audio / video stream to obtain a combined audio / video stream. Exemplarily, multiple microphone connection clients are two microphone connection caster sides, caster side A and caster side B. Caster side A has audio stream a, which transmits audio / video stream a to caster side B, and caster side B has audio / video stream b, which transmits audio / video stream b to caster side A. Caster side A combines audio stream a and audio / video stream b into a combined stream, and caster side B combines audio stream a and audio / video stream b into a combined stream.
[0048] Selectively, multiple microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, the target microphone connection caster side is one microphone connection caster side, and the process of receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster side among the multiple microphone connection clients may be receiving a second audio / video stream transmitted by at least one microphone connection guest side.
[0049] In this application scenario, the microphone-connected caster side corresponds to the first audio / video stream, and each microphone-connected guest side corresponds to the second audio / video stream, sending the second audio / video stream to the microphone-connected caster side. The microphone-connected caster side combines the first and second audio / video streams into a single combined stream. For example, multiple microphone-connected clients include one microphone-connected caster side and two microphone-connected guest sides, designated as caster side A, guest side B, and guest side C. When caster side A has audio / video stream a and guest side B has audio / video stream b, audio / video stream b is sent to caster side A. When guest side C has audio / video stream c, audio / video stream c is sent to caster side A. Caster side A combines audio / video streams a, b, and c into a single combined stream and sends the combined stream to guest side B and guest side C, allowing caster side A, guest side B, and guest side C to play / display the combined stream.
[0050] Selectively, multiple microphone connection clients include multiple microphone connection caster sides and at least one microphone connection guest side, the target microphone connection caster side is any of the multiple microphone connection caster sides, and the process of receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster side among the multiple microphone connection clients may be receiving a second audio / video stream transmitted by a microphone connection guest side corresponding to the target microphone connection caster side and a second audio / video stream transmitted by a microphone connection caster side other than the target microphone connection caster side.
[0051] In this application scenario, each microphone-connected caster side receives its own audio / video stream as the first audio / video stream, and the audio / video streams transmitted by other microphone-connected caster sides and microphone-connected guest sides (the other end) as the second audio / video stream. Finally, the first and second audio / video streams are combined into a single stream. For example, multiple microphone-connected clients include two microphone-connected caster sides and two microphone-connected guest sides, designated as Caster Side A, Caster Side B, Guest Side C, and Guest Side D. Guest Side C is located in the live streaming studio of Caster Side A, and Guest Side D is located in the live streaming studio where Caster Side B is located. Caster A has an audio / video stream a, which is transmitted to caster B; caster B has an audio stream b, which is transmitted to caster A; guest C has an audio / video stream c, which is transmitted to both caster A and caster B; and guest D has an audio / video stream d, which is transmitted to both caster A and caster B. Caster A can combine audio / video streams a, b, c, and d to create a composite stream, thereby playing / displaying the composite stream on caster A, and can transmit the composite stream to guest C to play / display the composite stream on both caster A and guest C. Caster B combines audio / video streams a, b, c, and d to create a composite stream, and transmits the composite stream to guest D to play / display the composite stream on both caster B and guest D.
[0052] A method for selectively sending multiple subtitle information to a target client may involve adding multiple subtitle information to an audio-video composite stream and then sending the audio-video composite stream with the added subtitle information to the target client.
[0053] Here, the audio-video synthesis stream is an audio-video synthesis stream that corresponds to multiple microphone-connected clients. In this embodiment, when the method is performed by a target microphone-connected client, the process of sending an audio-video synthesis stream with multiple subtitle information added to the target client may involve first sending the audio-video synthesis stream with multiple subtitle information added to the service end, and then the service end forwarding it to the target client.
[0054] Specifically, the method for adding the multiple subtitle information to the audio-video composite stream may involve adding the multiple subtitle information to the audio-video composite stream as Supplementary Enhancement Information (SEI), thereby pushing the stream to the target client and simultaneously transmitting the subtitle information to the target client. In this embodiment, by transmitting the audio-video composite stream and multiple subtitle information to the target client, synchronized display of the audio-video stream and subtitle information at the target client is guaranteed, thereby improving the user's viewing experience.
[0055] A method for selectively sending multiple subtitle information to a target client and causing the target client to distinguish and display the multiple subtitle information based on the client identifier and / or target identifier may involve sending multiple subtitle information to the target client and causing the target client to display the subtitle information in the microphone position area corresponding to the microphone connection client identifier and / or target identifier, around the microphone position area, or in a position related to the microphone connection client identifier and / or target identifier.
[0056] Here, determining the location associated with the microphone connection client identifier and / or target identifier may be done based on the relationship between a pre-configured location and the microphone connection client identifier and / or target identifier.
[0057] In this embodiment, multiple microphone-connected users correspond to different microphone position areas in the live streaming interface, and by determining the microphone-connected user corresponding to the subtitle information using the microphone-connected client identifier and / or target identifier, the subtitle information can be displayed in the corresponding microphone position area, thereby improving the accuracy of subtitle information display. Exemplarily, Figure 5 is an exemplary diagram of how subtitle information is displayed in this embodiment. Assuming that those participating in the microphone connection include Caster A, Guest B, and Guest C, the subtitle text received by the target client is {"Identifier of Caster A": "Subtitle Content", "Identifier of Guest B": "Subtitle Content", "Identifier of Guest C": "Subtitle Content"}. The target client displays the subtitle content of Caster A in the microphone position area where Caster A is located, the subtitle content of Guest B in the microphone position area where Guest B is located, and the subtitle content of Guest C in the microphone position area where Guest C is located.
[0058] A method that selectively sends multiple subtitle information to a target client and causes the target client to distinguish and display the multiple subtitle information based on the client identifier and / or target identifier may also involve sending multiple subtitle information to the target client and causing the target client to stitch together the subtitle information with its corresponding client identifier and / or target identifier based on the target identifier before displaying it.
[0059] Here, assuming that a target identifier is attached to the subtitle information, the target identifier and the subtitle information may be stitched together. In this embodiment, a subtitle display box may be installed on the live streaming interface, and the subtitle information after stitching the target identifier may be displayed in this subtitle display box. For example, Figure 6 is an exemplary diagram of how subtitle information is displayed in this embodiment, and the participants in the microphone connection include caster A, guest B and guest C, and assuming that the subtitle text received by the target client is {"Identifier of caster A": "Subtitle content", "Identifier of guest B": "Subtitle content", "Identifier of guest C": "Subtitle content"}, then after stitching the subtitle information and its corresponding target identifier, caster A: subtitle content, guest B: subtitle content, and guest C: subtitle content are obtained, and the stitched subtitle information is displayed in the subtitle box.
[0060] The technical method of the embodiment of this disclosure acquires multiple subtitle information corresponding to multiple microphone-connected clients, where the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, the subtitle information is determined by the audio data of the microphone-connected client, and the multiple subtitle information is transmitted to the target client so that the target client can distinguish and display the multiple subtitle information based on the microphone-connected client identifier and / or the target identifier. In the information processing method according to the embodiment of this disclosure, each microphone-connected client determines the subtitle information corresponding to its audio data and displays the subtitle information to the target client in a distinguished manner, thereby improving the accuracy of subtitle display in the live streaming microphone connection process.
[0061] Figure 7 is a schematic diagram of the structure of an information processing apparatus according to an embodiment of the present disclosure. As shown in Figure 7, the apparatus is A subtitle information acquisition module 710 for acquiring multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client. The system includes a subtitle information transmission module 720 that transmits multiple subtitle information to a target client, causing the target client to distinguish and display the multiple subtitle information based on a microphone-connected client identifier and / or target identifier.
[0062] Selectively, multiple microphone connection clients include the target microphone connection caster side, and the method is performed by the target microphone connection caster side, where, The subtitle information acquisition module 710 is further used to determine first subtitle information based on audio data from the target microphone-connected caster and to receive second subtitle information transmitted by other microphone-connected clients among the multiple microphone-connected clients, excluding the target microphone-connected caster.
[0063] Selectively, multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The subtitle information acquisition module 710 is further used to receive second subtitle information transmitted by other microphone connection casters among the multiple microphone connection casters, excluding the target microphone connection caster. Selectively, the subtitle information transmission module 720 is also used to transmit the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone connected to the caster side.
[0064] Selectively, multiple microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is one microphone connection caster side. The subtitle information acquisition module 710 is further used to receive second subtitle information transmitted by at least one guest microphone connection terminal. Selectively, the subtitle information transmission module 720 is also used to transmit the first subtitle information and the second subtitle information to the viewer side and at least one microphone-connected guest side corresponding to the target microphone-connected caster side.
[0065] Selectively, multiple microphone connection clients include multiple microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The subtitle information acquisition module 710 is further used to receive second subtitle information transmitted by other microphone-connected caster sides among the multiple microphone-connected caster sides other than the target microphone-connected caster side, and by at least one microphone-connected guest side. Selectively, the subtitle information transmission module 720 is also used to transmit the first subtitle information and the second subtitle information to the viewer side and the corresponding microphone-connected guest side, which are connected to the target microphone-connected caster side.
[0066] Selectively, the subtitle information acquisition module 710 further, This system is used to receive subtitle information transmitted by multiple microphone-connected clients and obtain multiple sets of subtitle information.
[0067] It further includes an audio-video synthesis stream acquisition module for selectively acquiring audio-video synthesis streams for multiple microphone-connected clients.
[0068] Selectively, multiple microphone connection clients include a target microphone connection caster side, the method is performed by the target microphone connection caster side, and the audio-video synthesis stream includes a first audio-video stream and a second audio-video stream. The audio / video synthesis stream acquisition module further includes: The target microphone connects to the caster side and acquires the first audio / video stream. It is used to receive a second audio / video stream transmitted by a microphone-connected client other than the target microphone-connected caster among multiple microphone-connected clients.
[0069] Selectively, multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The audio / video synthesis stream acquisition module further includes: It is used to receive a second audio / video stream transmitted by a microphone connection caster other than the target microphone connection caster among multiple microphone connection casters.
[0070] Selectively, multiple microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is one microphone connection caster side. The audio / video synthesis stream acquisition module further includes: It is used to receive a second audio / video stream transmitted by at least one microphone-connected guest.
[0071] Selectively, multiple microphone connection clients include multiple microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the multiple microphone connection caster sides. The audio / video synthesis stream acquisition module further includes: It is used to receive a second audio / video stream transmitted by the microphone connection guest side corresponding to the target microphone connection caster side, as well as by other microphone connection casters other than the target microphone connection caster side.
[0072] Selectively, the subtitle information transmission module 720 further, This involves adding multiple subtitle information to an audio-video composite stream, wherein the audio-video composite stream is an audio-video composite stream that supports multiple microphone-connected clients. It is used to send an audio-video composite stream with multiple subtitle information added to the target client.
[0073] Selectively, the subtitle information transmission module 720 further, It is used to add multiple subtitle information as supplemental extended information (SEI) to the audio-video composite stream.
[0074] Selectively, the subtitle information transmission module 720 further, This system is used to send multiple subtitle information to a target client and cause the target client to display the subtitle information in the microphone position area corresponding to the microphone connection client identifier and / or target identifier, or to display it in a position related to the microphone connection client identifier and / or target identifier, based on the microphone connection client identifier and / or target identifier.
[0075] Selectively, the subtitle information transmission module 720 further, This system is used to send multiple subtitle information to a target client, which then stitches together the subtitle information with its corresponding microphone connection client identifier and / or target identifier based on the microphone connection client identifier and / or target identifier, and displays it.
[0076] An information processing device according to an embodiment of the present disclosure can perform an information processing method according to any embodiment of the present disclosure and has a functional module and beneficial effects corresponding to the execution method.
[0077] It should be noted that while the units and modules included in the above-mentioned device are divided according to functional logic, they are not limited to the above classifications. They only need to be able to realize the corresponding function. Furthermore, the specific names of each functional unit are merely for the purpose of facilitating their distinction from one another and are not intended to limit the scope of protection of the embodiments of this disclosure.
[0078] Figure 8 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Referring to Figure 8, the following diagram shows a schematic diagram of the structure of an electronic device (e.g., a terminal device or server in Figure 8) 500 suitable for implementing an embodiment of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile devices such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 8 is merely an example, and no arbitrary limitations should be placed on the functions and scope of use of the embodiments of the present disclosure.
[0079] As shown in Figure 8, the electronic device 500 may include a processing unit (e.g., a central processor, graphics processor, etc.) 501, which can perform various appropriate operations and processes based on a program stored in read-only memory (ROM) 502 or a program loaded from storage device 508 into random access memory (RAM) 503. RAM 503 further stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.
[0080] Generally, input devices 506, including, for example, touchscreens, touchboards, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 507, including, for example, liquid crystal displays (LCDs), speakers, and vibrators; storage devices 508, including, for example, magnetic tapes and hard disks; and communication devices 509 can be connected to the I / O interface 505. The communication devices 509 can allow the electronic device 500 and other devices to exchange data via wireless or wired communication. Figure 8 shows an electronic device 500 with various devices, but it should be understood that it is not required to implement or include all the devices shown. Alternatively, more or fewer devices can be implemented or included.
[0081] In particular, according to embodiments of the present disclosure, the process described with reference to the flowchart above can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program placed on a non-temporary computer-readable medium, and this computer program includes program code for performing the method shown in the flowchart. In such embodiments, this computer program may be downloaded and installed from a network via a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When this computer program is executed by the processing device 501, the above-described functions, limited in the manner of embodiments of the present disclosure, are performed.
[0082] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.
[0083] The electronic devices according to the embodiments of this disclosure belong to the same inventive concept as the information processing methods according to the above embodiments, and technical details not described in detail in these embodiments can be referenced to the above embodiments. Furthermore, these embodiments have the same beneficial effects as the above embodiments.
[0084] The embodiments of this disclosure provide a computer storage medium on which a computer program is stored, and when this program is executed by a processor, the information processing method according to the embodiments is realized.
[0085] It should be noted that the computer-readable media described above in this disclosure may be computer-readable signal media, computer-readable storage media, or any combination thereof. Computer-readable storage media may be, but are not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, computer-readable storage media may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device. On the other hand, in this disclosure, a computer-readable signaling medium may include data signals propagated in the baseband or as part of a carrier, on which computer-readable program code is carried. Such propagated data signals may be in various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signaling medium may be any computer-readable medium other than a computer-readable storage medium, and this computer-readable signaling medium may transmit, propagate, or transmit programs for use by or in combination with instruction execution systems, apparatus, or devices. The program code contained on the computer-readable medium may be transmitted by any suitable medium, including but not limited to electric wires, optical cables, RF (radio frequency), or any suitable combination thereof.
[0086] In some embodiments, clients and servers can communicate using any currently known or future-to-be-developed network protocol, such as HTTP (HyperText Transfer Protocol), and can interconnect with digital data communications (e.g., communication networks) in any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-to-be-developed networks.
[0087] The computer-readable medium described above may be included in the electronic device described above, or it may be a standalone entity not assembled in the electronic device.
[0088] The above computer-readable medium contains one or more programs, and when the above one or more programs are executed by this electronic device, this electronic device... The computer-readable medium contains one or more programs, and when the one or more programs are executed by this electronic device, the electronic device is instructed to acquire multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client; and to transmit the multiple subtitle information to a target client, causing the target client to distinguish and display the multiple subtitle information based on the microphone-connected client identifier and / or the target identifier.
[0089] Computer program code for performing the operations of the Disclosure can be written in one or more programming languages or a combination thereof, and such programming languages include, but are not limited to, object-oriented programming languages—e.g., Java, Smalltalk, C++, and moreover, general procedural programming languages—e.g., the "C" language or similar programming languages. The program code may run entirely on a user computer, partially on a user computer, run as a single, independent software package, run partially on a user computer, partially on a remote computer, or run entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).
[0090] The flowcharts and block diagrams in the drawings illustrate the implementable systematic architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a defined logic function. It should also be noted that in some implementations as alternatives, the functions attached to the blocks may occur in a different order than those attached in the drawings. For example, two consecutive blocks may actually be executed essentially in parallel, or in reverse order depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system that performs the defined function or operation, or by a combination of dedicated hardware and computer instructions.
[0091] The units described in relation to the embodiments of this disclosure may be implemented in software or in hardware. Herein, the names of the units are not limited in any case to the unit itself; for example, the first acquisition unit may be described as "a unit for acquiring at least two Internet Protocol addresses."
[0092] In this specification, the functions described above may be performed by at least partially one or more hardware logic components. For example, without limitation, typical types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), dedicated integrated circuits (ASICs), dedicated standard products (ASSPs), systems on a chip (SOCs), and complex programmable logic devices (CPLDs).
[0093] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program for use by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any appropriate combination of the above. More specific examples of machine-readable storage media include one or more line-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any appropriate combination of the above.
[0094] The above description is merely an explanation of better embodiments of the disclosure and the technical principles in which they are applied. Those skilled in the art should understand that the scope of the disclosure is not limited to any specific combination of the above technical features, but should also cover other technical features formed by any combination of the above technical features or their equivalents, without departing from the concept of the disclosure. For example, technical features formed by substituting the above features with similar functional technical features disclosed (but not limited to) in this disclosure.
[0095] Although each operation is described using specific procedures, this should not be understood as requiring that these operations be performed by the specific or sequential procedures shown. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes some specific implementation details, these should not be construed as limiting the scope of this disclosure. Some features described in the context of a single embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may be implemented in multiple embodiments individually or in any suitable subcombination.
[0096] Although this topic has already been described using language specific to structural features and / or methodological logic, it should be understood that the topic limited to the claims in the attached file is not necessarily limited to the specific features or behaviors described above. Conversely, the specific features and behaviors described above are merely illustrative forms of realizing the claims.
Claims
1. The acquisition of multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client. The plurality of subtitle information is transmitted to the target client, causing the target client to distinguish and display the plurality of subtitle information based on the microphone connection client identifier and / or the target identifier. Information processing methods, including those mentioned above.
2. The plurality of microphone connection clients include a target microphone connection caster side, and the method is performed by the target microphone connection caster side. Obtaining multiple subtitle information for multiple microphone-connected clients is possible. The first subtitle information is determined based on the audio data from the target microphone connected to the caster, This includes receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients, The method according to claim 1.
3. The aforementioned multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the above multiple microphone connection caster sides. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by a microphone connection caster other than the target microphone connection caster among the plurality of microphone connection casters, Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side. The method according to claim 2.
4. The plurality of microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is the one microphone connection caster side. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by at least one guest microphone connection terminal. Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side and to the at least one microphone-connected guest side. The method according to claim 2.
5. The plurality of microphone connection clients include a plurality of microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the plurality of microphone connection caster sides. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by a microphone connection caster other than the target microphone connection caster among the plurality of microphone connection caster sides and the at least one microphone connection guest side. Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side and to the microphone-connected guest side corresponding to the target microphone-connected caster side. The method according to claim 2.
6. The aforementioned method is performed by the service terminal, and the acquisition of multiple subtitle information corresponding to multiple microphone-connected clients is: To receive subtitle information transmitted by multiple microphone-connected clients and obtain multiple subtitle information, The method according to claim 1, including the method described in claim 1.
7. The method according to claim 1, further comprising obtaining an audio-video composite stream corresponding to multiple microphone-connected clients.
8. The plurality of microphone connection clients include a target microphone connection caster side, the method is performed by the target microphone connection caster side, and the audio-video synthesis stream includes a first audio-video stream and a second audio-video stream. Obtaining an audio-video composite stream that supports multiple microphone-connected clients is, To acquire the first audio / video stream from the target microphone connected caster, Receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients, The method according to claim 7, including the method described in claim 7.
9. The aforementioned multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the above multiple microphone connection caster sides. Receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: Receiving a second audio / video stream transmitted by one of the multiple microphone connection caster sides other than the target microphone connection caster side, The method according to claim 8, including the method described in claim 8.
10. The plurality of microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is the one microphone connection caster side. Receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: To receive a second audio / video stream transmitted by at least one microphone-connected guest, The method according to claim 8, including the method described in claim 8.
11. The plurality of microphone connection clients include a plurality of microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the plurality of microphone connection caster sides. Receiving a second audio / video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: Receiving a second audio / video stream transmitted by the microphone connection guest side corresponding to the target microphone connection caster side and by other microphone connection caster sides other than the target microphone connection caster side. The method according to claim 8, including the method described in claim 8.
12. Sending the aforementioned multiple subtitle information to the target client means Adding the aforementioned multiple subtitle information to the audio-video synthesis stream, wherein the audio-video synthesis stream is an audio-video synthesis stream corresponding to the aforementioned multiple microphone-connected clients, Sending the aforementioned audio-video composite stream, to which multiple subtitle information has been added, to the target client, The method according to claim 7, including the method described in claim 7.
13. Adding the aforementioned multiple subtitle information to the audio-video composite stream is, The aforementioned multiple subtitle information is added to the audio-video composite stream as supplemental extended information (SEI). The method according to claim 12, including the method described in claim 12.
14. Sending the aforementioned multiple subtitle information to a target client and causing the target client to distinguish and display the aforementioned multiple subtitle information based on the microphone connection client identifier and / or the target identifier is, The plurality of subtitle information is transmitted to the target client, causing the target client to display the subtitle information in the microphone position area corresponding to the microphone connection client identifier and / or the target identifier, or to display it in a position related to the microphone connection client identifier and / or the target identifier, based on the microphone connection client identifier and / or the target identifier. The method according to claim 1, including the method described in claim 1.
15. Sending the aforementioned multiple subtitle information to a target client and causing the target client to distinguish and display the aforementioned multiple subtitle information based on the microphone connection client identifier and / or the target identifier is, The plurality of subtitle information is transmitted to the target client, and the target client is instructed to stitch together the subtitle information with the corresponding microphone-connected client identifier and / or target identifier based on the client identifier and / or target identifier, and then display it. The method according to claim 1, including the method described in claim 1.
16. A subtitle information acquisition module for acquiring multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and / or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client; A subtitle information transmission module that transmits the multiple subtitle information to a target client and causes the target client to distinguish and display the multiple subtitle information based on the target identifier, Information processing device, including
17. One or more processors, A storage device for storing one or more programs, An electronic device in which one or more of the aforementioned programs are executed by one or more processors, causing one or more processors to implement the information processing method described in any one of claims 1 to 15.
18. A storage medium containing computer executable instructions, which is used to perform the information processing method described in any one of claims 1 to 15 when the computer executable instructions are executed by a computer processor.