Screen projection method, apparatus, device, storage medium, and computer program

Abstract

Embodiments of the present disclosure provide a screen projection method, apparatus, device, and storage medium. The screen projection method includes displaying target content based on an operation triggered by a first user in a live streaming interface, obtaining a video stream corresponding to the target content, projecting the video stream onto a screen at the first user's microphone seat, and pushing the video stream to a client where a second user is located.

Description

Technical Field

[0001] [Cross - Reference to Related Applications] This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on March 3, 2023, with an application number of 202310217923.1 and an invention title of "Screen Projection Method, Device, Equipment and Storage Medium", and all of its content is incorporated herein by reference.

[0002] [Technical Field] Embodiments of the present disclosure relate to the technical field of video live streaming, and in particular, to a screen projection method, device, equipment and storage medium.

Background Art

[0003] In related technologies, in a video chat room, on the microphone seat, only the screen collected by the camera of the client involved in the connection of the microphone can be displayed, and no other screen can be displayed. When a user connected to the microphone opens other content in a live streaming room, for example, in the case of operations such as opening a text document or an applet, other users in the live streaming room cannot view the content opened by this user connected to the microphone, cannot perceive the content of the live streaming room, and this affects the effect of live streaming.

Summary of the Invention

Means for Solving the Problems

[0005] In the first embodiment, an embodiment of the present disclosure is a method for screen projection, the method is A step of displaying target content based on an action triggered by a first user in the live streaming interface, The steps include: obtaining a video stream corresponding to the aforementioned target content; The present invention provides a method for screen projection, which includes the steps of: projecting the video stream onto a screen at the microphone seat of a first user; and pushing the video stream to the client where a second user is located.

[0006] In a second embodiment, an embodiment of the present disclosure further relates to a method for screen projection, the method being A step of receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content. The present invention provides a method for screen projection, which includes the step of rendering and displaying a video stream corresponding to the target content at the microphone seat of a first user.

[0007] In a third embodiment, an embodiment of the present disclosure further relates to an apparatus for screen projection, the apparatus is A target content display module for displaying target content based on an action triggered by a first user in the live streaming interface, A video stream acquisition module for obtaining a video stream corresponding to the aforementioned target content, The present invention provides a screen projection apparatus that includes a screen projection module for projecting the video stream onto a screen at the microphone seat of a first user and for pushing the video stream to a client where a second user is located.

[0008] In a fourth embodiment, an embodiment of the present disclosure further relates to an apparatus for screen projection, the apparatus is A video stream receiving module for receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content, The present invention provides a screen projection apparatus that includes a display module for rendering and displaying a video stream corresponding to the target content at the microphone seat of a first user.

[0009] In a fifth embodiment, the embodiments of the present disclosure further include: One or more processors, A storage device for storing one or more programs, Further, the present invention provides an electronic device that causes one or more processors to implement the screen projection method described in the embodiments of the present disclosure when one or more of the aforementioned programs are executed by one or more of the aforementioned processors.

[0010] In a sixth embodiment, an embodiment of the present disclosure further provides a storage medium containing computer-executable instructions for performing the screen projection method described in an embodiment of the present disclosure when executed by a computer processor. [Brief explanation of the drawing]

[0011] The above-mentioned and other features, advantages, and aspects of each embodiment of this disclosure will become clearer when viewed in conjunction with the drawings below. Throughout the drawings, identical or similar reference numerals represent identical or similar elements. It should be understood that the drawings are schematic and the actual objects and elements are not necessarily drawn to scale.

[0012] [Figure 1] This is a schematic diagram of the flow of the screen projection method provided by the embodiments of this disclosure. [Figure 2] This is a schematic diagram of a first user client interface provided by an embodiment of the present disclosure. [Figure 3] This figure shows an example of display target content provided by the embodiments of this disclosure. [Figure 4] This is a schematic diagram of the screen projection method provided by the embodiments of this disclosure. [Figure 5] This figure shows an example of projecting the target content provided by the embodiments of this disclosure onto a screen at the microphone seat of the first user. [Figure 6] This is a schematic diagram of the flow of the screen projection method provided by the embodiments of this disclosure. [Figure 7] This is a schematic diagram of the configuration of a screen projection device provided by an embodiment of the present disclosure. [Figure 8] This is a schematic diagram of the configuration of a screen projection device provided by an embodiment of the present disclosure. [Figure 9] This is a schematic diagram of the configuration of an electronic device provided by an embodiment of the present disclosure. [Modes for carrying out the invention]

[0013] Embodiments of the present invention will be described in more detail below with reference to the drawings. The drawings show several embodiments of the present disclosure, however, the present disclosure can be implemented in various forms, and the following embodiments are provided to give a clearer and more complete understanding of the present disclosure and should not be construed as limiting the present invention. It should be understood that the drawings and embodiments of the present disclosure are illustrative only and are not intended to limit the scope of protection of the present disclosure.

[0014] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the performance of the steps shown. The scope of this disclosure is not limited to these.

[0015] As used herein, the term "comprising" and its variations are open-ended, that is, they mean "including but not limited to...". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment", the term "another embodiment" means "at least one another embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms are given in the following description.

[0016] The concepts such as "first", "second", etc. mentioned in this disclosure are only for distinguishing different devices, modules or units, and are not for limiting the order or interdependence relationship of the functions executed by these devices, modules or units.

[0017] The terms "one" and "plurality" mentioned in this disclosure are illustrative rather than restrictive, and should be understood as "one or more" unless clearly indicated otherwise in the context.

[0018] The names of the messages or information that interact between multiple devices in the embodiments of this disclosure are only for the purpose of explanation and are not for limiting the scope of these messages or information.

[0019] Before using the technical solutions disclosed in each embodiment of this disclosure, it should be understood that the type, scope of use, usage scenarios, etc. of the personal information related to this disclosure should be informed to the user in an appropriate manner in accordance with the relevant laws and regulations, and the permission of the user should be obtained.

[0020] For example, in response to an active request from the user, the system sends the user information to explicitly prompt the user that it is requesting an operation that requires the acquisition and use of the user's personal information. This allows the user to autonomously choose whether or not to provide personal information to software or hardware such as electronic devices, applications, servers, or storage media that perform the operation of the proposed technical method of this disclosure, depending on the information provided.

[0021] As an optional but not limited implementation, the form in which information is sent to the user in response to an active request from the user may be, for example, in the form of a pop-up window in which the information can be displayed in text form. The pop-up window may also be equipped with a selection control for the user to choose whether to "agree" or "disagree" to providing personal information to the electronic device.

[0022] The notification and user permission process described above are merely schematic and do not limit the forms in which this disclosure may be implemented. It should be understood that other forms that comply with applicable laws and regulations may also be applicable to the implementation of this disclosure.

[0023] It is understood that the data relating to this proposed technology (including, but not limited to, the data itself, its acquisition, or its use) should comply with the requirements of applicable laws, regulations, and related provisions.

[0024] Currently, within a video live streaming chat room, it is possible to communicate with multiple guests via live streaming, and users within the live streaming chat room can see the content displayed on the streamer's microphone and the guests' microphones. In related technologies, only images collected by the client where the streamer is located can be displayed on the streamer's microphone. If a user performs other operations such as opening an applet, mini-game, or text document in the live streaming interface, viewers cannot see what the streamer has opened and are unaware of the content in the live streaming chat room. Furthermore, the content opened by the streamer obstructs the microphone and comment area, affecting the interaction between the streamer and viewers and impacting the operation of the streamer's live streaming room.

[0025] Figure 1 is a schematic diagram of the flow of a screen projection method provided by an embodiment of the present disclosure, which applies when a user triggers content in a live streaming room to be screen projected, and this method may be performed by a screen projection device installed in the client where the first user is located, which may be implemented in software and / or hardware form, and optionally by an electronic device which may be a mobile terminal, a PC, or a server. As shown in Figure 1, the method includes the following:

[0026] S110: The target content is displayed based on an action triggered by the first user in the live streaming interface.

[0027] In this scenario, the first user may be a user connected to a microphone, for example, a live streamer or a guest communicating with the live streamer via microphone. The target content may be any content that can be displayed and shared, such as an applet, mini-game, web page, or document. The target content may be mounted in the form of a container within the live streaming application (Application, APP) and displayed in the function panel of the live streaming interface.

[0028] The application scene in this embodiment may be a video live streaming scene or an audio live streaming scene, during which a first user can connect with other users via video microphone and / or audio microphone. Examples include a video chat room, an audio chat room, or a karaoke scene.

[0029] In this embodiment, during the process in which a first user connects with multiple other users via microphone in a live streaming room and interacts with them, the microphone area in the first user interface includes the microphone seats of users connected to microphones. In a video chat scene, the terminal where the first user is located collects the first user's image in real time and displays the collected image at the first user's microphone seat. If another user connected to a microphone turns on their camera, the image collected in real time by the camera is displayed at that microphone seat. If the first user has not triggered target content, the image collected in real time by their camera is displayed at the first user's microphone seat, enabling the first user and other users connected to microphones to interact via video. In an audio chat scene, the terminals where the first user and other users connected to microphones are located each collect their respective audio information, and the first user's microphone seat and the other microphone seats display corresponding related information (e.g., avatars). As an example, Figure 2 is a schematic diagram of the first user interface in this embodiment. As shown in Figure 2, the live streaming interface displays the microphone seats of each user involved in microphone connection. For example, if the first user is the streamer, the streamer's microphone seat and each guest's microphone seat display the screen captured by their respective cameras. When the streamer wants to share triggered target content with other users (guests and viewers) in the live streaming room, they search for or find the target content in the function panel of the streamer interface and trigger the found target content.

[0030] In this context, a microphone seat can be understood as a medium through which users in the live streaming room participate in interactive live streaming. Users at a microphone seat (those connected to a microphone) can participate in interactive live streaming, while users not at a microphone seat (viewers) can only watch the interactive live streaming. Microphone seats include attributes such as Status and User, with the microphone seat status including Available, Occupied, and Closed. If a microphone seat is Occupied, the User attribute is the user information of the person currently connected to the microphone seat. In this embodiment, the live streaming interface displays the microphone seats of each user involved in microphone connection. As shown in Figure 2 of the above embodiment, the live streaming interface displays the streamer's microphone seat and each guest's microphone seat.

[0031] Specifically, the procedure for displaying target content based on an operation triggered by a first user in the live streaming interface may include: requesting label information for the target content from the server based on a first operation triggered by the first user in the live streaming interface; receiving the label information sent from the server and displaying the label information on the panel corresponding to the target content; and displaying the target content based on a second operation triggered by the first user in response to the label information.

[0032] In this context, label information can be understood as metadata. In this embodiment, the function panel of the first user interface displays a list of identifiers for multiple contents (e.g., name and / or cover) or a search box for the target content. The first operation triggered by the first user in the live streaming interface may be the first user clicking on the identifier of the target content or entering search information for the target content in the search box and clicking search. When the system detects that the first user has triggered the first operation, it generates a first request and sends it to the server where the target content resides. The server, in response to the first request, returns the label information for the target content to the client where the first user resides and displays the label information on the function panel. The label information may include a function description of the target content, a launch button for the target content, and an example diagram of the target content. For example, if the target content is a mini-game, the label content may include a function description of the mini-game, an example diagram of the mini-game in operation, and a launch button for the mini-game.

[0033] The first user triggers the target content by triggering a second action based on the displayed label information. For example, this could be accessing an applet or mini-game, or opening a web page or text document. Exemplarily, Figure 3 shows an example of triggering target content in this embodiment. As shown in Figure 3, the function panel displays identifiers such as content a, content b, and content c. For example, if the first user is a live streamer, and the live streamer wants to trigger content b, content b becomes the target content. The user clicks the identifier for content b, the label information for content b is displayed on the function panel, and when the live streamer clicks the "Activate" button in the label information, the operation to trigger the target content is completed. As shown in Figure 3, in the process of the live streamer triggering the target content, the function panel obstructs some of the guests' microphone seats and some of the live streamer's microphone seat area. Therefore, in order to prevent the microphone seat area from being continuously obstructed when the live streamer operates on the target content, it is necessary to adopt the solution of this embodiment and display the target content at the live streamer's microphone seat.

[0034] In this embodiment, the first user can trigger the target content in the live streaming interface, improving the convenience of displaying the target content.

[0035] S120: Retrieves the video stream corresponding to the target content.

[0036] In this context, the video stream corresponding to the target content may be a video stream formed during the process in which the target content is interacted with by a first user. For example, if the target content is a mini-game, the video stream is a video generated during the process in which the first user interacts with this mini-game; if the target content is a text document, the video stream is a video generated during the process in which the first user interacts with this text document.

[0037] In this embodiment, the procedure for obtaining a video stream corresponding to the target content may be to pull the video stream into the container where the target content resides. The form of obtaining a video stream corresponding to the target content may be to directly pull the video stream corresponding to the target content if the target content is a video category, or to take a screenshot (i.e., screen record) of the screen where the target content is located at a set frame rate and obtain a video stream corresponding to the target content if the target content is a text class.

[0038] In this embodiment, when an operation by the first user to trigger the target content is detected, the pulling of the video stream corresponding to the target content is initiated. If the current situation is a video chat scene, the camera capture operation of the client where the first user is located is simultaneously paused, i.e., the camera of the client where the first user is located is temporarily turned off.

[0039] Specifically, the procedure for obtaining a video stream corresponding to the target content may include displaying a screen projection entry corresponding to the target content, sending a screen projection request to the server through the screen projection entry, receiving screen projection feedback information returned from the server based on the screen projection request, and obtaining a video stream corresponding to the target content according to the screen projection feedback information.

[0040] In this embodiment, a screen projection entry may be represented by a single screen projection button, and the display of the screen projection entry can be understood as adjusting the state of the screen projection button to make it clickable. Screen projection feedback information may be information that permits screen projection. In this embodiment, after the screen projection entry for the target content is displayed, the client where the first user is located generates a screen projection request based on the first user's click operation on the screen projection entry and sends the screen projection request to the server where the live streaming is located. Based on the screen projection request, the server returns screen projection feedback information to the client where the first user is located. When the client where the first user is located receives the screen projection feedback information returned from the server, it notifies the container where the target content is located to output a video stream. When the container where the target content is located receives the notification, it outputs a video stream at the set frame rate.

[0041] Within this context, the screen projection request includes a first user identifier, and optionally, the procedure for receiving screen projection feedback information returned from the server may be information that permits screen projection. Specifically, for example, if the first user identifier belongs to a pre-configured first user identifier, the server returns information that permits screen projection and performs screen projection.

[0042] Optionally, this includes sending a screen projection request to the server through a screen projection entry, then receiving layout information returned from the server based on the screen projection request, and updating the interface layout of the client where the first user is currently located based on the layout information.

[0043] Within this context, the layout information can be understood as a layout that supports screen projection, and the layout information includes the layout configuration of the first user's microphone seat and / or the guest's microphone seat. In this embodiment, a layout configuration that supports screen projection is pre-configured, and after the server receives a screen projection request sent from the client where the first user is located, it returns the screen projection-supporting layout information to the client where the first user is located. This ensures smooth screen projection of the target content by updating the interface layout based on the layout information received by the client where the first user is located.

[0044] S130: Project the video stream onto the screen at the microphone seat of the first user and push the video stream to the client where the second user is located.

[0045] Within this context, the second user can be understood as any other user present in the current live streaming room besides the first user, and may be a streamer, guest, or viewer.

[0046] In this embodiment, after acquiring the video stream of the target content, this video stream is projected onto a screen at the microphone seat of the first user, that is, the video source at the first user's microphone seat is replaced from the image collected by the camera to the video stream of the target content.

[0047] Optionally, the process may include the step of sending a screen projection request to the server through a screen projection entry, and then receiving audio and video parameters returned from the server based on the screen projection request, and accordingly pushing the video stream to the client where the second user is located, or it may be a form of pushing the video stream to the client where the second user is located based on the audio and video parameters.

[0048] Within this, the audio and video parameters include information such as resolution and code rate. Based on these audio and video parameters, the video stream is pushed to the client where the second user is located, and the second user's client displays this video stream at the first user's microphone.

[0049] In one application scenario, achieving screen projection for video chat requires the cooperation of a live streaming client, a container client, a live streaming server, and a container server. The live streaming client is used by the first user to perform live streaming and connect with guests via microphone for interaction; the live streaming server is used for distributing and managing live streaming-related services and screen projection parameters; the container client launches open containers (mini-games, applets) and packages the output capabilities of the screen projection screen; and the container server manages the metadata (meta) of the open containers. Figure 4 shows the principle diagram of the screen projection method in this embodiment, and as shown in Figure 4, the screen projection procedure includes the following steps.

[0050] 1. When the first user detects that the target content has been triggered, the container client pulls the label information to the container server. 2. Mount the container client to the live streaming client. 3. Based on the first user's trigger operation, the live streaming client sends a screen projection request to the live streaming server. 4. The live streaming server returns layout information and audio / video parameters to the live streaming client, allowing screen projection. 5. The live streaming client notifies the container client to output the video stream. 6. The container client inputs the video stream to the live streaming client at the configured frame rate. 7. Start screen projection and stream pushing.

[0051] As an example, Figure 5 shows an example in this embodiment where the target content is projected onto the microphone of the first user. As shown in Figure 5, assuming the first user is a live streamer, the target content is projected onto the live streamer's microphone, which not only prevents the target content screen from obstructing other areas of the live streaming interface but also provides advantages for user interaction in the live streaming room. Furthermore, the video stream of the target content is pushed to the client where the second user is located, allowing viewers to intuitively perceive the live streaming content and improving the interactivity of the live stream.

[0052] The technical proposal of this embodiment involves displaying target content, acquiring a video stream corresponding to the target content, projecting the video stream onto a screen at the first user's microphone position, and pushing the video stream to the client where the second user is located, based on an operation triggered by the first user in a live streaming interface. The screen projection method provided in the embodiment of this disclosure projects the video stream of the target content triggered by the first user onto a screen at the first user's microphone position, improving the diversity of user interactions during live streaming and enhancing the user experience.

[0053] Figure 6 is a schematic diagram of the flow of a screen projection method provided by an embodiment of the present disclosure, which may be performed by a screen projection device provided on the viewer side, which may be implemented in the form of software and / or hardware, and optionally by electronic equipment such as a mobile terminal, PC, or server. As shown in Figure 6, the method includes the following steps.

[0054] S610: Receives video streams pushed from the client where the first user is located.

[0055] In this context, the video stream includes a video stream corresponding to the target content. The video stream corresponding to the target content is acquired by the first user in the process of triggering the target content on the client where the first user is located. The specific acquisition method is described in the above embodiment and will not be repeated here. In this embodiment, the first user first sends the video stream to the stream push server, and the stream push server then forwards it to the client where the second user is located.

[0056] S620: Renders and displays a video stream corresponding to the target content at the first user's microphone seat.

[0057] In this embodiment, the client where the second user is located receives the video stream and simultaneously receives layout information transmitted from the client where the first user is located. The client where the second user is located first updates the layout of its live streaming interface based on the layout information, and then renders and displays the video stream corresponding to the target content at the first user's microphone position, so that viewers can see the target content triggered by the first user.

[0058] The technical proposal of this embodiment involves receiving a video stream pushed from a client where a first user is located, the video stream including a video stream corresponding to target content, and rendering and displaying the video stream corresponding to the target content at the first user's microphone position. This allows viewers to intuitively perceive the live streaming content and improves the interactivity of the live stream.

[0059] Figure 7 is a schematic diagram of the structure of a screen projection device provided by an embodiment of the present disclosure, and as shown in Figure 7, the device is A target content display module 710 is used to display target content based on an action triggered by a first user in the live streaming interface, A video stream acquisition module 720 for obtaining a video stream corresponding to the target content, The system includes a screen projection module 730 for projecting and displaying a video stream on a screen at the microphone seat of a first user and for pushing the video stream to a client where a second user is located.

[0060] As an option, the target content display module 710 further... Based on a first operation triggered by a first user in the live streaming interface, the server is requested to provide label information for the target content, The system receives the label information transmitted from the server and displays the label information on the panel corresponding to the target content. It is used to display target content based on a second action triggered by a first user on label information.

[0061] As an option, the video stream acquisition module 720 is also available. Displaying screen projection entries corresponding to the target content, Sending a screen projection request to the server through the screen projection entry, Receiving screen projection feedback information returned from the server based on the screen projection request, This is used to obtain a video stream corresponding to the target content to be pulled, in accordance with the aforementioned screen projection feedback information.

[0062] As an option, further, Includes a layout information receiving module for receiving layout information returned from the server based on the screen projection request.

[0063] Accordingly, Includes a layout update module for updating the interface layout of the client where the first user is currently located, based on layout information including the layout configuration of the first user's microphone seat and / or the guest's microphone seat.

[0064] As an option, further, The system includes an audio-video parameter receiving module for receiving audio-video parameters returned from the server based on the screen projection request.

[0065] As an option, further, Includes a stream push module for pushing a video stream to a client located at a second user's site, based on audio and video parameters.

[0066] Figure 8 is a schematic diagram of the structure of a screen projection device provided by an embodiment of the present disclosure, and as shown in Figure 8, the device is A video stream receiving module 810 for receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content, The system includes a display module 820 for rendering and displaying a video stream corresponding to the target content at the microphone seat of the first user.

[0067] The screen projection apparatus provided by embodiments of this disclosure can perform the screen projection method provided by any embodiment of this disclosure and includes functional modules and beneficial effects depending on the performance of the method.

[0068] Furthermore, while the units and modules included in the above-described apparatus are divided according to functional logic, the division is not limited to the above-described division; it is sufficient that they can realize the corresponding functions. Also, the specific names of each functional unit are merely for the purpose of easily distinguishing them from one another and are not intended to limit the scope of protection of the embodiments of this disclosure.

[0069] Figure 9 is a schematic diagram of the configuration of an electronic device according to an embodiment of the present disclosure. Specifically, Figure 9 shows a schematic configuration that can be applied to realize the configuration of the electronic device 500 (for example, a terminal device or server in Figure 9) according to an embodiment of the present disclosure. The terminal devices according to the embodiment of the present disclosure include, but are not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (for example, car navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 9 is just one example and does not limit the functionality and application scope of the embodiment of the present disclosure.

[0070] As shown in Figure 9, the electronic device 500 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 501 capable of performing various appropriate operations and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. The RAM 503 also stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0071] Generally, devices such as input devices 506 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 507 including, for example, liquid crystal displays (LCDs), speakers, and vibrators; storage devices 508 including, for example, magnetic tape and hard disks; and communication devices 509 are connected to the I / O interface 505. The communication device 509 allows the electronic device 500 to communicate wirelessly or via wired connection with other devices to exchange data. Figure 9 shows an electronic device 500 including various devices, but it should be understood that it is not necessary to implement or have all of the illustrated devices. Alternatively, more or fewer devices may be implemented or have been included.

[0072] In particular, the processes described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program mounted on a non-temporary computer-readable medium, which includes program code for performing the method shown in the flowchart. In this embodiment, the computer program may be downloaded and installed from a network via a communication device 509, or it may be installed from a storage device 508 or ROM 502. When executed by the processing unit 501, the computer program performs the above functions which are limited to the topic push processing method according to embodiments of the present disclosure.

[0073] The names of messages or information that interact between multiple devices in embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0074] The electronic devices provided in the embodiments of this disclosure belong to the same inventive concept as the screen projection method provided in the embodiments described above, and for technical details not described in detail in these embodiments, refer to the embodiments described above, and these embodiments have the same beneficial effects as the embodiments described above.

[0075] Embodiments of this disclosure provide a computer storage medium containing a computer program that, when executed by a processor, implements the screen projection method provided by the embodiments described above.

[0076] The computer-readable media described above in this disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of both. A computer-readable storage medium may, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus, or device. On the other hand, in this disclosure, a computer-readable signal medium may include data signals propagated in the baseband or as part of a carrier wave, which contain computer-readable program code. Such propagated data signals may take various forms and include, but are not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. Furthermore, a computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium on which a program for use by or in combination with an instruction execution system, apparatus, or device can be transmitted, propagated, or transmitted.Program code contained in a computer-readable medium may be transmitted on any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0077] In some embodiments, clients and servers may communicate using any network protocol currently known or to be developed in the future, such as HTTP (Hypertext Transfer Protocol), and may connect with each other to digital data communications (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), extranets (e.g., the Internet), end-to-end networks (e.g., ad-hoc end-to-end networks), and networks currently known or to be developed in the future.

[0078] The computer-readable medium described above may be one included in the electronic device described above, or it may be a separate entity not incorporated into the electronic device.

[0079] The computer-readable medium described above stores one or more programs that, when executed by an electronic device, cause the electronic device to display target content, acquire a video stream corresponding to the target content, project the video stream onto a screen at the first user's microphone position, and push the video stream to the client where the second user is located, based on an operation triggered by a first user on a live streaming interface.

[0080] Alternatively, the computer-readable medium contains one or more programs that, when executed by an electronic device, cause the electronic device to receive a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content, and renders and displays the video stream corresponding to the target content at the first user's microphone seat.

[0081] Computer program code for performing the operations of the Disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code may run entirely on a user computer, partially on a user computer, run as a standalone software package, partially on a user computer and partially on a remote computer, or run entirely on a remote computer or server. Where a remote computer is involved, it may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (for example, connected via the Internet using an Internet service provider).

[0082] The flowcharts and block diagrams in the drawings illustrate the architectures, functions, and operations that can be implemented according to the systems, methods, and computer program products relating to each type of embodiment of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or part of code containing one or more executable instructions for implementing a given logic function. Note that in some implementations as replacements, the functions represented within a block may occur in a different order than shown in the drawings. For example, two blocks shown consecutively may actually be executed substantially in parallel, or in reverse order depending on the functions involved. Note that each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, may be implemented in a dedicated hardware-based system that performs a given function or operation, or in a combination of dedicated hardware and computer instructions.

[0083] The units relating to the embodiments of this disclosure described herein may be implemented in software or in hardware. Herein, the names of the units are not necessarily limiting to the units themselves; for example, the first acquisition unit may be described as a "unit for acquiring at least two Internet Protocol addresses."

[0084] The functions described above in this specification may be performed by at least partially one or more hardware logic components. For example, exemplary types of hardware logic components that may be used include, but are not limited to, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standards (ASSPs), systems on chips (SOCs), and composite programmable logic devices (CPLDs).

[0085] In the context of this disclosure, machine-readable media may be tangible media that contain or can store programs used by or in combination with instruction execution systems, devices, or equipment. Machine-readable media may be machine-readable signal media or machine-readable storage media. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the above. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, convenient compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0086] According to one or more embodiments of the present disclosure, a method for screen projection, the method is A step of displaying target content based on an action triggered by a first user in the live streaming interface, The steps include: obtaining a video stream corresponding to the aforementioned target content; The present invention provides a method for screen projection, which includes the steps of: projecting the video stream onto a screen at the microphone seat of a first user; and pushing the video stream to the client where a second user is located.

[0087] Furthermore, the step of displaying target content based on an action triggered by the first user in the live streaming interface is: A step of requesting label information for target content from a server based on a first operation triggered by a first user in the live streaming interface, The steps include receiving the label information transmitted from the server and displaying the label information on a panel corresponding to the target content, The process includes the step of displaying target content based on a second operation triggered by a first user on the label information.

[0088] Furthermore, the step of obtaining a video stream corresponding to the target content is: The steps include: displaying a screen projection entry corresponding to the target content; The steps include sending a screen projection request to the server through the aforementioned screen projection entry, The steps include receiving screen projection feedback information returned from the server based on the screen projection request, The step of obtaining a video stream corresponding to the target content to be pulled in accordance with the screen projection feedback information.

[0089] Furthermore, after sending a screen projection request to the server through the screen projection entry, The steps include receiving layout information returned from the server based on the screen projection request, The further step includes updating the interface layout of the client where the first user is currently located, based on the layout information, which includes the layout configuration of the microphone seats of the first user and / or the guest's microphone seats.

[0090] Furthermore, after sending a screen projection request to the server through the screen projection entry, The step of receiving audio and video parameters returned from the server based on the screen projection request, further includes: Accordingly, the step of pushing the video stream to the client where the second user is located is: The process includes the step of pushing the video stream to a client where a second user is located, based on the aforementioned audio and video parameters.

[0091] Embodiments of this disclosure further relate to a method for screen projection, the method being: A step of receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content. The present invention provides a method for screen projection, which includes the step of rendering and displaying a video stream corresponding to the target content at the microphone seat of a first user.

[0092] The above description is merely a description of preferred embodiments of the present disclosure and applicable technical principles. Those skilled in the art will understand that the scope of the disclosure is not limited to technical proposals based on specific combinations of the above-described technical features, but should also cover other technical proposals formed by any combination of the above-described technical features or their equivalents, without departing from the disclosed concepts. For example, technical proposals in which the above features are replaced with similarly functional technical features disclosed (but not limited to) in this disclosure.

[0093] Furthermore, although the operations have been described in a specific order, this should not be interpreted as requiring these operations to be performed in a specific or sequential order as indicated. Multitasking and parallel processing may be advantageous in certain environments. Similarly, while details of several specific embodiments are included in the above description, these should not be interpreted as limiting the scope of this disclosure. Certain features described in the context of separate embodiments may also be realized in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be realized in multiple embodiments, individually or in any suitable subcombination.

[0094] While this subject matter is described using language specific to structural features and / or method logic operations, it should be understood that the subject matter limited in the attached claims is not necessarily limited to the specific features or operations described above. Conversely, the specific features and operations described above are merely exemplary forms of realizing the claims.

Claims

1. A method for screen projection, the method is A step of displaying target content based on an action triggered by a first user in the live streaming interface, The steps include: obtaining a video stream corresponding to the aforementioned target content; The process includes the steps of projecting the video stream onto a screen at the microphone seat of the first user and pushing the video stream to the client where the second user is located. method.

2. The step of displaying target content based on an action triggered by the first user in the live streaming interface is: A step of requesting label information for target content from a server based on a first operation triggered by a first user in the live streaming interface, The steps include receiving the label information transmitted from the server and displaying the label information on a panel corresponding to the target content, The process includes the step of displaying target content based on a second operation triggered by a first user on the label information, The method according to claim 1.

3. The step of obtaining a video stream corresponding to the aforementioned target content is: The steps include: displaying a screen projection entry corresponding to the target content; The steps include sending a screen projection request to the server through the aforementioned screen projection entry, The steps include receiving screen projection feedback information returned from the server based on the screen projection request, The steps include: obtaining a video stream corresponding to the target content based on the screen projection feedback information; The method according to claim 1.

4. The steps include receiving layout information returned from the server based on the screen projection request, The process further includes the step of updating the interface layout of the client where the first user is located, based on the aforementioned layout information. The aforementioned layout information includes the layout configuration of the microphone seats for the first user and / or the guest's microphone seats. The method according to claim 3.

5. The step further includes receiving audio and video parameters returned from the server based on the screen projection request, Accordingly, the step of pushing the video stream to the client where the second user is located is: The process includes the step of pushing the video stream to a client where a second user is located, based on the aforementioned audio and video parameters. The method according to claim 3.

6. A method for screen projection, the method is A step of receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content. The process includes the step of rendering and displaying a video stream corresponding to the target content at the microphone seat of the first user, method.

7. A device for screen projection, said device is A target content display module for displaying target content based on an action triggered by a first user in the live streaming interface, A video stream acquisition module for obtaining a video stream corresponding to the aforementioned target content, The system includes a screen projection module for projecting the video stream onto a screen at the microphone seat of a first user and for pushing the video stream to the client where a second user is located. Device.

8. A device for screen projection, said device is A video stream receiving module for receiving a video stream pushed from a client where a first user is located, wherein the video stream includes a video stream corresponding to target content, The system includes a display module for rendering and displaying a video stream corresponding to the target content at the microphone seat of the first user, Device.

9. It includes one or more processors and a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors are made to implement the method according to any one of claims 1 to 6. electronic equipment.

10. A computer-executable instruction for performing the method described in any one of claims 1 to 6, when executed by a computer processor, storage medium.

Images