Scene information processing method and device and electronic equipment
By introducing scene information processing methods in the VR live broadcast system, the problem of cold start of the server when users switch applications is solved, and efficient application switching and flexible device deployment are achieved.
Patent Information
- Application Number
- CN202311510813.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-13
- Publication Date
- 2025-05-13
AI Technical Summary
When existing VR technology is used to switch applications, the server needs to be cold-started, resulting in inefficiency and inflexible device deployment.
By introducing a scene information processing method in the live broadcast system, after the first end detects the selection operation of the application identification, the scene identification is sent to the server, and the server obtains the three-dimensional scene information based on the identification and sends it to the second end, realizing application switching without cold start.
It realizes that the first end does not require a server-side cold start when switching between different applications, improves the switching efficiency and makes the deployment of the first end and the second end more flexible.
Smart Images

Figure CN119996387A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of Internet technology, and in particular to a scene information processing method, device and electronic device. Background Art
[0002] With the development of science and technology, VR technology has also been fully developed, and many VR applications (VR games, VR movies, etc.) have emerged. VR mainly uses pre-built three-dimensional models and then presents the three-dimensional models to give users a sense of immersion. Therefore, in order to give users a better sense of immersion, users can watch the pre-built VR models by wearing VR headsets, so that they can have a better sense of immersion. Summary of the invention
[0003] This disclosure section is provided to introduce concepts in a brief form, which will be described in detail in the detailed description section below. This disclosure section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0004] The embodiments of the present disclosure provide a scene information processing method, device and electronic device, which can eliminate the need for a cold start on the server side when the first side switches between different applications, and can also make the deployment of the first side and the second side more flexible.
[0005] In a first aspect, an embodiment of the present disclosure provides a scene information processing method, which is applied to a first end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data is transmitted between the first end and the second end through the server end; the scene information processing method includes: in response to detecting a selection operation for a first application identifier for display, running a first application indicated by the first application identifier, and determining first three-dimensional scene information corresponding to the first application; sending a first scene identifier corresponding to the first three-dimensional scene information to the server end, and displaying the first three-dimensional scene information; wherein the server end obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
[0006] In a second aspect, an embodiment of the present disclosure provides a scene information processing method, which is applied to a server end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; in response to receiving a scene identifier sent by the first end, three-dimensional scene information is determined according to the scene identifier; wherein the scene identifier is used to indicate the three-dimensional scene information; the three-dimensional scene information is sent to the second end, wherein the second end is used to display the three-dimensional scene information.
[0007] In a third aspect, an embodiment of the present disclosure provides a scene information processing method, which is applied to the second end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; in response to receiving three-dimensional scene information sent by the server end, the three-dimensional scene information is displayed.
[0008] In a fourth aspect, an embodiment of the present disclosure provides a scene information processing device, which is applied to a first end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data is transmitted between the first end and the second end through the server end; the scene information processing device includes: an execution unit, which is used to run a first application indicated by the first application identifier in response to detecting a selection operation for a first application identifier for display, and determine first three-dimensional scene information corresponding to the first application; a display unit, which is used to send a first scene identifier corresponding to the first three-dimensional scene information to the server end, and display the first three-dimensional scene information; wherein the server end obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
[0009] In a fifth aspect, an embodiment of the present disclosure provides a scene information processing device, which is applied to a server end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: a determination unit, which is used to determine three-dimensional scene information in response to receiving a scene identifier sent by the first end and according to the scene identifier; wherein the scene identifier is used to indicate the three-dimensional scene information; a sending unit, which is used to send the three-dimensional scene information to the second end, wherein the second end is used to display the three-dimensional scene information.
[0010] In a sixth aspect, an embodiment of the present disclosure provides a scene information processing device, which is applied to the second end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end via the server end; the scene information processing device includes: a display unit, which is used to display the three-dimensional scene information in response to receiving the three-dimensional scene information sent by the server end.
[0011] In the seventh aspect, an embodiment of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the scene information processing method of the first aspect, and the one or more processors implement the scene information processing method of the second aspect, and the one or more processors implement the scene information processing method of the third aspect.
[0012] In an eighth aspect, an embodiment of the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the scene information processing method of the first aspect described above, and, when executed by a processor, implements the scene information processing method of the second aspect described above, and, when executed by a processor, implements the scene information processing method of the third aspect described above.
[0013] The scene information processing method, device and electronic device provided by the embodiments of the present disclosure make the deployment of the first end and the second end more flexible due to the wireless connection between the first end, the second end and the server end. At the same time, after the user selects one of the applications, the first end can only send the scene identifier to the server end, and the server end can use the scene identifier sent by the first end to obtain the scene information, and then send the scene information to the second end for display; and in this process, since the first end and the server end do not interact in pure text, the first end can enter and exit a certain application at will, and only the first end can change the sent scene identifier in this process, so that the server end can obtain the corresponding scene information according to the received scene identifier. That is, compared with the pure text interaction in the related art, the method disclosed in this application can also avoid the cold start of the server end. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0015] Figure 1is a flow chart of an embodiment of a scene information processing method according to the present disclosure;
[0016] Figure 2 is a schematic diagram of a live broadcast system according to another embodiment of the present disclosure;
[0017] Figure 3 is a schematic diagram of GRPC construction according to another embodiment of the present disclosure;
[0018] Figure 4 is a flowchart of a scene information processing method according to yet another embodiment of the present disclosure;
[0019] Figure 5 is a data interaction schematic diagram according to yet another embodiment of the present disclosure;
[0020] Figure 6 is a flowchart of a scene information processing method according to yet another embodiment of the present disclosure;
[0021] Figure 7 is a structural schematic diagram of an embodiment of a scene information processing device according to the present disclosure;
[0022] Figure 8 is a structural schematic diagram of an embodiment of a scene information processing device according to the present disclosure;
[0023] Fig. 9 is a structural schematic diagram of an embodiment of a scene information processing device according to the present disclosure;
[0024] Fig.10 is an exemplary system architecture to which the information push method of an embodiment of the present disclosure can be applied;
[0025] Fig.11 It is a schematic diagram of the basic structure of an electronic device provided according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0027] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0028] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0029] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0030] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0031] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0032] The application scenario of the present application may be a three-dimensional live broadcast system scenario (for example, a VR live broadcast system scenario). In the three-dimensional live broadcast system, it may include a client, a server, and a head-mounted device.
[0033] The client can be used to display the 3D scene image corresponding to the 3D image application, and allow the user to select the 3D image application to be browsed. The server can obtain the 3D scene image corresponding to the 3D image application, and can send the 3D scene image to the head-mounted device, and the head-mounted device can display the 3D scene image, so that the user can have an immersive experience by wearing the head-mounted device.
[0034] In some implementations, the head mounted device may be understood as a VR head mounted device. At the same time, in order to better understand the concept of the present application, the following is an explanation using a VR live broadcast system:
[0035] In the related art, the client and the server are integrated together, and the head-mounted device is connected to the server through a wired connection. In this way, it is necessary to compare the process identifier (PID) of the current VR application with the (PID) of the file share to determine the VR application that needs to be opened currently. In this way, after the user changes the VR application displayed on the client, the later-started VR application needs to overwrite the first-started VR application. Therefore, it is necessary to restart the service suite used by the server to serve the VR application process (since this change method is a change to the file variables, the service needs to be restarted). At the same time, since the head-mounted device and the server are connected through a wired connection, its applicability is not strong.
[0036] Please refer to Figure 1 , which shows a flow chart of an embodiment of a scene information processing method according to the present disclosure. The scene information processing method can be applied to a terminal device. Figure 1 The scene information processing method shown comprises the following steps:
[0037] The above method can be applied to the first end of a live broadcast system, wherein the live broadcast system may include a first end, a server end, and a second end, and wireless data transmission can be performed between the first end and the second end through the server end.
[0038] Step 101, in response to detecting a selection operation on a displayed first application identifier, running a first application indicated by the first application identifier, and determining first three-dimensional scene information corresponding to the first application.
[0039] Here, the first application identifier may indicate the first application.
[0040] As an example, when a selection operation on a displayed first application logo is detected, the first application can be run, so that first three-dimensional scene information corresponding to the first application can be determined.
[0041] The first three-dimensional scene information can be understood as the three-dimensional scene information that needs to be displayed first after the first application is run.
[0042] As an example, multiple application program identifiers may be displayed on the display interface, and the first application identifier may be understood as any one of the multiple application program identifiers.
[0043] As an example, the specific implementation method of the selection operation can be limited according to actual conditions (for example, it can be a click operation, a long press operation, etc.), and the specific method of the selection operation is not limited here.
[0044] Step 102: Send a first scene identifier corresponding to the first three-dimensional scene information to a server, and display the first three-dimensional scene information.
[0045] Here, the server may obtain the first three-dimensional scene information based on the received first scene identifier, and send the first three-dimensional scene information to the second end, and the second end may be used to display the first three-dimensional scene information.
[0046] As an example, the first scene identifier may indicate the first three-dimensional scene information. That is, the server may obtain the corresponding scene information according to the scene identifier.
[0047] As an example, the server may be a server or a cloud. The first end sends the first scene identifier to the server, and the server may obtain the first three-dimensional scene information according to the first scene identifier.
[0048] The way the server obtains scene information based on the scene identifier can be reasonably set according to the actual situation. For example, when a user creates a three-dimensional scene on the first end (each scene can correspond to a corresponding scene identifier), the created three-dimensional scene information and the scene identifier corresponding to each scene information can be uploaded to the server in real time, so that the server can directly obtain the corresponding three-dimensional scene information on this end according to the scene identifier. Of course, the server can also obtain the corresponding three-dimensional scene information from the first end by calling through the scene identifier. In the specific implementation method, there are many ways for the server to obtain three-dimensional scene information, which can be reasonably set according to the actual situation.
[0049] The second end can be understood as a head-mounted device. At this time, after receiving the first three-dimensional scene information, the head-mounted device can display the first three-dimensional scene information, so that the user can immersively browse the first three-dimensional scene corresponding to the first application.
[0050] As an example, the first end may also display the first three-dimensional scene information.
[0051] It should be noted that both the first end and the second end can display three-dimensional scene information. The only difference is that the first end is a client, and the immersive feeling given to the user by directly displaying the three-dimensional scene information on the display screen may not be very strong. The second end can be a VR head-mounted device, which can give the user a better sense of immersion.
[0052] It should be noted that the first end, the server end, and the second end can all be connected wirelessly, making the deployment of the first end, the server end, and the second end easier, that is, the first end and the second end can be easily deployed. Compared with the wired connection method, there is no distance limit between the first end and the second end, so the deployment of the first end and the second end can be more flexible.
[0053] At the same time, because the server receives the scene identifier and uses the scene identifier to obtain the scene information, the server does not need to deploy the same running program as the client, thus avoiding the cold start of the service suite. In this way, the problem that the server needs to restart the service after the client changes the application can be solved. This method can also achieve more convenient switching between different applications on the first end.
[0054] It can be seen that in the present disclosure, since the first end, the second end and the server are wirelessly connected, the deployment of the first end and the second end is more flexible. At the same time, after the user selects one of the applications, the first end can only send a scene identifier to the server, and the server can use the scene identifier sent by the first end to obtain scene information, and then send the scene information to the second end for display; and in this process, since there is no pure text interaction between the first end and the server, the first end can enter and exit a certain application at will, and only the first end can change the sent scene identifier during the process, so that the server can obtain the corresponding scene information according to the received scene identifier. That is, compared with the pure text interaction in the related art, the method disclosed in this application can also avoid the cold start of the server.
[0055] In order to better understand the ideas disclosed in this application, you can combine Figure 2 To explain, Figure 2 A live broadcast system diagram of an embodiment of the present disclosure is shown in FIG. Figure 2 As shown, the live broadcast system may include a first end 201, a service end 202, and a second end 203. Figure 2 It can be seen that data is exchanged between the first end 201 and the second end 203 through the server 202. The first end 201 can send a scene identifier to the server 202, and the server 202 can obtain scene information according to the scene identifier and transmit the scene information to the second end 203.
[0056] In some embodiments, in response to detecting a change in the displayed content, the changed second 3D scene information can be determined to determine a second 3D scene identifier corresponding to the second 3D scene information, and the second 3D scene identifier can be sent to the server, and the second 3D scene information can be displayed.
[0057] Here, the server may obtain the second three-dimensional scene information based on the second three-dimensional scene identifier, and may send the second three-dimensional scene information to the second end, and the second end may be used to display the second three-dimensional scene information.
[0058] As an example, after detecting that the display content has changed, the second scene identifier corresponding to the changed second three-dimensional scene information can be sent to the server, so that the server can obtain the second three-dimensional scene information, and the second three-dimensional scene information can be sent to the second end, so that the three-dimensional scene information displayed on the second end is synchronized with the three-dimensional scene information displayed on the first end.
[0059] It can be seen that in this way, when the display content of the first end changes, it only needs to send the changed scene identifier to the server, and the server can obtain the scene information and send the scene information to the second end. This method can save the amount of information that needs to be sent each time the scene changes.
[0060] In some embodiments, the server may use the scene identifier to obtain three-dimensional scene information corresponding to the scene identifier from the first end.
[0061] As an example, the server can use the scene identifier to obtain the three-dimensional scene information corresponding to the scene identifier from the first end. In this way, after the first end changes the display content of the application, the server can also obtain the correct three-dimensional scene information.
[0062] For example, an application may be updated regularly, and after the update, the 3D scene information corresponding to the application may also change. In this way, since the server may not store the corresponding scene information, it obtains the 3D scene information by calling the first end and forwards the 3D scene information to the second end. In this way, the scalability of the application is increased, making it easier for users to expand the application.
[0063] In some implementations, which can also be understood as the methods of the present disclosure, users can upload certain customized data, so that users can update the application at any time.
[0064] In some embodiments, in response to detecting a newly added third application, corresponding address information of the third application is sent to the server.
[0065] As an example, the server may obtain three-dimensional scene information corresponding to the third application according to the address information.
[0066] As an example, after a third application is newly added, it is only necessary to send the address information of the third application to the server, and the server can obtain the 3D scene information corresponding to the third application by calling. In this way, when the user chooses to browse the third application, the server may have already obtained the 3D scene information corresponding to the third application, and thus can obtain the 3D scene information locally. This method can obtain the 3D scene information more efficiently. In this way, the consistency of the content displayed on the first and second ends can be further guaranteed.
[0067] At the same time, after adding a third application, it is only necessary to send the address information of the third application to the server, which greatly improves the scalability of the entire interactive system. That is, users can easily add applications on the first end.
[0068] In one possible implementation, the first end, the server end, and the second end can be connected using the GRPC architecture. This makes it easier for the server end to call the information of the first end and for the first end to expand its functions. Figure 3 To explain, Figure 3 This is a schematic diagram of the architecture of a live broadcast system according to an embodiment of the present disclosure. Figure 3 It can be seen that all applications can be connected to the server, that is, the server can call the data corresponding to any application (of course, including scene information). In this way, after adding an application, the section can be initialized so that the newly added program can be connected to the server, so that the server can obtain the scene information of the newly added application on the first end by calling, and can send the scene information to the second end.
[0069] In some embodiments, in response to detecting a switch operation of running an application, an application selection page may be displayed, and the first application may be exited from the running state, and page information of the application selection page may be sent to the server.
[0070] Here, the application selection page may include at least one application identifier, and the application identifier may indicate an application. It can be understood that the user may determine the application to be entered by triggering the application identifier.
[0071] Here, the at least one application identifier may include a first application identifier.
[0072] Here, the server can send the page information to the second end, and the second end can be used to display the page information.
[0073] As an example, an application identifier may indicate an application, and a user may select an application to be entered on an application selection page. At this time, it may be indicated that the user is browsing an application scenario corresponding to the application.
[0074] As an example, the application program can be understood as an application program for displaying three-dimensional scene information. Of course, the type of the specific application program can be set according to actual conditions.
[0075] As an example, an application selection page is displayed to facilitate users to select the application they need to enter.
[0076] In some embodiments, at least one application identifier may include a second application identifier, and, in response to detecting a selection operation for the second application, the second application may be run, and third three-dimensional scene information corresponding to the second application may be determined; and a third scene identifier corresponding to the third three-dimensional scene information may be sent to a server, and the third three-dimensional scene information may be displayed.
[0077] Here, the server may obtain the third three-dimensional scene information based on the received third scene identifier, and may send the third three-dimensional scene information to the second end, and the second end is used to display the third three-dimensional scene information.
[0078] It can be seen that in the process of switching from the first application to the second application, it is only necessary to change the scene identifier sent to the server. In this way, in the process of switching between different programs, the server does not need to perform a cold start, thereby improving the efficiency of switching and browsing different applications. Compared with the related art that requires a cold start each time an application is switched, the method disclosed in the present invention not only improves efficiency, but also has better applicability, making it more convenient for users to use.
[0079] In some embodiments, in response to detecting that a change has occurred in the presentation content, first notification information may be generated, and the first notification information may be sent to the server.
[0080] Here, the server may obtain the changed display information in response to receiving the first notification information.
[0081] As an example, the first notification information may include a scene identifier corresponding to the changed three-dimensional scene information, so that the server can directly obtain the changed display information according to the received first notification information.
[0082] As an example, after receiving the first notification information, the server may also obtain the changed display information from the first end by calling.
[0083] In the related art, an interval reading mechanism is usually adopted. For example, the display content of the first end is read once every 1 second to see if it has changed. If it has changed, the change information is written to the server, so that the server can also know what has changed. However, this interval reading mechanism relies on reading and writing at each interval; thus, when the display content changes during the interval, the server cannot obtain the change information in time, which may cause delays in the scene information sent by the server to the second end.
[0084] In the present disclosure, when the display information is changed, first notification information may be generated and sent to the server, so that the server can obtain the changed scene information in a timely manner according to the first notification information.
[0085] In some embodiments, the first end may send connection confirmation information to the server at intervals of a preset duration; and may determine the connection status between the first end and the server based on the feedback result of the server.
[0086] As an example, since the first end is connected to the server via wireless transmission, the connection between the first end and the server may be interrupted. The first end can obtain the connection status once every period of time, so that the first end can know the connection status in real time. If the connection is interrupted, the user at the first end can also know it in time. In this way, while it is convenient for users to handle connection failures in time, the stability of the connection can also be ensured.
[0087] In some embodiments, the first end may send mask information to the service end.
[0088] Here, the mask information may be used to indicate filtering out information of a predefined type.
[0089] As an example, the first end may set information that does not need to be received, for example, some notification information that the user of the first end may not pay attention to, so the server may not send this information to the first end. In this way, transmission resources can be saved.
[0090] As an example, the mask information may indicate the type of information that needs to be filtered out. Of course, the specific information that needs to be filtered out may be reasonably set according to actual conditions, and the specific information that needs to be filtered out is not limited here.
[0091] In some embodiments, the service end may determine whether to send the information sent by the second end to the first end according to the mask information in response to receiving the information sent by the second end.
[0092] As an example, the server can store the address and mask information of the first end in correspondence; in this way, after the server receives the information that needs to be sent to the first end, it can determine whether to send the information to the first end based on the mask information sent by the first end.
[0093] As an example, the server uses mask information to determine whether to send the received information to the first end, which allows the server to save data transmission resources, thereby improving the stability of the data transmission process from the server to the first end.
[0094] In some embodiments, before the first end sends data to the server end, the method may further include: encrypting the data to be sent to obtain encrypted data, and sending the encrypted data to the server end.
[0095] As an example, encrypting the data to be sent can make the data less likely to be changed during the transmission process, thereby further ensuring the stability of the transmission process.
[0096] In some implementations, the first end may include at least two pieces of data to be sent, and may also sort the at least two pieces of data to be sent according to the timestamps of the data to be sent; in response to detecting that the previous data has been sent, determine whether to send the next data according to the data type of the previous data.
[0097] As an example, some data may need to rely on the result of the previous data to determine whether to send, while some data may not need to rely on the result of the previous data to be sent.
[0098] For example, if the previous data is connection data and the next data is scene data, the next data may depend on the result of the top data. If the previous data is scene data and the next data is also scene data, the next data may not need to depend on the transmission result of the previous data, thus ensuring smooth data transmission.
[0099] It can be seen that in the interactive process of the present disclosure, both synchronous transmission and asynchronous transmission can be used at the same time, and the transmission mode used for the next data can be determined according to the data type of the previous data of the two adjacent data to be transmitted, so as to save transmission resources while ensuring the stability of the transmitted data. For example, in the related art, due to the use of a single data transmission method, data that does not need to be sent may be sent out, or data that does not need to wait for the feedback result of the previous data may be sent out with a delay. However, the present application, by using both synchronous transmission and asynchronous transmission, can save transmission resources while ensuring the stability of the transmitted data.
[0100] In some embodiments, the application identification may include a screenshot of the application scenario of the application.
[0101] As an example, the application identification may include a screenshot of the application scenario, so that the user can more conveniently determine the display scenario corresponding to each application, so that the user does not need to enter each application to understand the corresponding display scenario, thereby simplifying the steps for the user to understand the display scenario corresponding to each application.
[0102] In some implementations, the first end may also send a deletion instruction to the server end for instructing to delete the fourth application, so that the server end may delete all relevant information of the fourth application according to the deletion instruction. For example, the server end may delete the scene information corresponding to the fourth application, the information list created for the fourth application, etc., so that the storage resources of the server end can be saved.
[0103] See also Figure 4 , the figure is a flow chart of the scene information processing method provided by the present disclosure, the scene information processing method can be applied to the server end of the live broadcast system, and the live broadcast system can include a first end, a server end, and a second end, and wireless data transmission can be performed between the first end and the second end through the server end.
[0104] Step 401: in response to receiving a scene identifier, determine three-dimensional scene information according to the scene identifier.
[0105] Here, the scene identifier can be used to indicate the scene information. The server can call the scene information from the first end according to the scene identifier, or obtain the scene information from the local according to the scene identifier.
[0106] For example, if the received scene identifier already exists locally, the server can also directly obtain it locally. If the scene information corresponding to the received scene identifier does not exist locally, it may be necessary to call from the first end and then obtain the scene information corresponding to the scene identifier.
[0107] Step 402: Send the three-dimensional scene information to the second end.
[0108] Here, the second end can be used to display three-dimensional scene information.
[0109] As an example, a user can browse three-dimensional scene information through the second end, and the second end can be understood as a VR head-mounted device. Browsing the three-dimensional scene information through the second end can bring a more immersive browsing experience to the user, making the user experience better.
[0110] In some embodiments, in response to receiving a first connection request from a first end, a first message queue corresponding to the first end is established; in response to receiving a second connection request including an application address, a second message queue corresponding to the application is established.
[0111] As an example, a message queue of the first end and a second message queue of the application are established, so that information can be sent to a certain application of the first end separately or directly to the first end.
[0112] As an example, it can be understood that: messages sent through the second message queue can only be seen after entering the corresponding application. Messages sent through the first message queue can be seen when the first end is in the display state. In other words, it can be understood that the messages sent by the first message queue may be for all applications on the first end (for example, a broadcast message, a connection message, etc.); while the second message queue is for a single application (for example, a display message for the application, etc.).
[0113] In some implementations, each application may establish a separate message queue, so that messages for different applications may be placed in different message queues, thereby making the data transmission process more targeted.
[0114] In some embodiments, in response to receiving data sent by the second end, it is determined according to the type of the data to add the data to the message queue.
[0115] As an example, the server can also determine the message queue to which the data needs to be added based on the type of data. This makes the data transmission method more flexible and prevents users from receiving information that is not relevant to them when browsing the scene information corresponding to a certain application.
[0116] For ease of understanding, you can combine Figure 5 To explain, Figure 5 is an interactive schematic diagram of an embodiment of the present disclosure, from Figure 5It can be seen that the present disclosure can use the streaming service form of the GRPC client. When the application establishes a connection with the server, it will initiate a request to establish an application streaming service. After the request is established, the server will obtain a writing object Writer of the streaming service. The life cycle of this object is the same as the life cycle of the service connection. At the same time, the server can also maintain an event loop for each application connection. Each event loop has a message queue. The message queue can be indexed using the application ID. When the server processes the server request, it will encapsulate the processing result into an event and put it into the message queue corresponding to the event loop. The event loop detects the generation of a new message and sends it back to the application through the Writer.
[0117] In the above process, if the server's response is for a specific application, you need to first find the corresponding message queue by the application ID, and then put the event into the queue. In this way, only the specific application can receive the message. If the server's response is for all applications, you can traverse all message queues, and at this time, all applications connected to the server can receive the message.
[0118] See also Figure 6 , the figure is a flow chart of the scene information processing method provided by the present disclosure, the scene information processing method can be applied to the second end of the live broadcast system, and the live broadcast system can include a first end, a server end, and a second end, and wireless data transmission can be carried out between the first end and the second end through the server end.
[0119] Step 601: In response to receiving the three-dimensional scene information sent by the server, the three-dimensional scene information is displayed.
[0120] As an example, the three-dimensional scene information sent by the server is displayed on the second end, and the user can browse the three-dimensional scene information through the second end and have a better immersive experience.
[0121] In some embodiments, in response to detecting a status information sending instruction for the second end, the status information is sent to the service end.
[0122] Here, the server is used to send the status information to the first end, and the first end is used to display the status information.
[0123] Here, the status information includes at least one of the following:
[0124] Network connection status information, power information, picture clarity information, etc. Of course, the specific information included in the status information can be limited according to actual conditions.
[0125] As an example, the status information of the second terminal is sent to the server and forwarded to the first terminal for display, so that the user of the first terminal can also know the status information of the second terminal. In this way, the stability of the live broadcast system is higher. For example, when it is detected that the battery of the second terminal is too low, the first terminal can send a prompt message so that when watching at the second terminal, the low battery information can be seen. For another example, when the network connection is not smooth, the server can be instructed to deeply compress the three-dimensional scene information before transmitting it, so that transmission resources can be saved.
[0126] That is, the second end increases the adjustability of the entire live broadcast system by feeding back the status information to the first end, thereby making the live broadcast system more stable.
[0127] In some embodiments, in response to detecting a control instruction for displaying content, the control instruction may be transmitted to the server.
[0128] Here, the server may transmit the control instruction to the first end, and the first end changes the display content in response to the received control instruction based on the instruction of the control instruction.
[0129] As an example, this can also make it easier for the user at the second end to change the displayed content, so that the change of the displayed content can be more convenient, and the stability can be further improved.
[0130] Further references Figure 7 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a scene information processing device, and the device embodiment is Figure 1 Corresponding to the embodiment of the scene information processing method shown, the device can be specifically applied to various electronic devices.
[0131] like Figure 7 As shown, the scene information processing device of this embodiment is applied to the first end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: an execution unit 701, which is used to run the first application indicated by the first application identifier in response to detecting a selection operation for the first application identifier to be displayed, and determine the first three-dimensional scene information corresponding to the first application; a display unit 702, which is used to send the first scene identifier corresponding to the first three-dimensional scene information to the server end, and display the first three-dimensional scene information; wherein the server end obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
[0132] In some embodiments, the scene information processing device is further used to: in response to detecting a change in the display content, determine the changed second three-dimensional scene information to determine the second three-dimensional scene identifier corresponding to the second three-dimensional scene information; send the second three-dimensional scene identifier to the server, and display the second three-dimensional scene information, wherein the server obtains the second three-dimensional scene information based on the second three-dimensional scene identifier, and sends the second three-dimensional scene information to the second end, and the second end is used to display the second three-dimensional scene information.
[0133] In some embodiments, the server uses the scene identifier to obtain the three-dimensional scene information corresponding to the scene identifier from the first end.
[0134] In some embodiments, the scene information processing device is also used to: in response to detecting a switching operation of a running application, display an application selection page, and exit the running state of the first application; wherein the application selection page includes at least one application identifier, and the application identifier indicates the application; send the page information of the application selection page to the server, wherein the server sends the page information to the second end, and the second end is used to display the page information.
[0135] In some embodiments, the scene information processing device is also used to: generate first notification information in response to detecting a change in display content, and send the first notification information to a server, wherein the server obtains the changed display information in response to receiving the first notification information.
[0136] In some embodiments, the scene information processing device is further used to: send connection confirmation information to the server at preset intervals; and determine the connection status between the first end and the server based on the feedback result of the server.
[0137] In some embodiments, the scene information processing device is further used to: send mask information to the server, wherein the mask information is used to indicate filtering out information of a predefined type.
[0138] In some embodiments, the scene information processing device is also used to: in response to detecting a newly added third application, send address information corresponding to the third application to the server; wherein the server obtains the three-dimensional scene information corresponding to the three-dimensional application based on the address information.
[0139] In some embodiments, before sending data to the above-mentioned server, the above-mentioned scene information processing device is also used to: encrypt the data to be sent to obtain encrypted data, and send the encrypted data to the server.
[0140] In some embodiments, the first end includes at least two pieces of data to be sent, and the scene information processing device is also used to: sort the at least two pieces of data to be sent according to the timestamp of the data to be sent; in response to detecting that the previous data has been sent, determine whether to send the next data according to the data type of the previous data.
[0141] In some embodiments, the application identification includes a screenshot of the application scenario of the application.
[0142] Further references Figure 8 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a scene information processing device, and the device embodiment is Figure 4 Corresponding to the embodiment of the scene information processing method shown, the device can be specifically applied to various electronic devices.
[0143] like Figure 8 As shown, the scene information processing device of this embodiment is applied to the server end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: a determination unit 801, for determining three-dimensional scene information in response to receiving a scene identifier sent by the first end and according to the scene identifier; wherein the scene identifier is used to indicate the three-dimensional scene information; a sending unit 802, for sending the three-dimensional scene information to the second end, wherein the second end is used to display the three-dimensional scene information.
[0144] In some embodiments, the above-mentioned scene information processing device is also specifically used to: establish a first message queue corresponding to the first end in response to receiving a first connection request from the first end; establish a second message queue corresponding to the application in response to receiving a second connection request including an application address.
[0145] In some embodiments, the scene information processing device is further specifically used to: in response to receiving data sent by the second end, determine the message queue to add the data according to the type of the data.
[0146] Further references Fig. 9 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a scene information processing device, and the device embodiment is Figure 6 Corresponding to the embodiment of the scene information processing method shown, the device can be specifically applied to various electronic devices.
[0147] like Fig. 9As shown, the scene information processing device of this embodiment is applied to the second end of the live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: a display unit 901, which is used to display the three-dimensional scene information in response to receiving the three-dimensional scene information sent by the server end.
[0148] In some embodiments, the scene information processing device is further used to: in response to detecting a status information sending instruction for the second end, send the status information to the server, wherein the server is used to send the status information to the first end, and the first end is used to display the status information, wherein the status information includes at least one of the following:
[0149] Network connection status information, battery information, and picture clarity information.
[0150] In some embodiments, the scene information processing device is also specifically used to: in response to detecting a control instruction for display content, transmit the control instruction to the server; wherein the server transmits the control instruction to the first end, and the first end changes the display content based on the instruction of the control instruction in response to receiving the control instruction.
[0151] Please refer to Fig.10 , Fig.10 An exemplary system architecture is shown in which the information push method according to an embodiment of the present disclosure can be applied.
[0152] like Fig.10 As shown, the system architecture may include terminal devices 1001, 1002, 1003, a network 1004, and a server 1005. The network 1004 may be used to provide a medium for a communication link between the terminal devices 1001, 1002, 1003 and the server 1005. The network 1004 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0153] The terminal devices 1001, 1002, and 1003 can interact with the server 1005 through the network 1004 to receive or send messages, etc. Various client applications, such as web browser applications, search applications, and news information applications, can be installed on the terminal devices 1001, 1002, and 1003. The client applications in the terminal devices 1001, 1002, and 1003 can receive user instructions and perform corresponding functions according to the user instructions, such as adding corresponding information to the information according to the user instructions.
[0154] Terminal devices 1001, 1002, 1003 can be hardware or software. When terminal devices 1001, 1002, 1003 are hardware, they can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Compression Standard Audio Layer 4) players, laptop computers and desktop computers, etc. When terminal devices 1001, 1002, 1003 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.
[0155] The server 1005 may be a server that provides various services, such as receiving information acquisition requests sent by the terminal devices 1001, 1002, and 1003, acquiring display information corresponding to the information acquisition requests in various ways according to the information acquisition requests, and sending the relevant data of the display information to the terminal devices 1001, 1002, and 1003.
[0156] It should be noted that the scene information processing method provided in the embodiment of the present disclosure can be executed by a terminal device, and accordingly, the scene information processing device can be set in the terminal devices 1001, 1002, and 1003. In addition, the scene information processing method provided in the embodiment of the present disclosure can also be executed by a server 1005, and accordingly, the scene information processing device can be set in the server 1005.
[0157] It should be understood that Fig.10 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.
[0158] Reference below Fig.11 , which shows an electronic device (eg, Fig.10 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.11The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0159] like Fig.11 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage device 1108 to a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the electronic device 1100 are also stored. The processing device 1101, the ROM 1102, and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.
[0160] Typically, the following devices may be connected to the I / O interface 1105: input devices 1106 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 1107 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1108 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1109. The communication devices 1109 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Fig.11 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0161] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1109, or installed from the storage device 1108, or installed from the ROM 1102. When the computer program is executed by the processing device 1101, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0162] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0163] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0164] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0165] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: in response to detecting a selection operation for a displayed first application identifier, runs the first application indicated by the first application identifier, and determines the first three-dimensional scene information corresponding to the first application; sends the first scene identifier corresponding to the first three-dimensional scene information to the server, and displays the first three-dimensional scene information; wherein the server obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
[0166] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0167] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0168] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of the unit does not limit the unit itself in some cases. For example, the execution unit 701 may also be described as "a unit for running the first application indicated by the first application identifier, and determining the first three-dimensional scene information corresponding to the first application".
[0169] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0170] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0171] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0172] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0173] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
Claims
1. A scene information processing method, characterized in that: The method is applied to a first end of a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing method includes: In response to detecting a selection operation on a displayed first application identifier, running a first application indicated by the first application identifier, and determining first three-dimensional scene information corresponding to the first application; Sending a first scene identifier corresponding to the first three-dimensional scene information to the server, and displaying the first three-dimensional scene information; wherein the server obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
2. The method according to claim 1, characterized in that: The method further comprises: In response to detecting that the display content has changed, determining the changed second three-dimensional scene information to determine a second three-dimensional scene identifier corresponding to the second three-dimensional scene information; The second three-dimensional scene identifier is sent to the server, and the second three-dimensional scene information is displayed, wherein the server obtains the second three-dimensional scene information based on the second three-dimensional scene identifier, and sends the second three-dimensional scene information to the second end, and the second end is used to display the second three-dimensional scene information.
3. The method according to claim 1 or 2, characterized in that: The server uses the scene identifier to obtain the three-dimensional scene information corresponding to the scene identifier from the first end.
4. The method according to claim 1, characterized in that: The method further comprises: In response to detecting a switch operation of a running application, displaying an application selection page, and exiting the first application from a running state; wherein the application selection page includes at least one application identifier, and the application identifier indicates an application; The page information of the application selection page is sent to the server, wherein the server sends the page information to the second end, and the second end is used to display the page information.
5. The method according to claim 1, characterized in that The method further comprises: In response to detecting that the display content has changed, first notification information is generated, and the first notification information is sent to the server, wherein the server obtains the changed display information in response to receiving the first notification information.
6. The method according to claim 1, characterized in that The method further comprises: The mask information is sent to the server, wherein the mask information is used to indicate filtering out information of a predefined type.
7. The method according to claim 1, characterized in that The method further comprises: In response to detecting a newly added third application, address information corresponding to the third application is sent to a server; wherein the server obtains three-dimensional scene information corresponding to the three-dimensional application according to the address information.
8. The method according to claim 1, characterized in that: The first end includes at least two pieces of data to be sent, and the method further includes: Sort the at least two pieces of data to be sent according to the timestamps of the data to be sent; In response to detecting that the previous data has been sent, it is determined whether to send the next data according to the data type of the previous data.
9. The method according to claim 1, characterized in that: The application logo includes a screenshot of the application's application scenario.
10. A scene information processing method, characterized in that: A server end applied to a live broadcast system, wherein the live broadcast system comprises a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end via the server end; In response to receiving the scene identifier sent by the first end, determining the three-dimensional scene information according to the scene identifier; wherein the scene identifier is used to indicate the three-dimensional scene information; The three-dimensional scene information is sent to a second end, wherein the second end is used to display the three-dimensional scene information.
11. The method according to claim 10, characterized in that The method further comprises: In response to receiving a first connection request from the first end, establishing a first message queue corresponding to the first end; In response to receiving a second connection request including an application address, a second message queue corresponding to the application is established.
12. The method according to claim 10, characterized in that The method further comprises: In response to receiving the data sent by the second end, it is determined according to the type of the data to add the data to the message queue.
13. A scene information processing method, characterized in that: The second end is applied to a live broadcast system, wherein the live broadcast system comprises a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end via the server end; In response to receiving the three-dimensional scene information sent by the server, the three-dimensional scene information is displayed.
14. The method according to claim 13, characterized in that The method further comprises: In response to detecting a status information sending instruction for the second end, sending the status information to the server, wherein the server is used to send the status information to the first end, and the first end is used to display the status information, wherein the status information includes at least one of the following: Network connection status information, battery information, and picture clarity information.
15. The method according to claim 14, characterized in that The method further comprises: In response to detecting a control instruction for display content, the control instruction is transmitted to the server; wherein the server transmits the control instruction to the first end, and the first end changes the display content based on the instruction of the control instruction in response to receiving the control instruction.
16. A scene information processing device, characterized in that: The first end of the live broadcast system is applied, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the content processing device includes: an execution unit, configured to, in response to detecting a selection operation on a displayed first application identifier, run a first application indicated by the first application identifier, and determine first three-dimensional scene information corresponding to the first application; A display unit is used to send a first scene identifier corresponding to the first three-dimensional scene information to the server end, and to display the first three-dimensional scene information; wherein the server end obtains the first three-dimensional scene information based on the received first scene identifier, and sends the first three-dimensional scene information to the second end, and the second end is used to display the first three-dimensional scene information.
17. A scene information processing device, characterized in that: A server end applied to a live broadcast system, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: A determination unit, configured to determine the three-dimensional scene information according to the scene identifier in response to receiving the scene identifier sent by the first end; wherein the scene identifier is used to indicate the three-dimensional scene information; A sending unit is used to send the three-dimensional scene information to a second end, wherein the second end is used to display the three-dimensional scene information.
18. A scene information processing device, characterized in that: The second end of the live broadcast system is applied, wherein the live broadcast system includes a first end, a server end, and a second end, and wireless data transmission is performed between the first end and the second end through the server end; the scene information processing device includes: The display unit is used to display the three-dimensional scene information in response to receiving the three-dimensional scene information sent by the server.
19. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 15.
20. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 15 is implemented.