A live picture display method, device, equipment and readable storage medium

Abstract

The application discloses a live picture display method, device, system, equipment and storage medium, and is applied to the technical field of computers and AR glasses, and comprises the following steps: receiving a live picture and interactive information sent by a live machine; displaying the live picture and the interactive information at a target position; the target position is a set region in front of the AR glasses, which is determined based on the position of the AR glasses; receiving adjustment information sent by a control handle; and adjusting the size of the live picture at the target position to a target size based on the adjustment information. Compared with the current situation that the anchor needs to move the line of sight to watch the live picture on a large screen for interaction from time to time, the efficiency of interaction is low, and the user experience is affected. In the application, the live picture and the interactive information can be displayed in front of the user by using the AR glasses, and the line of sight does not need to be moved. In addition, the target position and the target size can be adjusted based on the user demand, so that the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a live picture display method, device and equipment and readable storage medium. BACKGROUND

[0002] Traditional live scene needs a director staff to watch the real-time picture of shooting and perform the director operation. The anchor needs to look away from the live picture on the large screen and watch the barrage for interaction, which makes the live efficiency low and affects the interactive experience of the anchor and the audience.

[0003] Therefore, how to improve the live efficiency and improve the user experience is a technical problem to be solved by the person skilled in the art. SUMMARY

[0004] Therefore, the present application aims to provide a live picture display method, device and equipment and readable storage medium, which solves the technical problem of low live efficiency in the prior art.

[0005] To solve the above technical problems, the present application provides a live picture display method, comprising:

[0006] receiving a live picture and interactive information sent by a live machine;

[0007] displaying the live picture and the interactive information at a target position; wherein the target position is a set region in front of the AR glasses determined based on the position of the AR glasses.

[0008] receiving adjustment information sent by a control handle, and adjusting the size of the live picture at the target position to a target size based on the adjustment information.

[0009] Optionally, after receiving the live picture and the interactive information sent by the live machine, the method further comprises:

[0010] adjusting the layout of the live picture, the interactive information and a live operation picture to obtain a target layout; wherein the live operation picture is a user interface for displaying and controlling live content, and the target layout is one of a single picture layout, a picture superposition layout and a picture split screen layout.

[0011] Optionally, after displaying the live picture and the interactive information at the target position, the method further comprises:

[0012] The live broadcast picture and the interactive information are displayed in the target position; the target position is a set region in front of the AR glasses which is determined based on the position of the AR glasses.

[0013] Optionally, after the live broadcast picture and the interactive information are displayed in the target position, the method further comprises:

[0014] Real-time acquisition of surrounding environment information; wherein the surrounding environment information comprises at least one of light, color and object;

[0015] Based on the surrounding environment information, the live broadcast picture and the interactive information in the target position are rendered to obtain the rendered live broadcast picture and the interactive information; wherein the rendering content comprises at least one of picture definition, font size and augmented reality content.

[0016] Optionally, after the live broadcast picture and the interactive information sent by the live broadcast machine are received, the method further comprises:

[0017] Real-time analysis of the interactive information to obtain user preference information;

[0018] The user preference information is sent to the live broadcast machine.

[0019] Optionally, the interactive information comprises at least one of a barrage, a special effect and a gift.

[0020] The application further provides a live broadcast picture display device applied to AR glasses, comprising:

[0021] A receiving module is configured to receive a live broadcast picture and interactive information sent by a live broadcast machine;

[0022] A display module is configured to display the live broadcast picture and the interactive information in a target position; wherein the target position is a set region in front of the AR glasses which is determined based on the position of the AR glasses.

[0023] An adjustment module is configured to receive adjustment information sent by a control handle and adjust the size of the live broadcast picture in the target position to a target size based on the adjustment information.

[0024] The application further provides a live broadcast picture display system, comprising:

[0025] A control handle is configured to send control information to the AR glasses;

[0026] A live broadcast machine is configured to send a live broadcast picture and interactive information to the AR glasses.

[0027] AR glasses, for performing the live picture display method described above.

[0028] The application also provides an electronic device comprising:

[0029] a memory for storing a computer program;

[0030] a processor for executing the computer program to implement the steps of the live picture display method described above.

[0031] The application also provides a readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the steps of the live picture display method described above.

[0032] The application also provides a computer program product comprising computer programs / instructions, the computer programs / instructions being executed by a processor to implement the steps of the live picture display method described above.

[0033] It can be seen that, by receiving the live picture and the interactive information sent by the live machine, the application displays the live picture and the interactive information at a target position, wherein the target position is a set region in front of the AR glasses determined based on the position of the AR glasses, and by receiving the adjustment information sent by the control handle, the application adjusts the size of the live picture at the target position to a target size based on the adjustment information.

[0034] The application has the following beneficial effects: compared with the current situation that the host needs to move the line of sight away from the live picture on the large screen from time to time to watch the bullet screen for interaction, the efficiency of live interaction is low, and the interactive experience of the host and the audience is affected, the application can realize live streaming by the real-time picture and the interactive information displayed by the AR glasses of the host, improve the live streaming efficiency, and improve the user experience due to the adjustment of the target position and the target size based on the user demand.

[0035] In addition, the application also provides a live picture display device, system, equipment and storage medium, which also have the beneficial effects described above. BRIEF DESCRIPTION OF DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only constitute the embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor based on the provided drawings.

[0037] Figure 1 A flowchart of a live picture display method provided by the embodiments of the application;

[0038] Figure 2 A schematic diagram of a target layout provided for an embodiment of the present application;

[0039] Figure 3 An AR glasses display effect diagram provided for an embodiment of the present application;

[0040] Figure 4 A schematic diagram of control handle control logic provided for an embodiment of the present application;

[0041] Figure 5 A flowchart example diagram of a live picture display method provided for an embodiment of the present application;

[0042] Figure 6 A schematic diagram of a live picture display principle provided for an embodiment of the present application;

[0043] Figure 7 A structural schematic diagram of a live picture display device provided for an embodiment of the present application;

[0044] Figure 8 A structural schematic diagram of a live picture display system provided for an embodiment of the present application;

[0045] Figure 9 A structural schematic diagram of a live picture display system based on AR glasses provided for an embodiment of the present application;

[0046] Figure 10 A structural schematic diagram of a live picture display device provided for an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0048] A common live scene needs to have a shooting camera, a streaming notebook and an interactive large-size screen, which have relatively large volume and weight. Moreover, the outdoor live scene setup consumes a lot of resources and is time-consuming and laborious. The present application combines AR (Augmented Reality) glasses and a live machine with strong computing power and 5G network to meet the more convenient operation of the host with smaller products.

[0049] The traditional live broadcast scene needs a director staff to watch the real-time picture of shooting to conduct the director operation. The anchor needs to look away from the live picture on the large screen from time to time to watch the bullet screen to interact, and the interaction efficiency is low, which affects the interaction experience of the anchor and the audience. The application can realize that the anchor displays the real-time picture through the AR glasses, conducts the director operation through the control handle, and also realizes the interaction with the audience through the live picture displayed by the AR glasses. The comprehensive advantages are obvious.

[0050] Please refer to Figure 1 , Figure 1 A flow chart of a live picture display method provided by the embodiment of the application. The method is applied to AR glasses and can include the following steps.

[0051] S101, receiving the live picture and the interaction information sent by the live broadcast machine.

[0052] The execution subject of the embodiment is AR glasses. The AR glasses, full name Augmented Reality glasses, are a display device using augmented reality technology (Augmented Reality, AR). The live picture in the embodiment refers to the video content recorded in real time by a video capture device and transmitted to the audience during live broadcast. The interaction information during live broadcast in the embodiment refers to the real-time communication and feedback between the audience and the anchor during live broadcast. These interaction information can take various forms, including but not limited to chat and comments, expressions and gifts, bullet screen, likes, sharing, games and challenges. The embodiment can also receive the director picture sent by the live broadcast machine. The director picture refers to the picture processed and switched by the director station, which can include multiple camera perspectives, graphic overlays and special effects. The live picture in the embodiment is a real-time picture. The AR glasses can display the real-time picture, the director picture and the interaction information at the same time, and one person can easily complete the live broadcast and the director operation. The picture played by the live broadcast platform can read the bullet screen content while focusing on the lens to interact with the audience. The live broadcast machine in the embodiment serves as a provider of display pictures, which collects external real-time pictures through a camera and receives the interaction information sent by the server through a 5G / wifi module. The interaction information includes bullet screen, special effects, gifts, etc. The interaction information is sent to the AR glasses.

[0053] It needs to be further explained that based on any of the above embodiments, after receiving the live picture and interactive information sent by the live machine, the layout of the live picture, interactive information and live operation picture can be adjusted to obtain a target layout; wherein the live operation picture is a user interface for displaying and controlling live content; and the target layout is one of single picture layout, picture superposition layout and picture split screen layout. It can be understood that the USB module of the AR glasses receives the real-time live picture and interactive information of the live camera (live machine). It is directly displayed in front of the eyes, and at the same time, the control information of the handle is received to make corresponding adjustments to the display of the input picture and interactive information, thereby improving the live experience of the user. The AR glasses have a large field of view and are easy to wear, so that the entire live scene can be simulated to display the effect of a large screen through the glasses without a physical screen. After the AR glasses replace the physical screen, the picture presented in front of the host is not limited by the screen size, and can be more diversified. This is specifically reflected in the following aspects: 1. The screen picture can be combined more, and the picture size is not affected. The original physical large screen has a fixed screen size, and if multiple pictures need to be displayed, each picture will become smaller, affecting the user's viewing, and using a larger screen will increase the cost linearly. The overall field of view of the AR glasses is very large, and the distance at which the picture is presented in front of the eyes can be adjusted as needed, so that more content can be placed overall, and the integration of the live picture can be laid out more, such as Figure 2 as shown in Figure 2 The schematic diagram of a target layout provided by the embodiments of the present application: a) single picture layout, the picture is more concise, and the left and right keys can be used to switch between live pictures. The displayed picture is larger, and the content of the current picture can be seen more clearly. According to the displayed information, the host can adjust the live mode in a timely manner b) picture superposition layout, the live picture and the corresponding operation interface are displayed in superposition, the content displayed in front of the eyes is more, and the operation is more convenient. The operation result can be immediately seen c) picture split screen layout, each live picture is displayed in split screen, all content can be displayed in front of the eyes, and the layout is separated, the operation is more accurate and clear. The above three ways are only examples, and the specific implementation mode can be flexibly adjusted as needed. In theory, any combination of picture content can be displayed.

[0054] It needs to be further explained that based on any of the above embodiments, after displaying the live picture and the interactive information at the target position, the method can further include: adjusting the display content of the live picture and the interactive information by using the live operation picture and the cursor position information and the key information sent by the control handle; wherein the display content includes at least one of position adjustment, zooming in, zooming out, picture switching and splicing; the position adjustment is to adjust the position of the live picture and the interactive information, the picture switching is to switch the current live picture, and the splicing is to splice multiple pictures. It can be understood that the original director is usually placed on the PC end (computer end) and needs to be operated by a dedicated person. The present application displays the director on the AR glasses, and the AR glasses provide a live operation interface, which can directly control the live picture, including position adjustment, zooming in and out, picture switching, splicing and other operations. The AR glasses display effect diagram after superimposing the live operation interface is shown in Figure 3 , Figure 3 The AR glasses display effect diagram provided by the embodiment of the present application is shown in Figure 3 It can be seen that the entire picture can include a live picture, a barrage message (interactive message), a real-time parameter and a director console (live operation interface). The embodiment improves the efficiency of adjusting the live picture.

[0055] S102, display the live picture and the interactive information at the target position; wherein the target position is a set region in front of the AR glasses determined based on the position of the AR glasses.

[0056] The target position in the embodiment is in front of the glasses. The reason for setting it in front of the AR glasses is that the eyes can directly watch through the AR glasses. In the embodiment, the AR glasses can accurately determine the set region in front as the target position by combining various sensors and algorithms to display the live picture and the interactive information. The set region in the embodiment is set in a certain region range according to user demand. For example, in front of the AR glasses field of view, a coordinate system is constructed with the AR glasses as the origin, thereby determining four points, which are 1 meter away from the coordinate origin and in the region 1 meter in front of the AR glasses.

[0057] It should be noted that in order to improve the accuracy of target position determination, the above-mentioned display of live picture and interactive information at target position can include: acquiring the spatial position of AR glasses in real time, constructing a coordinate system based on the spatial position, determining a target distance from the AR glasses based on the coordinate system, and displaying the live picture and interactive information in a regular area based on the coordinate system. The embodiment does not limit the specific regular area, and the regular area in the embodiment can be a rectangle; or the regular area in the embodiment can also be a square. In the embodiment, the target position is a regular area, and the regular area will move with the movement of the AR glasses, so that the user can also accurately obtain the live picture and interactive information during the movement, and the user experience is improved. The specific steps can include: acquiring the spatial position. Using SLAM algorithm: through SLAM (Simultaneous Localization and Mapping) algorithm, the spatial position and direction of AR glasses are acquired in real time. The SLAM algorithm can eliminate cumulative error and construct a motion trajectory. Three-dimensional reconstruction: according to the motion trajectory obtained by the SLAM algorithm, three-dimensional reconstruction is performed to construct a three-dimensional real world corresponding to the real world. Constructing a coordinate system and determining a reference point: selecting a fixed reference point in front of the field of view of the AR glasses as the origin of the constructed coordinate system. Establish a virtual coordinate system: taking the reference point as the origin, a virtual three-dimensional coordinate system is established for determining the display position of the live picture and interactive information. Determine the regular area and set the display area: based on the virtual coordinate system, define a regular area as the display area of the live picture and interactive information. The size and shape of this area can be adjusted according to actual needs. Consider the user's perspective: ensure that the display area is within the comfortable range of the user's field of view, avoid being too close or too far from the user, and affect the viewing experience. Display live picture and interactive information. Superimpose virtual information: use AR technology to superimpose live picture and interactive information into the display area of the real world. Optimize display effect: in order to ensure that the user can comfortably watch the live picture and interactive information, it is necessary to optimize the virtual display interface. For example, the size, position and transparency of the interface can be adjusted to make it more natural to integrate with the real world. Real-time update and adjustment.

[0058] Tracking user movement: as the user moves or the environment changes dynamically, the system will continuously track and update the spatial position of the AR glasses in real time to ensure accurate superposition of virtual information and real environment. In summary, through the above steps, the live picture and interactive information can be displayed in the set area at a target distance from the AR glasses.

[0059] It should be further noted that based on any of the above embodiments, after displaying the live picture and the interactive information at the target position, the method can further include: acquiring surrounding environment information in real time; wherein the surrounding environment information includes at least one of light, color and object; and rendering the live picture and the interactive information at the target position based on the surrounding environment information to obtain a rendered live picture and interactive information; wherein the rendering content includes at least one of picture definition, font size and augmented reality content. It can be understood that this embodiment acquires the surrounding environment information in real time. For example, light perception: through a camera and a sensor, the light conditions of the environment are monitored in real time, including brightness, color temperature and light source position. These data help to adjust the brightness and contrast of the live picture to ensure that the user obtains the best visual experience. Color recognition: using image recognition technology, the dominant color and color distribution in the environment are analyzed. This can help to apply appropriate filters and color enhancement effects in the live picture, making the picture more lively and attractive. Object detection: through computer vision algorithms, key objects in the environment are identified and tracked, such as furniture, decorations, etc. These information can be used to add virtual elements or annotations in the live picture, increasing interactivity and interest. Data processing speed: edge computing technology can quickly process the data collected from the camera and other sensors, reducing data transmission delay and ensuring the real-time nature of the live picture. Rendering content optimization includes picture definition adjustment: according to the light and color information of the environment, the resolution and definition of the live picture are automatically adjusted to ensure a high-quality visual experience in different environments. Font size adaptation: considering different viewing distances and screen sizes, the font size and style in the live picture are dynamically adjusted to ensure the readability and aesthetics of the information. Augmented reality content fusion: combined with the detection results of the environmental objects, augmented reality (AR) elements are integrated into the live picture, such as virtual annotations, interactive effects, etc., to improve the audience's immersion and participation. In summary, by acquiring the surrounding environment information in real time, precise rendering optimization can be achieved in the live picture and interactive information. This not only improves the visual effect and user experience of the live broadcast, but also enhances the interactivity and interest. In the future, with the continuous progress of technology, this intelligent rendering technology based on environmental perception will be widely used in more fields.

[0060] S103, receiving adjustment information sent by the control handle, and adjusting the size of the live picture at the target position to the target size based on the adjustment information.

[0061] The control handle in this embodiment is a device that can send control live picture and interactive information. The adjustment information includes user's request for changing the size of the live picture. For example, the current size is too large and inconvenient to watch, at which time the live picture size can be reduced; or the current size is too small, at which time the live picture size can be increased. The adjustment information in this embodiment can be to select the size increase / decrease button to adjust the size. The adjustment information in this embodiment can be to move the coordinates of the current live picture to a set position. The gyroscope of the control handle in this embodiment will transmit real-time data to the handle CPU and convert it into corresponding position information, which is then sent to the AR glasses through the Bluetooth or star flash module. At the same time, if the buttons on the handle are pressed, the information will also be sent to the receiving module of the AR glasses, i.e. the Bluetooth / star flash module of the AR glasses, through the Bluetooth or star flash module. The USB module of the AR glasses in this embodiment receives the real-time picture and interactive information of the live camera. It directly displays in front of the eyes, and also receives the control information of the handle to make corresponding adjustments to the display of the input picture and interactive information, thereby improving the user's live experience.

[0062] It needs to be further explained that the interactive information can also be controlled based on the control information sent by the control handle. The interactive management method in this embodiment is more convenient. The original interactive information, such as bullet screen, special effects, gifts, etc., needs the host to stop the live rhythm to read and respond on the mobile phone or large screen, while the present application integrates the bullet screen and special effects into the AR glasses, so that these interactive information is directly projected in front of the eyes, and the host can immediately get real-time information and quickly feedback to the audience. The display of interactive information can be controlled by the handle, and the contents of the control include: a) position adjustment, the handle selects the interactive information box through the gyroscope, determines the button and selects it, and drags it to any position, and cancels the selected button. The handle sends this series of operations to the AR glasses to realize the position adjustment of the interactive information. b) information filtering, after the handle moves, the gyroscope position change will be fed back to the AR glasses end, and the handle is moved to the operation interface to check the corresponding content to be displayed, to achieve the effect of displaying specified content. c) other supported operation methods can also be realized. For ease of understanding, please refer to Figure 4 , Figure 4A schematic diagram of control handle control logic is provided for the embodiment of the present application. The left flow chart: the gyroscope is used to obtain position information in real time, which is used for AR glasses to update the cursor position; the key detection is used to detect whether there is a key event, and if there is, the key event is sent to the AR glasses; and the AR glasses determine what operation needs to be performed according to the cursor position and the key event. The "transformed into a position point pair / transformed into a key value" in the step means that the data of the gyroscope will be transformed into a position point pair, and the key event data will be transformed into key value information. The key value can be pressed 1 or released 0. The right flow chart: handle data processing. Check whether the handle data is received. If yes, continue to execute. If no, return to the step of waiting for receiving the handle data. Obtain the gyroscope position data: obtain the position data of the gyroscope. Obtain the handle key value: obtain the key value of the handle. Get the operation position: determine the position of the operation according to the data of the gyroscope and the handle. Get the operation method: determine the method of the operation. Perform the related operation: perform the corresponding operation according to the determined position and method.

[0063] The live picture display method provided by the embodiment of the present application can include: S101, receiving the live picture and interactive information sent by a live machine; S102, displaying the live picture and interactive information at a target position; wherein the target position is a set region in front of the AR glasses determined based on the position of the AR glasses; S103, receiving adjustment information sent by a control handle, and adjusting the size of the live picture at the target position to a target size based on the adjustment information. And the current anchor needs to move the line of sight away from the live picture on the large screen from time to time to watch the barrage for interaction, the efficiency of the live broadcast is low, and the interactive experience of the anchor and the audience is affected, the present application can realize that the anchor broadcasts through the real-time picture and interactive information displayed by the AR glasses, and since the target position and the target size can be adjusted based on the user demand, the user experience is improved.

[0064] In order to make the present application more convenient to understand, please refer to Figure 5 , Figure 5 A flow example diagram of a live picture display method is provided for the embodiment of the present application, which can specifically include:

[0065] S201, the live machine collects real-time live pictures through a camera, receives interactive information sent by a service end, and sends the real-time live pictures and the interactive information to the AR glasses.

[0066] For the convenience of understanding, please refer to Figure 6 , Figure 6 A schematic diagram of a live picture display principle is provided for the embodiment of the present application. As can be seen from Figure 6 , Figure 6The hardware architecture of an augmented reality (AR) live streaming system is demonstrated, which is divided into three main parts, each containing different components and their connections. The AR glasses can receive and transmit data using star flash, WiFi, TYPE-C, etc. Taking TYPE-C connection as an example, the following is an explanation of each part: Upper part: data acquisition and transmission includes 5G / WiFi module: responsible for wireless network connection, providing high-speed data transmission capability. Camera: used to capture raw images. CPU: central processing unit, processing data captured by the camera. TYPE-C interface: for data transmission or charging. The process of this part is: the raw images captured by the camera are processed by the CPU and transmitted to the AR glasses through the TYPE-C interface. Middle part: data processing and display includes: TYPE-C interface: receives data from the upper part. CPU: processes received data. Optical components: used to adjust and optimize images to meet the display requirements of AR glasses. Bluetooth / star flash: wireless communication technology, which may be used for connection with the handle or other devices. Live streaming picture: the final AR live streaming picture. The process of this part is: receiving data through the TYPE-C interface, processing by the CPU, adjusting through the optical components, and then transmitting to the AR glasses through the Bluetooth / star flash technology to form the live streaming picture. Lower part: handle control and feedback includes: Bluetooth / star flash: for wireless connection of the handle. CPU: processes control information of the handle. Keys: physical keys on the handle for user input. Gyroscope: detects the movement and rotation of the handle, providing spatial positioning information. The process of this part is: the handle communicates with the CPU through Bluetooth / star flash, the user inputs control information through the keys and gyroscope, the CPU processes these information and transmits the control information to the live streaming glasses to achieve interaction. The overall process can include: the camera captures raw images, which are transmitted to the CPU through the 5G / WiFi module. The CPU processes image data and transmits it to the AR glasses through the TYPE-C interface. The AR glasses display the live streaming picture through the optical components. The user inputs control information through the handle (keys and gyroscope) and transmits it to the CPU through Bluetooth / star flash. The CPU processes the handle control information and adjusts the live streaming picture or performs related operations. This architecture diagram demonstrates a complete AR live streaming system, from data acquisition, processing to display and user interaction.

[0067] S202, the gyroscope of the control handle transmits real-time data to the handle CPU and converts it into corresponding position information, and sends the position information to the AR glasses and sends the key information on the handle to the AR glasses.

[0068] S203, the AR glasses receive the real-time live streaming picture and interactive information of the live streaming machine and display it in front of the AR glasses, and receive the control information of the handle to adjust the display of the input picture and interactive information accordingly.

[0069] The control information in this embodiment includes gyroscope information and button information.

[0070] S204, the effect of displaying a large screen is simulated through the AR glasses, and the multiple picture information is adjusted to obtain a picture after layout adjustment; Wherein, the picture after layout adjustment includes one of single picture, superimposed method and split screen method.

[0071] The single picture in this embodiment corresponds to the single picture layout described above. The superimposed method in this embodiment corresponds to the picture superimposed layout described above; The split screen method in this embodiment corresponds to the split screen layout described above.

[0072] S205, the AR glasses provide a live broadcast operation interface, and the live broadcast operation interface is used to control the display effect; Wherein, the content of control includes position adjustment, zoom in and out, picture switching and splicing.

[0073] The beneficial effects of the embodiments of the application are as follows: 1. Reduce the cost of live scene building, replace the people or things needed for live broadcast such as large screen and director, provide larger picture field of view and more convenient live broadcast operation mode, and improve the overall portability of the whole live broadcast equipment. 2. Enhance the sense of immersion, AR live broadcast glasses can display the bullet screen and special effects in three-dimensional form in the user's field of view, integrate with the live broadcast content, and create a more realistic immersive experience. 3. With rich visual levels, different visual levels are created by using AR technology, so that the bullet screen and special effects are not mixed with the live broadcast content. 4. Improve the interactivity, users can directly see the real-time feedback of other audiences through AR live broadcast glasses, and increase the immediacy of interaction. 5. Improve space utilization, AR glasses can directly display information in the user's field of view without additional display equipment, suitable for various environments, and the size of the display interface can be zoomed in or out through the handle.

[0074] The live picture display device provided by the embodiments of the application will be introduced below, and the live picture display device described below can be correspondingly referred to the live picture display method described above.

[0075] For details, please refer to Figure 7 , Figure 7 The structure diagram of a live picture display device provided by the embodiments of the application, applied to AR glasses, can include:

[0076] The receiving module 100 is used for receiving the live picture and interactive information sent by the live broadcast machine;

[0077] The display module 200 is used for displaying the live picture and the interactive information at the target position; Wherein, the target position is a set region in front of the AR glasses determined based on the position of the AR glasses;

[0078] The adjusting module 300 is configured to receive the adjusting information sent by the control handle, and adjust the size of the live picture at the target position to a target size based on the adjusting information.

[0079] Further, based on any of the above embodiments, the live picture display device can further include:

[0080] A target layout determining module is configured to adjust the layout of the live picture, the interactive information, and a live operation picture to obtain a target layout; the live operation picture is a user interface for displaying and controlling live content; and the target layout is one of a single-picture layout, a picture superimposition layout, and a picture split-screen layout.

[0081] Further, based on any of the above embodiments, the live picture display device can further include:

[0082] A display content adjusting module is configured to adjust the display content of the live picture and the interactive information by using the live operation picture, and the cursor position information and the key information sent by the control handle; the display content includes at least one of position adjustment, zoom-in, zoom-out, picture switching, and splicing; the position adjustment is to adjust the position of the live picture and the interactive information; the picture switching is to switch the current live picture; and the splicing is to splice multiple pictures.

[0083] Further, based on any of the above embodiments, the live picture display device can further include:

[0084] A surrounding environment information determining module is configured to acquire surrounding environment information in real time; the surrounding environment information includes at least one of light, color, and object.

[0085] A picture rendering module is configured to render the live picture and the interactive information at the target position based on the surrounding environment information, to obtain the rendered live picture and interactive information; the rendering content includes at least one of picture definition, font size, and augmented reality content.

[0086] Further, based on any of the above embodiments, the live picture display device can further include:

[0087] A user preference information determining module is configured to analyze the interactive information in real time to obtain user preference information.

[0088] An occurrence module is configured to send the user preference information to a live machine.

[0089] Further, based on any of the above embodiments, the interactive information includes at least one of a barrage, an effect, and a gift.

[0090] It should be noted that the order of the modules and units in the live picture display device described above can be changed without affecting the logic.

[0091] The live picture display device provided by the embodiment of the application can include: a receiving module 100 configured to receive a live picture and interactive information sent by a live machine; a display module 200 configured to display the live picture and the interactive information at a target position; wherein the target position is a set region in front of an AR glasses determined based on a position of the AR glasses; and an adjusting module 300 configured to receive adjustment information sent by a control handle and adjust a size of the live picture at the target position to a target size based on the adjustment information. The current use of the anchor needs to move the line of sight from time to time to look at the live picture on the large screen, and the efficiency of the live broadcast is low, which affects the interactive experience of the anchor and the audience. The application can realize live broadcast of the real-time picture and the interactive information displayed by the AR glasses of the anchor, and the target position and the target size can be adjusted based on the user demand, thereby improving the experience of the user.

[0092] The live picture display system provided by the embodiment of the application will be described below. The live picture display system described below can be correspondingly referred to the live picture display method described above.

[0093] For the convenience of understanding, please refer to Figure 8 , Figure 8 The structure diagram of the live picture display system provided by the embodiment of the application can include:

[0094] The control handle is configured to send control information to the AR glasses.

[0095] The live machine is configured to send the live picture and the interactive information to the AR glasses.

[0096] The AR glasses are configured to execute the steps of the live picture display method.

[0097] For the convenience of understanding, please refer to Figure 9 , Figure 9A structure schematic diagram of a live picture display system based on AR glasses provided by an embodiment of the present application is composed of an AR handle, AR glasses and a live machine. The control handle contains a battery, a gyroscope, a Bluetooth / Star flash, a button and the like. An optical ray can be displayed in the glasses according to the position and angle held by the user, and the user performs button operation on the handle according to the intersection of the optical ray and the picture. There are left and right keys of the mouse, focus zooming, sound size adjustment, split screen control, one-key screen-off, one-key picture switching, one-key AI function start and the like. The handle control data can be transmitted to the AR glasses through the Bluetooth / Star flash module. The AR glasses: binocular display, type-c interface, Bluetooth / Star flash module, power control unit. The AR glasses receive real-time pictures and interactive information from the live machine in a wired manner, and the built-in control interface can realize picture split screen superposition, director control, information filtering and the like through the handle control interface. The pictures obtained will be projected in front of the user at a distance of 1 m. The live machine: integrated camera, shooting the live picture of the host, and performing various optimizations on the shot picture to improve the picture quality, and then encoding and compressing the video. The live machine has wifi, Bluetooth and USB communication capabilities, can push the live picture to the AR glasses, the live platform or the PC end, and supply power to the AR glasses through the USB.

[0098] The electronic device provided by an embodiment of the present application is introduced as follows, and the electronic device described below can be correspondingly referred to the live picture display method described above.

[0099] Please refer to Figure 10 , Figure 10 A structure schematic diagram of a live picture display device provided by an embodiment of the present application can include:

[0100] The memory 10 is used for storing a computer program;

[0101] The processor 20 is used for executing the computer program to realize the live picture display method described above.

[0102] The memory 10, the processor 20 and the communication interface 30 complete the communication among each other through the communication bus 40.

[0103] In the embodiment of the present application, the memory 10 stores one or more programs, and the program can include program code including computer operation instructions. In the embodiment of the present application, the memory 10 can store programs for realizing the following functions:

[0104] Receiving the live picture and interactive information sent by the live machine;

[0105] The live picture and the interactive information are displayed at the target position; wherein the target position is a set region in front of the AR glasses determined based on the position of the AR glasses.

[0106] The adjustment information sent by the control handle is received, and the size of the live picture at the target position is adjusted to the target size based on the adjustment information.

[0107] In a possible implementation, the memory 10 can include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function, etc.; and the data storage area can store data created during use.

[0108] In addition, the memory 10 can include a read-only memory and a random access memory, and provide instructions and data for the processor. A part of the memory can also include an NVRAM. The memory stores an operating system and operation instructions, executable modules or data structures, or a subset of them, or an extended set of them, wherein the operation instructions can include various operation instructions for implementing various operations. The operating system can include various system programs for implementing various basic tasks and processing hardware-based tasks.

[0109] The processor 20 can be a central processing unit (CPU), an application-specific integrated circuit, a digital signal processor, a field programmable gate array or other programmable logic device, and the processor 20 can be a microprocessor or any conventional processor, etc. The processor 20 can invoke a program stored in the memory 10.

[0110] The communication interface 30 can be an interface of a communication module, used for connecting with other devices or systems.

[0111] Of course, it should be noted that, Figure 10 The structures shown do not constitute a limitation on the live picture display device in the embodiments of the present application, and the live picture display device can include more or fewer components than Figure 10 shown, or combine certain components.

[0112] The computer readable storage medium provided by the embodiments of the present application is introduced below, and the computer readable storage medium described below can be mutually referred to the live picture display method described above.

[0113] The present application also provides a computer readable storage medium, the computer readable storage medium has a computer program stored thereon, and the computer program is executed by a processor to implement the steps of the live picture display method described above.

[0114] The computer readable storage medium can include a U disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various media capable of storing program codes.

[0115] The various embodiments are described in a progressive manner in the specification, and each embodiment focuses on the difference from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the device disclosed by the embodiments, since it corresponds to the method disclosed by the embodiments, the description is relatively simple, and the relevant part can be referred to the method part.

[0116] The skilled person can further realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in general terms in the above description. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0117] Finally, it should be noted that, in this document, relationships such as first and second are intended to distinguish one entity or operation from another, and do not necessarily require or imply any actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variant are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device.

[0118] The above provides a detailed introduction to the live picture display method, device, system, equipment and storage medium provided by the present application. The principles and implementation modes of the present application are described by applying specific examples in this document. The above embodiment description is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed; in view of the above, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A method for displaying live streaming footage, characterized in that, Applications in AR glasses include: Receive live video feeds and interactive messages from the live streaming device; The live stream and interactive information are displayed at the target location; wherein, the target location is a designated area in front of the AR glasses, determined based on the position of the AR glasses; Receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to the target size based on the adjustment information; The process includes, after receiving the live stream footage and interactive information from the live streaming device, the following: The layout of the live stream screen, the interactive information, and the live stream operation screen is adjusted to obtain a target layout; wherein, the live stream operation screen is a user interface used to display and control the live stream content; the target layout is one of a single-screen layout, a screen overlay layout, and a screen split-screen layout.

2. The live broadcast display method according to claim 1, characterized in that, After displaying the live stream and the interactive information at the target location, the method further includes: Using the live operation screen and the cursor position information and button information sent by the control handle, the display content of the live screen and the interactive information is adjusted; wherein, the display content includes at least one of position adjustment, zooming in, zooming out, screen switching and splicing; the position adjustment is to adjust the position of the live screen and the interactive information, the screen switching is to switch the current live screen; the splicing is to splice multiple screens together.

3. The live broadcast display method according to any one of claims 1 to 2, characterized in that, After displaying the live stream and the interactive information at the target location, the method further includes: Real-time acquisition of surrounding environmental information; wherein, the surrounding environmental information includes at least one of light, color, and objects; Based on the surrounding environment information, the live stream and interactive information at the target location are rendered to obtain the rendered live stream and interactive information; wherein, the rendered content includes at least one of image clarity, font size, and augmented reality content.

4. The live broadcast display method according to claim 1, characterized in that, After receiving the live stream and interactive information from the live streaming device, it also includes: Real-time analysis of interactive information yields user preference information; The user preference information is sent to the live streaming machine.

5. The live broadcast display method according to claim 1, characterized in that, The interactive information includes at least one of bullet comments, special effects, and gifts.

6. A live streaming display device, characterized in that, Applications in AR glasses include: The receiving module is used to receive live video feeds and interactive information sent by the live streaming device; The display module is used to display the live broadcast and the interactive information at a target location; wherein, the target location is a set area in front of the AR glasses, determined based on the position of the AR glasses; An adjustment module is used to receive adjustment information sent by a control handle and adjust the size of the live broadcast screen at the target position to the target size based on the adjustment information; The target layout determination module is used to adjust the layout of the live broadcast screen, the interactive information, and the live operation screen to obtain a target layout; wherein, the live operation screen is a user interface used to display and control the live broadcast content; the target layout is one of a single-screen layout, a screen overlay layout, and a screen split layout.

7. A live streaming display system, characterized in that, include: Control handles are used to send control information to AR glasses; A live streaming device is used to send live video feeds and interactive information to AR glasses; AR glasses for performing the live broadcast display method according to any one of claims 1 to 5.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the live broadcast display method as described in any one of claims 1 to 5.

9. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the steps of the live broadcast display method as described in any one of claims 1 to 5.

Images