Live broadcast picture display method, apparatus and device, and readable storage medium

Abstract

The invention discloses a live broadcast picture display method, device, system and equipment and a storage medium, which are applied to the technical field of computers and AR glasses, and comprises the following steps: receiving a live broadcast picture and interaction information sent by a live broadcast machine; displaying the live broadcast picture and the interaction information at the target position; the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; and receiving adjustment information sent by the control handle, and adjusting the size of the live broadcast picture at the target position to the target size based on the adjustment information. Compared with the situation that the interaction efficiency is low and the user experience is affected due to the fact that the current anchor needs to move the sight to watch the live broadcast picture on a large screen for interaction, the live broadcast picture and the interaction information can be displayed in front of the user through the AR glasses, the sight does not need to be moved, and the user experience is improved. And the target position and the target size can be adjusted based on user requirements, so that the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a live screen display method, device, equipment and readable storage medium. Background Art

[0002] Traditional live broadcasting requires a director to perform directing operations while watching the live images. The host needs to look away from time to time to watch the live images on the big screen and interact with the comments, which makes the live broadcasting inefficient and affects the interactive experience between the host and the audience.

[0003] Therefore, how to improve the efficiency of live broadcasting and enhance the user experience is a technical problem that technical personnel in this field urgently need to solve. Summary of the invention

[0004] In view of this, an object of the present invention is to provide a live broadcast screen display method, device, equipment and readable storage medium, which solves the technical problem of low live broadcast efficiency in the prior art.

[0005] In order to solve the above technical problems, the present invention provides a method for displaying a live broadcast image, comprising:

[0006] Receive live images and interactive information sent by the live broadcast machine;

[0007] Displaying the live broadcast screen and the interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses;

[0008] Receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to a target size based on the adjustment information.

[0009] Optionally, after receiving the live broadcast image and interactive information sent by the live broadcast machine, the method further includes:

[0010] The layout of the live broadcast screen, the interactive information and the live broadcast operation screen is adjusted to obtain a target layout; wherein the live broadcast operation screen is a user interface for displaying and controlling live broadcast content; the target layout is one of a single-screen layout, a screen overlay layout and a screen split-screen layout.

[0011] Optionally, after displaying the live broadcast screen and the interactive information at the target location, the method further includes:

[0012] The live broadcast operation screen, as well as the cursor position information and button information sent by the control handle are used to adjust the display content of the live broadcast screen and the interactive information; wherein the display content includes at least one of position adjustment, zooming in, zooming out, screen switching and splicing; the position adjustment is to adjust the position of the live broadcast screen and the interactive information, the screen switching is to switch the current live broadcast screen; the splicing is to splice multiple screens.

[0013] Optionally, after displaying the live broadcast screen and the interactive information at the target location, the method further includes:

[0014] Acquire surrounding environment information in real time; wherein the surrounding environment information includes at least one of light, color and object;

[0015] Based on the surrounding environment information, the live broadcast picture and the interactive information at the target location are rendered to obtain the rendered live broadcast picture and the interactive information; wherein the rendering content includes at least one of picture clarity, font size, and augmented reality content.

[0016] Optionally, after receiving the live broadcast screen and interactive information sent by the live broadcast machine, it also includes:

[0017] Analyze interactive information in real time to obtain user preference information;

[0018] The user preference information is sent to the live broadcast machine.

[0019] Optionally, the interactive information includes at least one of barrage, special effects and gifts.

[0020] The present invention also provides a live screen display device, which is applied to AR glasses, comprising:

[0021] A receiving module, used to receive the live broadcast screen and interactive information sent by the live broadcast machine;

[0022] A display module, used to display the live broadcast screen and the interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses;

[0023] The adjustment module is used to receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to a target size based on the adjustment information.

[0024] The present invention also provides a live screen display system, comprising:

[0025] A control handle, used to send control information to the AR glasses;

[0026] Live broadcast machine, used to send live broadcast images and interactive information to AR glasses;

[0027] AR glasses are used to execute the above-mentioned live screen display method.

[0028] The present invention also provides an electronic device comprising:

[0029] Memory for storing computer programs;

[0030] A processor is used to execute the computer program to implement the steps of the live screen display method as described above.

[0031] The present invention also provides a readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the live screen display method as described above are implemented.

[0032] The present invention also provides a computer program product, including a computer program / instruction, which implements the steps of the above-mentioned live screen display method when executed by a processor.

[0033] It can be seen that the present invention receives the live broadcast picture and interactive information sent by the live broadcast machine; displays the live broadcast picture and interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; receives the adjustment information sent by the control handle, and adjusts the size of the live broadcast picture at the target position to the target size based on the adjustment information.

[0034] The beneficial effects of the present invention are as follows: unlike the current situation where the host needs to look away from time to time to watch the live broadcast on the big screen and interact with the barrage, the efficiency of live broadcast interaction is low, which affects the interactive experience between the host and the audience. The present invention can enable the host to broadcast live through the real-time images and interactive information displayed by AR glasses, thereby improving the live broadcast efficiency. In addition, since the target position and target size can be adjusted based on user needs, the user experience is improved.

[0035] In addition, the present invention also provides a live screen display device, system, equipment and storage medium, which also have the above-mentioned beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0037] Figure 1 A flowchart of a live screen display method provided by an embodiment of the present invention;

[0038] Figure 2 A schematic diagram of a target layout provided by an embodiment of the present invention;

[0039] Figure 3 An AR glasses display effect diagram provided by an embodiment of the present invention;

[0040] Figure 4 A schematic diagram of a control handle control logic provided by an embodiment of the present invention;

[0041] Figure 5 A flowchart of a method for displaying a live video stream provided by an embodiment of the present invention;

[0042] Figure 6 A schematic diagram of a live screen display principle provided by an embodiment of the present invention;

[0043] Figure 7 A schematic diagram of the structure of a live screen display device provided by an embodiment of the present invention;

[0044] Figure 8 A schematic diagram of the structure of a live screen display system provided by an embodiment of the present invention;

[0045] Fig. 9 A schematic diagram of the structure of a live screen display system based on AR glasses provided in an embodiment of the present invention;

[0046] Fig.10 A schematic structural diagram of a live screen display device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] Ordinary live broadcast scenes require shooting cameras, streaming laptops, and interactive large-size screens, which are relatively large in size and weight. In addition, the construction of outdoor live broadcast scenes is very time-consuming and labor-intensive. The present invention combines AR (Augmented Reality) glasses and a live broadcast machine with powerful computing power and 5G network, using smaller products to meet the needs of anchors for more convenient operation.

[0049] Traditional live broadcast scenes require a director to perform directing operations while watching the real-time images. The host needs to look away from time to time to watch the live images on the big screen and interact with the barrage. The interaction is inefficient, affecting the interactive experience between the host and the audience. The present invention allows the host to perform directing operations through the control handle through the real-time images displayed by AR glasses, and can also interact with the audience through the live images displayed by AR glasses. The comprehensive advantages are obvious.

[0050] Please refer to Figure 1 , Figure 1 A flowchart of a live screen display method provided by an embodiment of the present invention. Applied to AR glasses, the method may include:

[0051] S101, receiving the live broadcast image and interactive information sent by the live broadcast machine.

[0052] The execution subject of this embodiment is AR glasses. AR glasses, full name is augmented reality glasses, which is a display device using augmented reality technology (Augmented Reality, referred to as AR). The live screen in this embodiment refers to the video content recorded in real time by a video capture device and transmitted to the audience during the live broadcast process. The interactive information during the live broadcast in this embodiment refers to the real-time communication and feedback between the audience and the anchor during the live broadcast process. These interactive information can take many forms, including but not limited to: chat and comments, expressions and gifts, bullet screens, likes, sharing, games and challenges. This embodiment can also receive the director screen sent by the live broadcast machine. The director screen refers to the screen processed and switched by the director station, which may include multiple camera perspectives, graphic overlays and special effects. The live broadcast screen in this embodiment is a real-time screen. AR glasses can display real-time screens, director screens and interactive information at the same time. One person can easily complete the live broadcast and director operations. The screen played by the live broadcast platform can read the bullet screen content and interact with the audience while paying attention to the lens. As the provider of the display screen, the live broadcast machine in this embodiment will collect external real-time screens through the camera, and receive interactive information sent by the server through the 5G / wifi module. Interactive information includes bullet comments, special effects, gifts, etc. The interactive information is sent to the AR glasses.

[0053] It should be further explained that, based on any of the above embodiments, after receiving the live screen and interactive information sent by the live broadcast machine, it can also include: adjusting the layout of the live screen, interactive information and live operation screen to obtain the target layout; wherein the live operation screen is a user interface for displaying and controlling the live content; the target layout is one of a single screen layout, a screen overlay layout and a screen split screen layout. It can be understood that the USB module of the AR glasses receives the real-time live screen and interactive information of the live camera (live broadcast machine). It is directly displayed in front of the eyes, and the control information of the handle is also received to make corresponding adjustments to the display of the input screen and interactive information, thereby improving the user's live broadcast experience. AR glasses have a large field of view and are easy to wear, so that the entire live broadcast scene can simulate the effect of displaying a large screen without a physical screen. After the AR glasses replace the physical screen, the screen presented in front of the anchor is not limited by the screen size and can be more diversified. It is specifically reflected in the following aspects: 1. The screen can be combined in more ways without affecting the size of the screen. The original physical large screen has a fixed screen size. If multiple screens need to be displayed, each screen will become smaller, affecting the user's viewing experience. Using a larger screen will increase the cost. However, the overall field of view of AR glasses is very large, and the distance at which the screen is presented in front of the eyes can be adjusted as needed, so that more content can be placed on the whole, and more layouts can be made for the integration of live screens, such as Figure 2 As shown, Figure 2 A schematic diagram of a target layout provided for an embodiment of the present invention: a) Single-screen layout, the screen is more streamlined, and the live screens can be switched by using the left and right keys. The displayed screen is larger, and the content of the current screen can be seen more clearly. The host can adjust the live broadcast mode in time according to the displayed information. b) Screen overlay layout, the live screen and the corresponding operation interface are superimposed and displayed, more content is displayed in front of you, the operation is more convenient, and the operation results can be seen immediately. c) Screen split-screen layout, each live screen is split-screen, all content can be displayed in front of you, and the layout is separated, and the operation is more accurate and clear. The above three methods are only examples, and the specific implementation method can be flexibly adjusted as needed. In theory, any combination of any screen content can be displayed.

[0054] It should be further explained that, based on any of the above embodiments, after the live broadcast screen and interactive information are displayed at the target position, it may also include: using the live broadcast operation screen, as well as the cursor position information and button information sent by the control handle to adjust the display content of the live broadcast screen and interactive information; wherein the display content includes at least one of position adjustment, zooming in, zooming out, screen switching and splicing; position adjustment is to adjust the position of the live broadcast screen and interactive information, screen switching is to switch the current live broadcast screen; splicing is to splice multiple screens. It is understandable that the original director is usually placed on the PC side (computer side) and requires special personnel to operate. The present invention puts the director on the AR glasses. The AR glasses provide a live broadcast operation interface, which can directly control the live broadcast screen, including position adjustment, zooming in and out, screen switching, splicing and other operations. The display effect diagram of the AR glasses after superimposing the live broadcast operation interface is as follows Figure 3 As shown, Figure 3 An AR glasses display effect diagram provided by an embodiment of the present invention, from Figure 3 It can be seen that the entire screen may include the live screen, bullet screen messages (interactive messages), real-time parameters and the director console (live operation interface). This embodiment improves the efficiency of adjusting the live screen.

[0055] S102, displaying the live broadcast image and interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses.

[0056] The target position in this embodiment is the front of the glasses. The reason why it is set to the front of the AR glasses is that the eyes can directly view through the AR glasses. In this embodiment, the AR glasses can accurately determine the set area in front as the target position through a combination of multiple sensors and algorithms to display live images and interactive information. The set area in this embodiment is set within a certain area according to user needs. For example, in front of the field of view of the AR glasses, with the AR glasses as the origin, a coordinate system is constructed to determine four points. These four points are 1 meter away from the coordinate origin and are in the area 1 meter in front of the AR glasses.

[0057] It should be noted that, in order to improve the accuracy of the target position determination, the above-mentioned display of the live screen and interactive information at the target position may include: obtaining the spatial position of the AR glasses in real time, constructing a coordinate system based on the spatial position, determining the target distance from the AR glasses based on the coordinate system, and determining a regular area based on the coordinate system, and displaying the live screen and interactive information in the regular area. This embodiment does not limit the specific regular area. The regular area in this embodiment may be a rectangle; or the regular area in this embodiment may also be a square. In this embodiment, the target position is a regular area, and the regular area moves with the movement of the AR glasses, so that the user can also accurately obtain the live screen and interactive information during the movement, thereby improving the user experience. The specific steps may include: obtaining the spatial position. Using the SLAM algorithm: obtaining the spatial position and direction of the AR glasses in real time through the SLAM (Simultaneous Localization and Mapping) algorithm. The SLAM algorithm can eliminate cumulative errors and construct a motion trajectory. Three-dimensional reconstruction: performing three-dimensional reconstruction according to the motion trajectory obtained by the SLAM algorithm to construct a three-dimensional real world corresponding to the real world. Constructing a coordinate system and determining a reference point: selecting a fixed reference point in front of the field of view of the AR glasses as the origin of the constructed coordinate system. Establish a virtual coordinate system: With the reference point as the origin, establish a virtual three-dimensional coordinate system to determine the display position of the live screen and interactive information. Determine the regular area and set the display area: Based on the virtual coordinate system, define a regular area as the display area for the live screen and interactive information. The size and shape of this area can be adjusted according to actual needs. Consider the user's perspective: Ensure that the display area is within the comfortable range of the user's field of view, and avoid being too close or far away from the user, which affects the viewing experience. Display live screens and interactive information. Overlay virtual information: Use AR technology to overlay live screens and interactive information into the display area of ​​the real world. Optimize display effects: In order to ensure that users can watch live screens and interactive information comfortably, the virtual display interface needs to be optimized. For example, the size, position, and transparency of the interface can be adjusted to make it more naturally integrated with the real world. Update and adjust in real time.

[0058] Tracking user movement: As the user moves or the environment changes dynamically, the system will continue to track and update the spatial position of the AR glasses in real time to ensure accurate superposition of virtual information with the real environment. In general, through the above steps, the live broadcast screen and interactive information can be displayed in a set area at a target distance from the AR glasses.

[0059] It should be further explained that, based on any of the above embodiments, after the live screen and interactive information are displayed at the target location, it may also include: obtaining the surrounding environment information in real time; wherein the surrounding environment information includes at least one of light, color and object; based on the surrounding environment information, the live screen and interactive information at the target location are rendered to obtain the rendered live screen and interactive information; wherein the rendering content includes at least one of picture clarity, font size, and augmented reality content. It can be understood that this embodiment obtains the surrounding environment information in real time. For example, light perception: through cameras and sensors, the lighting conditions of the environment, including brightness, color temperature and light source position, are monitored in real time. These data help adjust the brightness and contrast of the live screen to ensure that users get the best visual experience. Color recognition: using image recognition technology to analyze the main color and color distribution in the environment. This can help apply appropriate filters and color enhancement effects in the live screen to make the picture more vivid and attractive. Object detection: through computer vision algorithms, key objects in the environment, such as furniture, decorations, etc., are identified and tracked. This information can be used to add virtual elements or annotations to the live screen to increase interactivity and fun. Data processing speed: Edge computing technology can quickly process data collected from cameras and other sensors, reduce data transmission delays, and ensure the real-time nature of live broadcast images. Rendering content optimization includes picture clarity adjustment: According to the ambient light and color information, the resolution and clarity of the live broadcast image are automatically adjusted to ensure high-quality visual experience in different environments. Font size adaptation: Taking into account different viewing distances and screen sizes, the font size and style in the live broadcast are dynamically adjusted to ensure the readability and aesthetics of the information. Augmented reality content integration: Combined with the detection results of environmental objects, augmented reality (AR) elements are integrated into the live broadcast image, such as virtual annotations, interactive special effects, etc., to enhance the audience's immersion and participation. In general, by obtaining surrounding environmental information in real time, accurate rendering optimization can be achieved in live broadcast images and interactive information. This not only improves the visual effects and user experience of live broadcasts, but also enhances interactivity and fun. In the future, with the continuous advancement of technology, this intelligent rendering technology based on environmental perception will be widely used in more fields.

[0060] S103, receiving adjustment information sent by the control handle, and adjusting the size of the live broadcast image at the target position to a target size based on the adjustment information.

[0061] The control handle in this embodiment is a device that can send control live screen and interactive information. The adjustment information includes the user's request to change the size of the live screen. For example, if the current size is too large to be viewed, the live screen size can be reduced; or if the current size is too small, the live screen size can be increased. The adjustment information in this embodiment can be to select the size increase / decrease button to adjust the size. The adjustment information in this embodiment can be to move the coordinates of the current live screen to a set position. The gyroscope of the control handle in this embodiment transmits real-time data to the handle CPU, converts it into corresponding position information, and then sends it to the AR glasses via Bluetooth or the star flash module. At the same time, if the button on the handle is pressed, its information will also be sent to the receiving module of the AR glasses, that is, the Bluetooth / star flash module of the AR glasses, via Bluetooth or the star flash module. The USB module of the AR glasses in this embodiment receives the real-time picture and interactive information of the live camera. It is displayed directly in front of the eyes, and the control information of the handle is also received to make corresponding adjustments to the display of the input picture and interactive information, thereby improving the user's live experience.

[0062] It should be further explained that the interactive information can also be controlled based on the control information sent by the control handle. The interactive management method in this embodiment is more convenient. The original interactive information, such as barrage, special effects, gifts, etc., all require the host to stop the live broadcast rhythm and go to the mobile phone or large screen to read and respond. The present invention integrates barrage special effects into AR glasses, so that these interactive information can be projected directly in front of the eyes. The host can immediately obtain real-time information and quickly feedback to the audience. The display of interactive information can be controlled by the handle, and the control content includes: a) Position adjustment, the handle selects the interactive information box through the gyroscope, confirms the button and selects it, and drags it to any position, and cancels the selection of the button. The handle sends this series of operations to the AR glasses to adjust the position of the interactive information. b) Information filtering, after determining that the handle moves, the gyroscope position changes, which will be fed back to the AR glasses end, and the handle moves to the operation interface to check the corresponding content to be displayed, so as to achieve the effect of displaying the specified content. c) Various other supported operation methods can also be implemented. For ease of understanding, please refer to Figure 4 , Figure 4A schematic diagram of a control handle control logic provided by an embodiment of the present invention. Left flow chart: The gyroscope is used to obtain position information in real time, which is used for AR glasses to update the cursor position; the key detection is used to detect whether there is a key event, and if so, the key event is sent to the AR glasses; and the AR glasses determine what operation needs to be performed currently based on the cursor position and the key event. The "convert to position point pair / convert to key value" in the step means that the gyroscope data will be converted into position point pairs, and the key event data will be converted into key value information. The key value can be 1 for pressing or 0 for releasing. Right flow chart: Handle data processing. Check whether the handle data is received. If yes, continue to execute. If not, return to the step of waiting for receiving handle data. Get gyroscope position data: Get the gyroscope position data. Get handle key value: Get the handle key value. Get operation position: Determine the operation position based on the data of the gyroscope and the handle. Get operation method: Determine the operation method. Perform related operations: Perform corresponding operations based on the determined position and method.

[0063] The live screen display method provided by the embodiment of the present invention may include: S101, receiving the live screen and interactive information sent by the live broadcast machine; S102, displaying the live screen and interactive information at the target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; S103, receiving adjustment information sent by the control handle, and adjusting the size of the live screen at the target position to the target size based on the adjustment information. Compared with the current situation where the anchor needs to look away from time to time to watch the live screen on the big screen and watch the barrage to interact, the efficiency of live broadcast is low, which affects the interactive experience of the anchor and the audience. The present invention can enable the anchor to broadcast live through the real-time screen and interactive information displayed by AR glasses, and because the target position and target size can be adjusted based on user needs, the user experience is improved.

[0064] In order to make the present invention easier to understand, please refer to Figure 5 , Figure 5 A flowchart of a method for displaying a live screen provided by an embodiment of the present invention may specifically include:

[0065] S201, the live broadcast machine collects real-time live images through the camera, receives interactive information sent by the server, and sends the real-time live images and interactive information to the AR glasses.

[0066] For easier understanding, please refer to Figure 6 , Figure 6 A schematic diagram of a live screen display principle provided by an embodiment of the present invention. Figure 6 It can be seen that Figure 6The hardware architecture of an augmented reality (AR) live broadcast system is shown, which is divided into three main parts, each of which contains different components and the connection methods between them. AR glasses can send and receive data using Star Flash, wifi (wireless network), TYPE-C (Type C interface), etc. Taking TYPE-C connection as an example, the following is an explanation of each part: Upper part: Data acquisition and transmission including 5G / WiFi module: responsible for wireless network connection, providing high-speed data transmission capability. Camera: used to capture raw images. CPU: central processing unit, processing data captured by the camera. TYPE-C interface: used for data transmission or charging. The process of this part is: the raw image captured by the camera is processed by the CPU and transmitted to the AR glasses through the TYPE-C interface. Middle part: Data processing and display including: TYPE-C interface: receiving data from the upper part. CPU: processing the received data. Optical components: used to adjust and optimize the image to meet the display requirements of AR glasses. Bluetooth / Star Flash: wireless communication technology, which may be used for the connection of handles or other devices. Live screen: the final AR live screen. The process of this part is: receive data through the TYPE-C interface, adjust it through the optical components after CPU processing, and then transmit it to AR glasses through Bluetooth / Star Flash technology to form a live broadcast picture. Lower part: handle control and feedback include: Bluetooth / Star Flash: used for wireless connection of the handle. CPU: process the control information of the handle. Button: physical button on the handle for user input. Gyroscope: detect the movement and rotation of the handle and provide spatial positioning information. The process of this part is: the handle communicates with the CPU through Bluetooth / Star Flash, the user inputs control information through buttons and gyroscopes, and after the CPU processes this information, it transmits the control information to the live broadcast glasses to achieve interaction. The overall process may include: the camera captures the original image and transmits it to the CPU through the 5G / WiFi module. The CPU processes the image data and transmits it to the AR glasses through the TYPE-C interface. The AR glasses display the live broadcast picture through optical components. The user inputs control information through the handle (buttons and gyroscope) and transmits it to the CPU through Bluetooth / Star Flash. The CPU processes the handle control information and adjusts the live broadcast picture or performs related operations. This architecture diagram shows a complete AR live broadcast system, from data collection and processing to display and user interaction.

[0067] S202, the gyroscope of the control handle transmits real-time data to the handle CPU and converts it into corresponding position information, sends the position information to the AR glasses, and sends the button information on the handle to the AR glasses.

[0068] S203, the AR glasses receive the real-time live broadcast image and interactive information from the live broadcast machine and display them in front of the AR glasses, and at the same time receive the control information of the handle to make corresponding adjustments to the display of the input image and interactive information.

[0069] The control information in this embodiment includes gyroscope information and key information.

[0070] S204, using AR glasses to simulate the effect of displaying a large screen, and adjusting multiple screen information to obtain a screen with an adjusted layout; wherein the screen with an adjusted layout includes a single screen, an overlay mode, and a split screen mode.

[0071] The single screen in this embodiment corresponds to the single screen layout described above. The superposition method in this embodiment corresponds to the screen superposition layout described above; and the split screen mode in this embodiment corresponds to the split screen layout described above.

[0072] S205. The AR glasses provide a live broadcast operation interface, and the live broadcast operation interface is used to control the display effect; wherein the control content includes position adjustment, zooming in and out, screen switching and splicing.

[0073] The beneficial effects of the embodiments of the present invention are: 1. It reduces the cost of setting up the live broadcast scene and replaces the large screen, director and other people or objects required for live broadcast. It provides a larger field of view and a more convenient live broadcast operation method, which improves the overall portability of the whole set of live broadcast equipment. 2. Enhance the sense of immersion. AR live broadcast glasses can display barrage and special effects in the user's field of view in three dimensions, and integrate them with the live broadcast content to create a more realistic immersive experience. 3. It has rich visual levels and uses AR technology to create different visual levels so that barrage and special effects will not be mixed with the live broadcast content. 4. Improve interactivity. Users can directly see the real-time feedback of other viewers through AR live broadcast glasses, which increases the immediacy of interaction. 5. Improve space utilization. No additional display equipment is required. AR glasses can display information directly in the user's field of view. It is suitable for various environments, and the size of the display interface can also be scaled by the handle.

[0074] The following is an introduction to a live screen display device provided by an embodiment of the present invention. The live screen display device described below and the live screen display method described above can be referenced to each other.

[0075] Please refer to Figure 7 , Figure 7 A schematic diagram of the structure of a live screen display device provided by an embodiment of the present invention, which is applied to AR glasses, may include:

[0076] The receiving module 100 is used to receive the live broadcast screen and interactive information sent by the live broadcast machine;

[0077] A display module 200, configured to display the live broadcast screen and the interactive information at a target location; wherein the target location is a set area in front of the AR glasses determined based on the location of the AR glasses;

[0078] The adjustment module 300 is used to receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to a target size based on the adjustment information.

[0079] Further, based on any of the above embodiments, the above live screen display device may further include:

[0080] The target layout determination module is used to adjust the layout of the live broadcast screen, the interactive information and the live broadcast operation screen to obtain a target layout; wherein the live broadcast operation screen is a user interface for displaying and controlling live broadcast content; the target layout is one of a single-screen layout, a screen overlay layout and a screen split-screen layout.

[0081] Further, based on any of the above embodiments, the above live screen display device may further include:

[0082] A display content adjustment module is used to adjust the display content of the live broadcast screen and the interactive information by using the live broadcast operation screen, as well as the cursor position information and button information sent by the control handle; wherein the display content includes at least one of position adjustment, zooming in, zooming out, screen switching and splicing; the position adjustment is to adjust the position of the live broadcast screen and the interactive information, the screen switching is to switch the current live broadcast screen; the splicing is to splice multiple screens.

[0083] Further, based on any of the above embodiments, the above live screen display device may further include:

[0084] A surrounding environment information determination module, used to obtain surrounding environment information in real time; wherein the surrounding environment information includes at least one of light, color and object;

[0085] A picture rendering module is used to render the live picture and the interactive information at the target location based on the surrounding environment information to obtain the rendered live picture and the interactive information; wherein the rendering content includes at least one of picture clarity, font size, and augmented reality content.

[0086] Further, based on any of the above embodiments, the above live screen display device may further include:

[0087] A user preference information determination module, used to analyze interactive information in real time to obtain user preference information;

[0088] A generating module is used to send the user preference information to the live broadcast machine.

[0089] Further, based on any of the above embodiments, the interactive information includes at least one of barrage, special effects and gifts.

[0090] It should be noted that the order of the modules and units in the above-mentioned live screen display device can be changed without affecting the logic.

[0091] The live screen display device provided by the embodiment of the present invention may include: a receiving module 100, for receiving the live screen and interactive information sent by the live broadcast machine; a display module 200, for displaying the live screen and the interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; an adjustment module 300, for receiving adjustment information sent by the control handle, and adjusting the size of the live screen at the target position to a target size based on the adjustment information. The current use of the anchor needs to look away from time to time to watch the live screen on the big screen and watch the barrage to interact, which is inefficient and affects the interactive experience of the anchor and the audience. The present invention can enable the anchor to broadcast live through the real-time screen and interactive information displayed by the AR glasses, and because the target position and target size can be adjusted based on user needs, the user experience is improved.

[0092] A live screen display system provided by an embodiment of the present invention is introduced below. The live screen display system described below and the live screen display method described above can be referred to each other.

[0093] Please refer to Figure 8 , Figure 8 A structural diagram of a live screen display system provided by an embodiment of the present invention may include:

[0094] A control handle, used to send control information to the AR glasses;

[0095] Live broadcast machine, used to send live broadcast images and interactive information to AR glasses;

[0096] AR glasses are used to execute the steps of the above-mentioned live screen display method.

[0097] For easier understanding, please refer to Fig. 9 , Fig. 9A structural schematic diagram of a live screen display system based on AR glasses provided in an embodiment of the present invention, the structure consists of an AR handle, AR glasses and a live broadcast machine. Control handle: The control handle contains a battery, a gyroscope, Bluetooth / star flash, a button, etc. An optical ray can be displayed in the glasses according to the position and angle of the user, and the user can operate the buttons on the handle according to the intersection of the optical ray and the picture. There are left / right buttons of the mouse, focus zooming in and out, sound volume adjustment, split screen control; one-key screen off / one-key screen switching / one-key start and other AI functions. The handle control data can be transmitted to the AR glasses through the Bluetooth / star flash module. AR glasses: binocular display, type-c interface, Bluetooth star flash module, power control unit. AR glasses receive real-time images and interactive information from the live broadcast machine in a wired manner. It has a built-in control interface, which can be controlled by the handle to realize screen split overlay, director control, information filtering and other functions. The acquired picture will be projected 1m in front of the eyes. Live broadcast machine: It integrates a camera to shoot the live broadcast screen of the anchor, and makes various optimizations to the captured screen to improve the image quality, and then encodes and compresses the video. The live broadcast machine has WiFi, Bluetooth and USB communication capabilities, and can push the live broadcast screen to AR glasses, live broadcast platforms or PCs. And it powers the AR glasses through USB.

[0098] An electronic device provided by an embodiment of the present invention is introduced below. The electronic device described below and the live screen display method described above can refer to each other.

[0099] Please refer to Fig.10 , Fig.10 A schematic diagram of the structure of a live screen display device provided by an embodiment of the present invention may include:

[0100] A memory 10, used for storing computer programs;

[0101] The processor 20 is used to execute a computer program to implement the above-mentioned live screen display method.

[0102] The memory 10 , the processor 20 , and the communication interface 30 all communicate with each other via a communication bus 40 .

[0103] In the embodiment of the present invention, the memory 10 is used to store one or more programs, and the program may include program code, and the program code includes computer operation instructions. In the embodiment of the present invention, the memory 10 may store programs for implementing the following functions:

[0104] Receive live images and interactive information sent by the live broadcast machine;

[0105] Displaying the live broadcast screen and interactive information at a target location; wherein the target location is a set area in front of the AR glasses determined based on the position of the AR glasses;

[0106] Receive adjustment information sent by the control handle, and adjust the size of the live broadcast image at the target position to the target size based on the adjustment information.

[0107] In a possible implementation, the memory 10 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function, etc.; the data storage area may store data created during use.

[0108] In addition, the memory 10 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include an NVRAM. The memory stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an extended set thereof, wherein the operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic tasks and processing hardware-based tasks.

[0109] The processor 20 may be a central processing unit (CPU), an application specific integrated circuit, a digital signal processor, a field programmable gate array or other programmable logic device, a microprocessor or any conventional processor, etc. The processor 20 may call a program stored in the memory 10 .

[0110] The communication interface 30 may be an interface of a communication module, and is used to connect to other devices or systems.

[0111] Of course, it should be noted that Fig.10 The structure shown does not constitute a limitation on the live screen display device in the embodiment of the present invention. In actual applications, the live screen display device may include Fig.10 More or fewer components than shown, or combinations of certain components.

[0112] The computer-readable storage medium provided in an embodiment of the present invention is introduced below. The computer-readable storage medium described below and the live screen display method described above can be referenced to each other.

[0113] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned live screen display method are implemented.

[0114] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0115] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0116] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0117] Finally, it should be noted that, in this article, relationships such as first and second, etc. are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variations are intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0118] The live screen display method, device, system, equipment and storage medium provided by the present invention are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for displaying a live broadcast image, characterized in that: Applied to AR glasses, including: Receive live images and interactive information sent by the live broadcast machine; Displaying the live broadcast screen and the interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; Receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to a target size based on the adjustment information.

2. The method for displaying live images according to claim 1, characterized in that: After the live broadcast screen and interactive information sent by the live broadcast machine are received, the method further includes: The layout of the live broadcast screen, the interactive information and the live broadcast operation screen is adjusted to obtain a target layout; wherein the live broadcast operation screen is a user interface for displaying and controlling live broadcast content; and the target layout is one of a single-screen layout, a screen overlay layout and a screen split-screen layout.

3. The method for displaying live images according to claim 2, characterized in that: After displaying the live broadcast screen and the interactive information at the target location, the method further includes: The live broadcast operation screen, as well as the cursor position information and button information sent by the control handle are used to adjust the display content of the live broadcast screen and the interactive information; wherein the display content includes at least one of position adjustment, zooming in, zooming out, screen switching and splicing; the position adjustment is to adjust the position of the live broadcast screen and the interactive information, the screen switching is to switch the current live broadcast screen; the splicing is to splice multiple screens.

4. The method for displaying a live broadcast image according to any one of claims 1 to 3, characterized in that: After displaying the live broadcast screen and the interactive information at the target location, the method further includes: Acquire surrounding environment information in real time; wherein the surrounding environment information includes at least one of light, color and object; Based on the surrounding environment information, the live broadcast picture and the interactive information at the target location are rendered to obtain the rendered live broadcast picture and the interactive information; wherein the rendering content includes at least one of picture clarity, font size, and augmented reality content.

5. The method for displaying live images according to claim 1, characterized in that: After receiving the live broadcast screen and interactive information sent by the live broadcast machine, it also includes: Analyze interactive information in real time to obtain user preference information; The user preference information is sent to the live broadcast machine.

6. The method for displaying live images according to claim 1, characterized in that: The interactive information includes at least one of barrage, special effects and gifts.

7. A live screen display device, characterized in that: Applied to AR glasses, including: A receiving module, used to receive the live broadcast screen and interactive information sent by the live broadcast machine; A display module, used to display the live broadcast screen and the interactive information at a target position; wherein the target position is a set area in front of the AR glasses determined based on the position of the AR glasses; The adjustment module is used to receive adjustment information sent by the control handle, and adjust the size of the live broadcast screen at the target position to a target size based on the adjustment information.

8. A live screen display system, characterized in that: include: A control handle, used to send control information to the AR glasses; Live broadcast machine, used to send live broadcast images and interactive information to AR glasses; AR glasses, used to execute the live screen display method described in any one of claims 1 to 6.

9. An electronic device, characterized in that: include: Memory for storing computer programs; A processor is used to execute the computer program to implement the steps of the live screen display method as described in any one of claims 1 to 6.

10. A storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processor, implements the steps of the live screen display method according to any one of claims 1 to 6.

Images