Competition live broadcast picture presentation method and device, equipment and medium

Abstract

The invention discloses a competition live broadcast picture presentation method and device, equipment and a medium, and belongs to the technical field of augmented reality. The method is executed by a display device supporting an augmented reality (AR) mode, and the method comprises the following steps: running a competition live broadcast client on the display device; in the AR mode, a mixed picture with a real environment as a picture background and at least one three-dimensional competition live broadcast display element as a picture foreground is presented; wherein the real environment comprises the surrounding environment where the display device is located in the real space, and the three-dimensional competition live broadcast display element is a three-dimensional virtual element related to the competition live broadcast content. The method provides a match live broadcast picture applied to a display device supporting an AR mode.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of augmented reality technology, and more particularly to a method, device, equipment and medium for presenting live event images. Background Art

[0002] With the continuous development of augmented reality technology, there is now a trend of using AR (Augmented Reality) devices as office equipment and entertainment equipment.

[0003] In the related technologies, the technology of displaying live sports images on mobile phones, laptops, tablet computers and other terminals has become mature. However, when these technologies are applied to AR devices, the live sports images displayed will not be well matched with the characteristics of AR devices. Summary of the invention

[0004] The present application provides a method, device, equipment and medium for presenting a live broadcast screen of an event, and provides a live broadcast screen of an event applied to a display device supporting an AR mode. The technical solution is as follows:

[0005] According to one aspect of the present application, a method for presenting a live event screen is provided, the method being executed by a display device supporting an AR mode, the method comprising:

[0006] Run the live event client on the display device;

[0007] In AR mode, a mixed picture is presented with a real environment as the picture background and at least one three-dimensional event live broadcast display element as the picture foreground;

[0008] The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional live broadcast display elements are three-dimensional virtual elements related to the live broadcast content.

[0009] According to another aspect of the present application, a device for presenting a live event screen is provided, the device being applied to a display device supporting an AR mode, the device comprising:

[0010] A running module, used to run the live broadcast client of the event on the display device;

[0011] A display module is used to present a mixed picture with a real environment as a picture background and at least one three-dimensional event live broadcast display element as a picture foreground in an AR mode;

[0012] The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional live broadcast display elements are three-dimensional virtual elements related to the live broadcast content.

[0013] According to one aspect of the present application, a display device is provided, comprising: a processor and a memory, wherein the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the method for presenting live event images as described above.

[0014] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is loaded and executed by a processor to implement the method for presenting live event images as described above.

[0015] According to another aspect of the present application, a computer program product or a computer program is provided, wherein the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for presenting a live event screen provided in the above aspect.

[0016] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0017] In AR mode, the display device presents a mixed picture with the real environment as the picture background and the three-dimensional live event display elements as the picture foreground. The present application provides a live event picture applied to a display device supporting AR mode. When watching a live event, users can not only watch the live event content, but also be aware of changes in the surrounding environment (such as the presence of other objects who want to talk to the user), thereby improving the efficiency of users in obtaining information when watching live events.

[0018] In addition, the three-dimensional live broadcast display elements can better integrate the virtual and real environment with the real environment, thereby improving the authenticity of the live broadcast images. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 A schematic diagram showing the principle of a method for presenting a live event screen provided by an exemplary embodiment;

[0021] Figure 2 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment is shown;

[0022] Figure 3A schematic diagram of an initial mixed screen with a real scene as the screen background and a system interface as the screen foreground provided by an exemplary embodiment is shown;

[0023] Figure 4 A flowchart of a method for presenting a live event screen provided by another exemplary embodiment is shown;

[0024] Figure 5 A schematic diagram of a live broadcast screen of an event provided by an exemplary embodiment is shown;

[0025] Figure 6 A flowchart of a method for presenting a live event screen provided by another exemplary embodiment is shown;

[0026] Figure 7 A flowchart of a method for presenting a live event screen provided by another exemplary embodiment is shown;

[0027] Figure 8 A flowchart of a method for presenting a live event screen provided by another exemplary embodiment is shown;

[0028] Fig. 9 A schematic diagram showing a live broadcast screen of an event provided by another exemplary embodiment is shown;

[0029] Fig.10 A schematic diagram showing a live broadcast screen of an event provided by another exemplary embodiment is shown;

[0030] Fig.11 A schematic diagram of a live broadcast screen of an event provided by an exemplary embodiment is shown;

[0031] Fig.12 A flowchart of a method for developing a live event client provided by an exemplary embodiment is shown;

[0032] Fig.13 A structural block diagram of a device for presenting a live event screen provided by an exemplary embodiment is shown;

[0033] Fig.14 A structural block diagram of a head mounted display device provided by an exemplary embodiment is shown. DETAILED DESCRIPTION

[0034] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0035] It should be understood that the "several" mentioned in this article refers to one or more, and "multiple" refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0036] First, the nouns involved in the embodiments of the present application are briefly introduced:

[0037] E-sports events: events held by event organizers for gaming competitions. In this application, e-sports events can be events held for any game. The game can be any of the first-person shooting (FPS) games, third-person shooting (TPS) games, MOBA games, tactical competitive games, and strategy games (Simulation Game, SLG).

[0038] In the game, contestants can control virtual characters in the virtual environment of the game to carry out activities, and the activities of the virtual characters include but are not limited to: adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, and throwing. In principle, the virtual characters are virtual human characters, such as simulated human characters or cartoon human characters.

[0039] In one embodiment, contestants may use game controllers, smartphones, laptops, tablets, notebook computers, desktop computers, wearable devices, smart watches, AR smart devices, VR smart devices, etc. to play in the competition.

[0040] Live broadcast scenario of e-sports events: Set up independent signal acquisition equipment at the e-sports event site to collect audio and video data of e-sports events in real time, and import them into the director end (director device or platform). The director end then publishes the audio and video of the e-sports events collected in real time to the Internet through the network for users to watch. For example, publish it to the client for users to watch. Optionally, the game match data provided by the game server of the e-sports event is also imported into the director end, and the director end uses the method of visualizing the game match data to publish the game match data to the Internet for users to watch.

[0041] Multiplayer Online Battle Arena (MOBA) game: refers to a game in which different virtual teams belonging to at least two hostile camps occupy their own map areas in a virtual environment and compete with a certain victory condition as the goal. The victory condition includes but is not limited to: occupying a stronghold or destroying a stronghold of the hostile camp, killing the virtual character of the hostile camp, ensuring one's own survival in a specified scene and time, grabbing certain resources, and exceeding the score of the opponent within a specified time. At least one of the above. Tactical competition can be carried out in rounds, and the maps of each round of tactical competition can be the same or different. Each virtual team includes one or more virtual characters, such as 1, 2, 3 or 5.

[0042] Game virtual environment: is a virtual environment displayed (or provided) when the game application is running on the terminal. The virtual environment can be a simulation of the real world, a semi-simulation and semi-fictitious environment, or a purely fictitious environment. The game virtual environment can be any one of a two-dimensional virtual environment, a 2.5-dimensional virtual environment, and a three-dimensional virtual environment, which is not limited in the embodiments of the present application.

[0043] Virtual character: refers to at least one movable object controlled by a user (or player) in the game virtual environment. The virtual character can be a virtual person, a virtual animal, an animated character, etc. Optionally, the virtual character is a three-dimensional model created based on animation skeleton technology. Each virtual character has its own shape and volume in the game virtual environment and occupies a part of the space in the game virtual environment.

[0044] Augmented Reality (AR): superimposing virtual elements on the real environment. AR mainly emphasizes serving reality and expanding users' real-life experience.

[0045] Virtual Reality (VR): By creating an environment, users can interact with virtual objects in a virtual environment to enhance the user's immersive experience.

[0046] Mixed Reality (MR): Mixing the real world and virtual objects to create a new visual and interactive environment. The difference between MR and AR is that MR recalculates virtual objects and the real environment and mixes the two to create an interactive environment that is difficult to distinguish between real and fake. AR only superimposes virtual elements on the real environment. The real environment displayed by AR is the real environment viewed from the user's naked eye, while MR is the real environment captured by the camera with a wider field of view.

[0047] Extended Reality (XR): XR is a collection of multiple technologies such as VR / AR / MR. XR is a general term that includes augmented reality (AR), virtual reality (VR), mixed reality (MR) and everything in between. It will even incorporate other body senses rather than being limited to vision.

[0048] Figure 1 A schematic diagram showing the principle of a method for presenting a live event screen provided by an exemplary embodiment of the present application is shown. Figure 1 A user wearing the display device 101 and two screens showing the display device 101 operating in the AR mode are shown. Figure 1 The display device 101 in the figure is a head-mounted display device.

[0049] The display device 101 presents an initial mixed screen 10 with the real environment as the screen background and the system interface as the screen foreground, wherein the real environment includes the surrounding environment of the display device 101 in the real space. Figure 1 A "living room" scene in real space is shown.

[0050] The system interface is provided by the operating system support of the display device 101. The system interface includes multiple client operation controls, which are displayed through icons. The system interface includes an event live broadcast client operation control 102. In response to the operation control 102 receiving a trigger operation, the event live broadcast client is run.

[0051] Figure 1 The live broadcast picture 20 displayed during the operation of the live broadcast client is also shown. The display device 101 presents a mixed picture with the real environment as the picture background and at least one three-dimensional live broadcast display element as the picture foreground.

[0052] Optionally, the event is an e-sports event, in which multiple virtual characters controlled by multiple players will compete in a virtual game environment, and the winner of the competition will be determined as the winner of the e-sports event.

[0053] Optionally, at least one 3D event live broadcast display element includes a 3D virtual sandbox 103. The display device 101 presents the locations of multiple player virtual characters on the 3D virtual sandbox 103, and the 3D virtual sandbox 103 is used to display the overall terrain of the virtual environment of the game. Optionally, the 3D virtual sandbox 103 will be placed on a real object in the real environment. Figure 1 In the live match screen 20 shown, the three-dimensional virtual sandbox 103 is placed on the "coffee table" in the real space.

[0054] In one embodiment, in response to the display device 101 receiving a trigger operation for the first player virtual character, a three-dimensional first virtual screen 104 is newly presented, and the first player virtual character is any one of multiple player virtual characters; the virtual environment picture observed by the first player is presented on the three-dimensional first virtual screen 104, and the first player is the player who controls the first player virtual character.

[0055] In one embodiment, in response to the display device 101 receiving a trigger operation for the three-dimensional virtual sandbox 103, a three-dimensional second virtual screen 105 is newly presented; at least one of the game economic curves and current equipment conditions of multiple player virtual characters is presented on the three-dimensional second virtual screen 105.

[0056] Optionally, at least one 3D live event display element includes a 3D virtual commentary 106. The display device 101 presents the evaluation of the real-time game situation of multiple player virtual characters by the 3D virtual commentary 106, and / or plays the evaluation of the real-time game situation of multiple player virtual characters by the 3D virtual commentary 106.

[0057] In one embodiment, the live broadcast screen 20 also includes a two-dimensional virtual viewing screen 107. The display device 101 presents the two-dimensional virtual viewing screen 107 as the foreground of the live broadcast screen 20. The two-dimensional virtual viewing screen 107 presents a picture of multiple virtual characters of players competing in the virtual environment of the game. Figure 1 The two-dimensional virtual viewing screen 107 shown shows a scene in which multiple virtual characters of players compete against each other in a virtual canyon scene of a MOBA game.

[0058] The above has introduced the live broadcast screen of the event in the AR mode. Optionally, the display device 101 also supports displaying the live broadcast screen of the event in the VR mode.

[0059] Optionally, the display device 101 receives a head-down operation and presents a mode switching control. In response to the mode switching control receiving a trigger operation, the AR mode is switched to the VR mode. In the VR mode, the display device 101 will present a live event scene. In the VR mode, the display device 101 will present an immersive live event scene.

[0060] The live broadcast scene of the event includes at least one of the event base scene, the game scene and the event scene. The event base scene includes at least one of the event organizer's viewing base scene and the event participant's preparation base scene; the game scene is the scene of the virtual game environment where multiple players' virtual characters are located; the event scene includes the live picture of multiple players competing in the game.

[0061] It is understandable that the present application provides a presentation scheme for live event screens applied to display devices that support AR mode. In AR mode, the display device presents a mixed screen with the real environment as the screen background and the three-dimensional live event display elements as the screen foreground. The present application mixes the three-dimensional live event display elements with the real environment to provide a new type of live event screen. When users watch live events, they can not only watch the live content of the events, but also be aware of changes in the surrounding environment at the same time (such as the presence of other objects who want to talk to the user), thereby improving the efficiency of users in obtaining information when watching live events. In addition, the three-dimensional live event display elements can better integrate the virtual and real with the real environment, thereby improving the authenticity of the live event screen.

[0062] In this application, the display device may also be referred to as a spatial computing device, a mixed reality device, an AR device, an extended reality device, etc. The display device is in the form of glasses, helmets, etc. Optionally, the display device includes multiple camera components. When in use, the camera components capture the surrounding environment picture of the real space, and the display device receives the live broadcast display elements of the event sent by the live broadcast server (and / or the event server). Through camera calibration, image detection, image recognition, image fusion and other technologies, according to the depth information of the surrounding environment picture, the live broadcast display elements of the event are mixed with the surrounding environment picture to generate a mixed picture. Optionally, the display device projects the three-dimensional light of the mixed picture into the user's eyes. Optionally, the display device includes at least an internal display screen, the internal display screen is close to the user's eyes, and the display device displays the mixed picture on the internal display screen.

[0063] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the user gestures, eye information, and user voice involved in this application are all obtained with full authorization.

[0064] Moreover, when it comes to relevant information, the relevant information processors will follow the principles of legality, legitimacy and necessity, clarify the purpose, method and scope of relevant information processing, obtain the consent of the relevant information subjects, and take necessary technical and organizational measures to ensure the security of relevant information.

[0065] Figure 2 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment of the present invention is shown. Figure 1 The display device 101 shown is used as an example to illustrate that the display device 101 supports the AR mode. The method includes:

[0066] Step 220, running the live event client on the display device;

[0067] AR mode refers to a display mode that adds virtual elements to the real environment. Optionally, the real environment in AR mode is observed through the user's field of view. Optionally, the real environment in AR mode is observed through a camera component included in or connected to the display device, and the shooting range of the camera component is not less than the user's field of view, so as to achieve better virtual and real fusion.

[0068] A live event client refers to a client that supports live event broadcasting. Optionally, the live event client is a game client. The game client not only provides game functions, but also provides a live event section. The live event section supports the display of live event screens. Optionally, the live event client is a live broadcast client. The live broadcast client provides multiple live broadcast rooms for users to choose to watch, including live event rooms. Optionally, the live event room is an official live broadcast room or a live broadcast room for various anchors to broadcast. Optionally, the live event client is a game assistant client. The game assistant client provides users with game data analysis services, game revelation services, game peripheral information, etc. The game assistant client provides a live event section. The live event section supports the display of live event screens. Optionally, the live event client is a video content platform. The video content platform mainly provides users with long videos, short videos and other services. The video content platform provides channels such as TV series, variety shows, movies, animation, and live broadcasts. The video content platform supports the display of live event screens.

[0069] Optional, events include e-sports events, sports events, and more.

[0070] The display device is in the form of glasses, helmets, etc. Optionally, the display device is a head-mounted display device. Optionally, the display device includes or is connected to multiple camera components, and the camera components are used to capture the real environment of the real space where the display device is located. By splicing the images captured by multiple camera components, a real environment scene observed by the user's naked eye is simulated.

[0071] In one embodiment, the display device presents an initial mixed screen with a real environment as the screen background and a system interface as the screen foreground, and the system interface includes a running control of a live event client; in response to the running control receiving a trigger operation, the live event client is run.

[0072] Optionally, the trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye sight trigger operation. Optionally, the display device is connected to a gesture sensor, and the gesture sensor fits the user's hand. The user only needs to slightly move his finger to correspondingly move the cursor on the initial mixed screen. When the user performs a finger pinch operation (the thumb and index finger are in contact), the running control of the live broadcast client can be confirmed to be selected. Optionally, the display device obtains the user's hand posture through a camera component, the camera component captures the user's hand image, determines the user's hand position through image recognition, and determines the position of the cursor on the initial mixed screen according to the hand position. When the user performs a predetermined gesture action (such as an OK gesture), it indicates confirmation that the running control of the live broadcast client is selected.

[0073] Optionally, the display device receives a voice input by the user and selects a running control of the live event client according to the voice content. Optionally, the display device receives eye posture data of the user and determines to select a running control of the live event client according to the eye posture data, and the eye posture data includes eye position data, eye sight direction, eye stay time, etc.

[0074] Combined with reference Figure 3 , Figure 3 An initial mixed screen 300 is shown, Figure 3 The initial mixed picture shown is a mixed picture obtained by taking the "living room" environment in the real space as the picture background and the system interface as the picture foreground. Figure 3 It is obtained that the system interface includes a running control 301 of the event live broadcast client.

[0075] Step 240: In the AR mode, a mixed picture is presented with a real environment as a picture background and at least one three-dimensional event live broadcast display element as a picture foreground.

[0076] The real environment includes the surrounding environment of the display device in the real space. The real environment includes the surrounding environment of the head-mounted display device in the real space.

[0077] The 3D event live broadcast display elements are 3D virtual elements related to the event live broadcast content. In principle, if the event is an e-sports event, the 3D virtual elements include 3D virtual sandbox, 3D virtual commentary, 3D virtual mascot, 3D player characters, 3D non-player characters, etc. Optionally, if the event is a sports event, the 3D virtual elements include 3D virtual sports equipment, 3D virtual competition venues, 3D virtual commentary, etc.

[0078] In one embodiment, the depth of the 3D live event display element in the mixed picture is determined based on the depth information of the real environment, and then the mixed picture is generated. In an exemplary manner, the depth information of the pixel corresponding to the 3D live event display element is set to be greater than the depth information of the pixel corresponding to the real environment, so as to achieve the effect that the real environment in the mixed picture does not block the 3D live event display element.

[0079] In one embodiment, when there are interactive objects around the display device, the real environment is displayed clearly, and other visual elements other than the real environment in the mixed image are displayed blurred. In an exemplary manner, when there are interactive objects (such as people, dogs, cats, etc.) around the display device, the transparency of other visual elements is increased, or other visual elements are not displayed.

[0080] In one embodiment, when the distance between the interactive object and the display device gradually increases, the real environment is displayed clearly, and other visual elements in the mixed screen except the real environment are displayed blurred; when the distance between the interactive object and the display device gradually decreases, the real environment is displayed blurred, and other visual elements in the mixed screen except the real environment are displayed clearly.

[0081] In an exemplary manner, when the interactive object approaches the user wearing the display device, the transparency of other visual elements is gradually increased, or other visual elements are not displayed. When the interactive object moves away from the user wearing the display device, the transparency of other visual elements is gradually reduced.

[0082] In summary, in AR mode, the display device presents a mixed picture with the real environment as the picture background and the three-dimensional live event display elements as the picture foreground. This application provides a live event picture applied to a display device supporting AR mode. When watching live events, users can not only watch the live event content, but also be aware of changes in the surrounding environment (such as the presence of other objects who want to talk to the user), thereby improving the efficiency of users in obtaining information when watching live events.

[0083] In addition, the three-dimensional live broadcast display elements can better integrate the virtual and real environment with the real environment, thereby improving the authenticity of the live broadcast images.

[0084] based on Figure 2 In the optional embodiment shown, the three-dimensional live event display element includes a three-dimensional virtual sandbox. Figure 4 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment of the present invention is shown. Figure 1 The display device 101 shown is used as an example to illustrate that the method includes:

[0085] Step 420, running the live event client on the display device;

[0086] Live event client refers to a client that supports live event broadcasting.

[0087] In one embodiment, the display device presents an initial mixed screen with the real environment as the screen background and the system interface as the screen foreground, and the system interface includes a running control of the live broadcast client; in response to the running control receiving a trigger operation, the live broadcast client is run. Optionally, the trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye trigger operation.

[0088] Step 440, in the AR mode, presenting a mixed picture with the real environment as the picture background and the three-dimensional virtual sandbox as the picture foreground;

[0089] The three-dimensional virtual sandbox uses a sandbox to indicate the movable space of the virtual characters in the game. There is a two-dimensional map in the game that indicates the movable space of the virtual characters. The three-dimensional virtual sandbox can be understood as a three-dimensional map indicating the movable space of the virtual characters. The three-dimensional virtual sandbox displays the virtual environment of the game in a thumbnail form. The three-dimensional virtual sandbox displays the topography of the virtual environment. Optionally, the three-dimensional virtual sandbox also displays at least one of the resource points (such as neutral creatures, wild monsters, etc.), strongholds (such as defense towers), player virtual characters, and non-player characters in the game.

[0090] In one embodiment, the display device presents a three-dimensional virtual sand table placed on a real object in a real environment. For example, the three-dimensional virtual sand table is placed on a coffee table in a real space.

[0091] Optionally, the display device presents a three-dimensional virtual sand table with a first volume placed on a real object in a real environment; wherein the first volume is adapted to the bearing capacity of the real object. For example, the area of ​​the placement plane of the real object is A, and the contact area between the three-dimensional virtual sand table and the placement plane is smaller than A by adjusting the volume of the three-dimensional virtual sand table.

[0092] Optionally, the display device determines a real object for placing the three-dimensional virtual sand table from a plurality of candidate real objects. Optionally, the display device determines a real object for placing the three-dimensional virtual sand table according to a preset judgment logic. Schematically, the following Table 1 shows the preset judgment logic.

[0093] Table 1

[0094]

[0095] When the judgment logic of all candidate real objects is not satisfied, the three-dimensional virtual sand table is presented at a preset position of the mixed picture, for example, the three-dimensional virtual sand table is displayed at a lower middle position of the mixed picture.

[0096] In one embodiment, the depth information of the three-dimensional virtual sandbox in the mixed screen is determined based on the determined depth information of the real object in the real environment, so as to achieve the visual effect of placing the three-dimensional virtual sandbox on the real object. For example, the depth information of the coffee table is 3, and the depth information of the pixel corresponding to the three-dimensional virtual sandbox in the mixed screen is determined to be 3.

[0097] In one embodiment, the pixel values ​​of edge pixels on the mixed screen are randomly set to the pixel values ​​of the 3D virtual sand table or the pixel values ​​of the real object, and the edge pixels refer to the pixels at the junction of the 3D virtual sand table and the real object. This method ensures the virtual-real fusion effect of the 3D virtual sand table and the real object, and realizes the splicing of the 3D virtual sand table and the real object.

[0098] In one embodiment, according to the lighting conditions in the real space, the shadows of the 3D virtual sandbox and the shadows of real objects are presented on the mixed screen. In addition to the shadows of real objects in the real space, the mixed screen also displays the shadows of the 3D virtual sandbox in the real space, so as to achieve a deeper virtual-real fusion effect, further enhancing the user's sense of reality of watching the game in person.

[0099] Combined with reference Figure 5 , Figure 5 500 is a mixed picture provided by an exemplary embodiment of the present application. The mixed picture 500 shows a three-dimensional virtual sandbox 501. Figure 5 It can be seen that the three-dimensional virtual sandbox 501 is placed on the coffee table in the real environment.

[0100] Step 460: presenting the locations of multiple player virtual characters on a three-dimensional virtual sand table, where the three-dimensional virtual sand table is used to display the overall topography of the virtual environment of the game.

[0101] In one embodiment, in response to the display device receiving a trigger operation for a first player virtual character, a three-dimensional first virtual screen is newly presented, and the first player virtual character is any one of multiple player virtual characters; the virtual environment picture observed by the first player is presented on the three-dimensional first virtual screen, and the first player is the player controlling the first player virtual character.

[0102] Indicatively, in response to the first player virtual character on the three-dimensional virtual sandbox receiving an eye sight trigger operation, a three-dimensional first virtual screen is newly displayed. Indicatively, in response to the first player virtual character on the three-dimensional virtual sandbox receiving a gesture click operation, a three-dimensional first virtual screen is newly displayed.

[0103] Combined with reference Figure 5 , Figure 5A three-dimensional first virtual screen 502 is shown. The three-dimensional first virtual screen 502 displays the virtual environment image observed by the first player.

[0104] In one embodiment, in response to the three-dimensional virtual sandbox receiving a trigger operation, a three-dimensional second virtual screen is newly presented; at least one of the game economic curves and current equipment conditions of multiple player virtual characters is presented on the three-dimensional second virtual screen.

[0105] Indicatively, in response to the three-dimensional virtual sandbox receiving a double-click gesture operation, a three-dimensional second virtual screen is newly displayed. Figure 5 , Figure 5 A three-dimensional second virtual screen 503 is shown. The three-dimensional second virtual screen 503 displays the game economic curves and current equipment conditions of multiple player virtual characters.

[0106] In summary, the above embodiments provide a display device that displays a three-dimensional virtual sand table. The volume of the three-dimensional virtual sand table will be adapted to the bearing capacity of real objects in the real environment. The above embodiments also provide a method for determining real objects for placing the three-dimensional virtual sand table, which improves the coordination and authenticity of the live broadcast of the event, thereby enhancing the user's sense of immersion.

[0107] based on Figure 4 In the optional embodiment shown, the three-dimensional virtual sandbox also supports at least one of the following operation modes and display modes.

[0108] Regarding the operation mode,

[0109] Optionally, in response to the display device receiving a trigger operation, the display of the three-dimensional virtual sandbox is turned on or off; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual sandbox is moved; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual sandbox is enlarged or reduced; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual sandbox is rotated. The trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye sight trigger operation.

[0110] Indicatively, in response to the display device receiving a designated gesture (such as a palm sweep from left to right), an interface element controller is called out in the mixed screen, and the interface element controller provides a display control of a three-dimensional virtual sand table. By setting the display control to a closed state, it is determined that the three-dimensional virtual sand table is closed in the mixed screen. Similarly, by setting the display control to an open state, it is determined that the three-dimensional virtual sand table is displayed in the mixed screen.

[0111] Indicatively, in response to the display device receiving a gesture operation for controlling cursor movement and a confirmation gesture operation, it is determined that the three-dimensional virtual sandbox is selected. In response to the display device receiving a move gesture operation, the three-dimensional virtual sandbox is moved. In response to the display device receiving a rotate gesture operation, the three-dimensional virtual sandbox is rotated. In response to the display device receiving a zoom gesture operation, the three-dimensional virtual screen is zoomed.

[0112] Indicatively, the 3D virtual sand table can be directly controlled by voice to open / close, drag / place, reduce / enlarge, rotate, etc. Indicatively, the 3D virtual sand table can be continuously stared at to confirm the selection of the 3D virtual sand table, and then the 3D virtual sand table can be scaled / rotated / moved through gestures and / or voice operations.

[0113] For display mode,

[0114] Optionally, a color effect of the three-dimensional virtual sand table is presented on the mixed screen, and the color effect is associated with at least one of the lighting conditions and temperature conditions of the real environment. Optionally, a weather effect of the three-dimensional virtual sand table is presented on the mixed screen, and the weather effect is associated with the weather conditions of the real environment. Optionally, a flickering effect of the three-dimensional virtual sand table is presented on the mixed screen, and the flickering effect is associated with the sound conditions of the real environment.

[0115] Indicatively, if the real environment where the display device is located has sufficient light, a light yellow halo will be displayed on the 3D virtual sand table, and the light yellow halo will cover the 3D virtual sand table. Indicatively, if the real environment where the display device is located has a temperature below zero degrees, a white halo will be displayed on the 3D virtual sand table, and the white halo will cover the 3D virtual sand table. Indicatively, if it is raining in the real environment, a rain effect will be added to the 3D virtual sand table. Indicatively, if the display device is in a library and the volume is low, the 3D virtual sand table will not flicker. Indicatively, if the display device is in a living room and the volume is moderate, a slightly flickering 3D virtual sand table will be displayed.

[0116] For display mode,

[0117] Optionally, at the beginning stage of a game between multiple player virtual characters, the initial game scene in three-dimensional form is enlarged and presented as the foreground of the mixed screen; optionally, at the end stage of a game between multiple player virtual characters, the ending game scene in three-dimensional form is enlarged and presented as the foreground of the mixed screen; optionally, in response to the presence of exciting operation scenes in the real-time game performance displayed on the three-dimensional virtual sandbox, the exciting operation scenes in three-dimensional form are enlarged and reproduced as the foreground of the mixed screen.

[0118] Schematically, at the beginning of the game, the warm-up scene of multiple virtual characters of players in three-dimensional form is enlarged and presented as the foreground of the picture in the mixed picture. Schematically, at the beginning of the game, the base building in the virtual environment of the game in three-dimensional form is enlarged and presented as the foreground of the picture in the mixed picture.

[0119] Indicatively, at the end of the game, the scene of the three-dimensional base building being breached is magnified and presented as the foreground of the mixed image.

[0120] Indicatively, an operation scene in which a player virtual character defeats another player virtual character alone is enlarged and reproduced in a three-dimensional form as a foreground of the picture.

[0121] In summary, the above provides an operation method and a display method for a three-dimensional virtual sandbox, and provides a display solution for a three-dimensional virtual sandbox in an AR mode in a live event scenario.

[0122] In addition, the 3D virtual sandbox can be controlled by the user to turn on / off the display, move, shrink / enlarge, and rotate, which increases the freedom of the live broadcast of the event. Users can flexibly adjust and customize the 3D virtual sandbox.

[0123] In addition, the color effects, weather effects and flashing effects of the three-dimensional virtual sand table are all related to the environmental factors of the real environment, realizing the influence of the environmental conditions of the real environment on the three-dimensional virtual sand table, and deeply combining the real environment and the three-dimensional virtual sand table, thereby improving the authenticity of the live broadcast of the event and the user's sense of immersion when watching the live broadcast of the event.

[0124] In addition, the initial game scene at the beginning of the game, the ending game scene at the end of the game, and the exciting operation scenes are all presented in three-dimensional form in the mixed screen. Presenting the game scene information in three-dimensional form enhances the user's immersive viewing experience.

[0125] based on Figure 2 In the optional embodiment shown, the three-dimensional live event presentation element includes three-dimensional virtual commentary. Figure 6 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment of the present invention is shown. Figure 1 The display device 101 shown is used as an example to illustrate that the method includes:

[0126] Step 620, running the live event client on the display device;

[0127] Live event client refers to a client that supports live event broadcasting.

[0128] In one embodiment, the display device presents an initial mixed screen with the real environment as the screen background and the system interface as the screen foreground, and the system interface includes a running control of the live broadcast client; in response to the running control receiving a trigger operation, the live broadcast client is run. Optionally, the trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye trigger operation.

[0129] Step 640, in the AR mode, presenting a mixed picture with the real environment as the picture background and the three-dimensional virtual explanation as the picture foreground;

[0130] 3D virtual commentary refers to a 3D virtual image that provides real-time evaluation of the game situation. The 3D virtual commentary can be a virtual character in the game or other virtual characters. The 3D virtual commentary is a virtual character controlled by an AI model. The game data is input into the AI ​​model, and the AI ​​model will extract the key events of the game. The AI ​​model generates commentary text and / or commentary audio based on the key events. The display device presents the text and / or plays the audio.

[0131] In one embodiment, the display device presents a three-dimensional virtual illustration leaning / sitting / lying on a real object in the real environment. For example, the display device leans against a bookshelf in the real space.

[0132] Optionally, the display device presents a three-dimensional virtual interpretation in a first posture in contact with a real object in the real environment. The first posture is adapted to the type of the real object. For example, if the real object is a bookshelf, the first posture is a leaning posture; if the real object is a stool, the first posture is a sitting posture; if the real object is a bed, the first posture is a lying posture.

[0133] Optionally, the display device determines a real object for supporting the three-dimensional virtual interpretation from a plurality of candidate real objects. Optionally, the display device determines a real object for supporting the three-dimensional virtual interpretation according to a preset judgment logic. Schematically, the following Table 2 shows the preset judgment logic.

[0134] Table 2

[0135]

[0136] When the judgment logic of all candidate real objects is not satisfied, the three-dimensional virtual interpretation is presented at a preset position of the mixed picture, for example, the three-dimensional virtual interpretation is displayed on the right side of the mixed picture.

[0137] In one embodiment, the depth information of the 3D virtual commentary in the mixed picture is determined based on the depth information of the real object in the real environment to achieve the visual effect of the 3D virtual commentary leaning / sitting / lying on the real object. For example, if the depth information of the bookshelf is 6, the depth information of the pixel corresponding to the 3D virtual commentary in the mixed picture is determined to be 5-7.

[0138] In one embodiment, the pixel values ​​of edge pixels on the mixed screen are randomly set to the pixel values ​​of the 3D virtual interpretation or the pixel values ​​of the real object, and the edge pixels refer to the pixels at the junction of the 3D virtual interpretation and the real object. This method ensures the virtual-real fusion effect of the 3D virtual interpretation and the real object, and realizes the splicing of the 3D virtual interpretation and the real object.

[0139] In one embodiment, according to the lighting conditions in the real space, the shadow of the 3D virtual commentary and the shadow of the real object are presented on the mixed screen. In addition to the shadow of the real object in the real space, the shadow of the 3D virtual commentary in the real space is also displayed on the mixed screen to achieve a deeper virtual-real fusion effect, further enhancing the user's sense of reality of watching the game in person.

[0140] Combined with reference Figure 5 , Figure 5 500 is provided by an exemplary embodiment of the present application. The mixed picture 500 shows a three-dimensional virtual explanation 504. Figure 5 It can be seen that the three-dimensional virtual sandbox 504 is leaning against the bookshelf in the real environment.

[0141] Step 660, presenting the evaluation of the real-time game situation of the multiple virtual characters of the players by the three-dimensional virtual commentary, and / or playing the evaluation of the real-time game situation of the multiple virtual characters of the players by the three-dimensional virtual commentary;

[0142] In one embodiment, the evaluation of the three-dimensional virtual interpretation is presented through text, graphics, animation, etc.

[0143] Optionally, in response to the display device receiving a trigger operation, the display of the three-dimensional virtual interpretation is turned on or off; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual interpretation is moved; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual interpretation is enlarged or reduced; optionally, in response to the display device receiving a trigger operation, the three-dimensional virtual interpretation is rotated. The trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye sight trigger operation.

[0144] In an illustrative manner, in response to the display device receiving a designated gesture (such as a palm swiping from left to right), an interface element controller is called out in the mixed screen, and the interface element controller provides a display control of a three-dimensional virtual commentary. By setting the display control to a closed state, it is determined that the three-dimensional virtual commentary is closed in the mixed screen. Similarly, by setting the display control to an open state, it is determined that the three-dimensional virtual commentary is displayed in the mixed screen.

[0145] Indicatively, in response to the display device receiving a gesture operation for controlling cursor movement and a confirmation gesture operation, the 3D virtual interpretation is determined to be selected. In response to the display device receiving a move gesture operation, the 3D virtual interpretation is moved. In response to the display device receiving a rotate gesture operation, the 3D virtual interpretation is rotated. In response to the display device receiving a zoom gesture operation, the 3D virtual screen is zoomed.

[0146] Indicatively, the 3D virtual interpretation can be directly controlled by voice to open / close, drag / place, reduce / enlarge, rotate, etc. Indicatively, the 3D virtual interpretation can be continuously stared at to confirm the selection of the 3D virtual interpretation, and then the 3D virtual interpretation can be scaled / rotated / moved by gesture operation and / or voice operation.

[0147] In summary, the above embodiments provide a display device that displays a three-dimensional virtual commentary. The posture of the three-dimensional virtual commentary will be adapted to the real objects in the real environment. The above embodiments also provide a method for determining the real objects that support the three-dimensional virtual commentary, which improves the coordination and authenticity of the live broadcast of the event, thereby enhancing the user's sense of immersion.

[0148] In addition, the 3D virtual commentary can be controlled by the user to turn on / off the display, move, shrink / enlarge, and rotate, which increases the freedom of the live broadcast of the event. Users can flexibly adjust and customize the 3D virtual commentary.

[0149] based on Figure 2 In the optional embodiment shown, the mixed screen also displays a two-dimensional live event display element. Optionally, the two-dimensional live event display element includes a two-dimensional virtual viewing screen. Figure 7 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment of the present invention is shown. Figure 1 The display device 101 shown is used as an example to illustrate that the method includes:

[0150] Step 720, running the live event client on the display device;

[0151] Live event client refers to a client that supports live event broadcasting.

[0152] In one embodiment, the display device presents an initial mixed screen with the real environment as the screen background and the system interface as the screen foreground, and the system interface includes a running control of the live broadcast client; in response to the running control receiving a trigger operation, the live broadcast client is run. Optionally, the trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye trigger operation.

[0153] Step 740, in the AR mode, presenting a mixed picture with the real environment as the picture background and at least one three-dimensional event live broadcast display element as the picture foreground;

[0154] The three-dimensional live event display elements are three-dimensional virtual elements related to the live event content.

[0155] Step 760, presenting the two-dimensional virtual viewing screen as the foreground of the mixed picture;

[0156] A two-dimensional virtual viewing screen refers to a two-dimensional virtual screen used to accommodate images of multiple virtual characters of players competing against each other in a virtual game environment.

[0157] In one embodiment, the display device presents a two-dimensional virtual viewing screen embedded in a real plane of the real environment. For example, the display device presents a two-dimensional virtual viewing screen embedded in a wall of the real environment.

[0158] Optionally, the display device presents a two-dimensional virtual viewing screen embedded in a real plane of the real environment at a first tilt angle and a first size; wherein the first tilt angle is adapted to the tilt angle of the real plane, and the first size is adapted to the size of the real plane. Optionally, the real plane includes a wall, a floor, a ceiling, a TV screen, and the like.

[0159] Optionally, the screen border of the two-dimensional virtual viewing screen is parallel to the edge lines of the real plane.

[0160] Optionally, the display device determines a real plane for accommodating the two-dimensional virtual viewing screen from multiple candidate real planes. Optionally, the display device determines a real plane for accommodating the two-dimensional virtual viewing screen according to a preset judgment logic. Schematically, the following Table 3 shows the preset judgment logic.

[0161] Table 3

[0162]

[0163] When the judgment logic of all candidate real objects is not satisfied, a two-dimensional virtual viewing screen is presented at a preset position of the mixed picture, for example, the two-dimensional virtual viewing screen is displayed in the center of the mixed picture.

[0164] Combined with reference Figure 5 , Figure 5 500 is a mixed picture provided by an exemplary embodiment of the present application. The mixed picture 500 shows a two-dimensional virtual viewing screen 505. Figure 5 It can be seen that the two-dimensional virtual viewing screen 505 is embedded in the wall.

[0165] In one embodiment, in response to the display device receiving a trigger operation, the two-dimensional virtual viewing screen is moved from the first real plane to the second real plane for embedded presentation. Schematically, the two-dimensional virtual viewing screen is moved from the wall to the TV screen for embedded presentation. When switching, the size and tilt angle of the two-dimensional virtual viewing screen are automatically adjusted to adapt to the second real plane after switching.

[0166] Step 780: presenting a picture of multiple virtual characters of players competing against each other in the virtual game environment on a two-dimensional virtual viewing screen.

[0167] In one embodiment, a two-dimensional virtual viewing screen presents a picture of multiple player virtual characters competing in a virtual game environment.

[0168] In one embodiment, in response to the display device receiving a trigger operation, the display of the two-dimensional virtual viewing screen is turned on or off; in response to the display device receiving a trigger operation, the display of the two-dimensional virtual viewing screen is moved; in response to the display device receiving a trigger operation, the display of the two-dimensional virtual viewing screen is enlarged or reduced; in response to the display device receiving a trigger operation, the display of the two-dimensional virtual viewing screen is rotated. The trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye sight trigger operation.

[0169] Indicatively, in response to the display device receiving a designated gesture (such as a palm swiping from left to right), an interface element controller is called out in the mixed screen, and the interface element controller provides a display control of a two-dimensional virtual viewing screen. By setting the display control to a closed state, it is determined that the two-dimensional virtual viewing screen is closed in the mixed screen. Similarly, by setting the display control to an open state, it is determined that the two-dimensional virtual viewing screen is displayed in the mixed screen.

[0170] Indicatively, in response to the display device receiving a gesture operation for controlling cursor movement and a confirmation gesture operation, it is determined that the two-dimensional virtual viewing screen is selected. In response to the display device receiving a move gesture operation, the two-dimensional virtual viewing screen is moved. In response to the display device receiving a rotate gesture operation, the two-dimensional virtual viewing screen is rotated. In response to the display device receiving a zoom gesture operation, the three-dimensional virtual screen is zoomed.

[0171] Indicatively, the two-dimensional virtual viewing screen can be directly controlled by voice to open / close, drag / place, reduce / enlarge, rotate, etc. Indicatively, the two-dimensional virtual viewing screen can be continuously stared at to confirm the selection of the two-dimensional virtual viewing screen, and then the two-dimensional virtual viewing screen can be scaled / rotated / moved through gestures and / or voice operations.

[0172] In summary, the above embodiments provide a display device that displays a two-dimensional virtual viewing screen. The tilt angle and size of the two-dimensional virtual viewing screen will be adapted to the real plane in the real environment. The above embodiments also provide a method for determining the real plane for accommodating the two-dimensional virtual viewing screen, which improves the coordination and authenticity of the live broadcast of the event, thereby enhancing the user's sense of immersion.

[0173] In addition, the two-dimensional virtual viewing screen can be controlled by the user to turn on / off, move, shrink / enlarge, and rotate, which increases the freedom of the live broadcast of the event. Users can flexibly adjust and customize the two-dimensional virtual viewing screen.

[0174] Above Figure 2 , Figure 4 , Figure 6 , Figure 7 In the embodiment of the present invention, the live broadcast screen of the event in the AR mode of the display device has been introduced. The live broadcast screen of the event in the VR mode will be introduced below. Figure 8 A flowchart of a method for presenting a live event screen provided by an exemplary embodiment of the present invention is shown. Figure 1 The method is illustrated by the display device shown in the figure, and includes:

[0175] Step 820, running the live event client on the display device;

[0176] Live event client refers to a client that supports live event broadcasting.

[0177] In one embodiment, the display device presents an initial mixed screen with the real environment as the screen background and the system interface as the screen foreground, and the system interface includes a running control of the live broadcast client; in response to the running control receiving a trigger operation, the live broadcast client is run. Optionally, the trigger operation includes at least one of a gesture trigger operation, a voice trigger operation, and an eye trigger operation.

[0178] Step 840, in the AR mode, presenting a mixed picture with the real environment as the picture background and at least one three-dimensional event live broadcast display element as the picture foreground;

[0179] The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional live broadcast display elements are three-dimensional virtual elements related to the live broadcast content.

[0180] In one embodiment, after the live event client is run, the default AR mode will be entered.

[0181] Step 860, switching the AR mode to the virtual reality VR mode;

[0182] VR mode refers to a mode of immersively presenting virtual scenes. Optionally, the images presented in VR mode have nothing to do with the real space where the display device is located. Optionally, a purely fictional scene is presented in VR mode; Optionally, other real scenes are presented in VR mode, and other real scenes are scenes of other real spaces, and other real spaces refer to real spaces different from the real space where the display device is located.

[0183] In one embodiment, in response to the display device receiving a head-down operation, a mode switching control is presented; in response to the mode switching control receiving a trigger operation, the AR mode is switched to the VR mode. In another embodiment, in response to the display device receiving a user's continuous eye-closing operation, the AR mode is switched to the VR mode.

[0184] Step 880: In VR mode, a live event scene is presented, where the live event scene is a scene related to the live event.

[0185] The event live broadcast scene refers to a scene related to the event live broadcast. Optionally, the event live broadcast scene includes at least one of the event base scene, the game scene and the event site scene. Optionally, the event live broadcast scene contains virtual items and virtual objects that support interaction with users wearing display devices.

[0186] The event base scene includes at least one of the event organizer's viewing base scene and the event participant's preparation base scene. Fig. 9 , Fig. 9 The organizer's viewing base scene is shown, and a user wearing a display device can interact with the three-dimensional virtual character 901 and the three-dimensional virtual object 902 in the viewing base scene.

[0187] The game scene is the scene of the virtual environment where multiple players' virtual characters are located. Fig.10 , Fig.10 The three-dimensional virtual environment of the game is shown. The user can select any different location to watch the current game scene at that location.

[0188] The scene of the event, including the live pictures of multiple players competing against each other. Fig.11 , Fig.11The live competition scenes of multiple players are shown. Optionally, the live scene of the competition is captured by VR high-definition cameras in the player seats and the entire venue, so that the user feels like he is in the stadium.

[0189] In one embodiment, in response to a portal in the first live event scene receiving a trigger operation, the first live event scene is switched to the second live event scene. The trigger operation includes any one of a gesture click operation and an eye continuous gaze operation.

[0190] To sum up, the above embodiments provide a method for presenting live broadcast images of events in VR mode. Furthermore, the present application provides an e-sports live viewing mode that can freely switch between real space and virtual space. Users can choose the viewing method that best suits them according to different scenes and environments, thereby improving the user's viewing comfort and immersion.

[0191] Next, the development process of the live event client will be introduced. In one embodiment, based on SwiftUI (an interface framework), RealityKit (an AR rendering platform), ARKit (an AR development platform), and Accessibility (accessibility) of AppleFrameworks (a framework), an application is developed on Unity (a development engine) to achieve various interactions between AR mode and VR mode. Fig.12 , Fig.12 A flow chart of a method for developing a live event client is shown. The method includes:

[0192] Step 1201, create a vision OS project;

[0193] Create a vision OS project in Xcode, which is an integrated development tool that runs on the operating system Mac OS X. Add a unity target in Xcode and import the relevant resources and code from the unity project into the Xcode project.

[0194] Step 1202, using SwiftUI as the interface framework;

[0195] Use SwiftUI as the interface framework of the live event client.

[0196] Step 1203, creating a main interface;

[0197] Use SwiftUI to create the main interface of the live event client.

[0198] Step 1204, adding a mode switch;

[0199] Use SwiftUI to add a mode switcher for switching between AR mode and VR mode in the main interface of the live event client.

[0200] Step 1205, adding a two-dimensional virtual viewing screen;

[0201] Use SwiftUI to add a two-dimensional virtual viewing screen to the main interface of the live broadcast client for live display of the game screen.

[0202] Step 1206, creating a three-dimensional virtual sandbox;

[0203] Use RealityKit to add a 3D virtual sandbox to the main interface.

[0204] Step 1207, creating a three-dimensional first virtual screen;

[0205] Use RealityKit to add a 3D first virtual screen to the main interface.

[0206] Step 1208, creating a three-dimensional second virtual screen;

[0207] Use RealityKit to add a 3D second virtual screen to your main interface.

[0208] Step 1209, creating a three-dimensional virtual explanation;

[0209] Use RealityKit to add 3D virtual explanations to the main interface.

[0210] Step 1210, adding spatial perception and interaction capabilities;

[0211] Use ARKit to add spatial perception and interaction capabilities to the live broadcast client, such as plane detection, scene reconstruction, image anchoring, etc.

[0212] Step 1211, adding barrier-free function;

[0213] Use Accessibility to add barrier-free features to the live event client, such as voice control, voice feedback, magnifying glass, etc.

[0214] Step 1212, adding a virtual scene function;

[0215] Use Unity to add virtual scene functions to the live broadcast client, such as e-sports event base scenes, game scenes, on-site VR scenes, etc.

[0216] Step 1213, preview and test using Xcode Previews and vision OS Simulator;

[0217] Use Xcode Previews (a development tool) and visionOS Simulator (a development tool) to preview and test your app.

[0218] Step 1214, use Reality Composer Pro to edit and debug the 3D content.

[0219] Use Reality Composer Pro, a development tool, to edit and debug 3D content.

[0220] Fig.13 A device for presenting a live event screen provided by an exemplary embodiment of the present application is shown. The device is applied to a display device supporting an AR mode. The device includes:

[0221] The running module 1301 is used to run the event live broadcast client on the display device;

[0222] The display module 1302 is used to present a mixed picture with a real environment as the picture background and at least one three-dimensional event live broadcast display element as the picture foreground in the AR mode;

[0223] The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional live broadcast display elements are three-dimensional virtual elements related to the live broadcast content.

[0224] In an optional embodiment, at least one 3D event live broadcast display element includes a 3D virtual sandbox. The display module 1302 is also used to present a mixed picture with a real environment as the picture background and a 3D virtual sandbox as the picture foreground. The locations of multiple player virtual characters are presented on the 3D virtual sandbox, and the 3D virtual sandbox is used to display the overall terrain of the game virtual environment.

[0225] In an optional embodiment, the display module 1302 is also used to present a three-dimensional virtual sandbox placed on real objects in a real environment.

[0226] In an optional embodiment, the display module 1302 is further used to present a three-dimensional virtual sandbox placed on a real object in a real environment with a first volume; wherein the first volume is adapted to the bearing capacity of the real object.

[0227] In an optional embodiment, the display module 1302 is also used to present the color effects of the three-dimensional virtual sandbox, and the color effects are associated with at least one of the lighting conditions and temperature conditions of the real environment.

[0228] In an optional embodiment, the display module 1302 is also used to present weather effects of the three-dimensional virtual sandbox, and the weather effects are associated with the weather conditions of the real environment.

[0229] In an optional embodiment, the display module 1302 is also used to present a flickering effect of the three-dimensional virtual sandbox, where the flickering effect is associated with the sound conditions of the real environment.

[0230] In an optional embodiment, the display module 1302 is further used to present a three-dimensional first virtual screen in response to the display device receiving a trigger operation for the first player virtual character, where the first player virtual character is any one of the multiple player virtual characters; and present the virtual environment picture observed by the first player on the three-dimensional first virtual screen, where the first player is the player controlling the first player virtual character.

[0231] In an optional embodiment, the display module 1302 is also used to present a new three-dimensional second virtual screen in response to the three-dimensional virtual sandbox receiving a trigger operation; and present at least one of the game economic curves and current equipment conditions of multiple player virtual characters on the three-dimensional second virtual screen.

[0232] In an optional embodiment, the display module 1302 is further configured to enlarge and present the initial game scene in three-dimensional form as the foreground of the mixed screen at the beginning of the game between multiple virtual characters of the players.

[0233] In an optional embodiment, the display module 1302 is further configured to enlarge and present the three-dimensional end-game scene as the foreground of the mixed screen at the end stage of the game between multiple virtual characters of the players.

[0234] In an optional embodiment, the display module 1302 is further used to respond to the presence of exciting operation scenes in the real-time game performance displayed by the three-dimensional virtual sandbox, and to enlarge and reproduce the three-dimensional exciting operation scenes as the foreground of the picture in the mixed picture.

[0235] In an optional embodiment, at least one 3D live event display element includes a 3D virtual commentary; the display module 1302 is further used to present a mixed picture with a real environment as the picture background and the 3D virtual commentary as the picture foreground; present the 3D virtual commentary's evaluation of the real-time game situation of multiple player virtual characters, and / or play the 3D virtual commentary's evaluation of the real-time game situation of multiple player virtual characters.

[0236] In an optional embodiment, the display module 1302 is also used to present a three-dimensional virtual illustration of leaning, sitting or lying on a real object in the real environment.

[0237] In an optional embodiment, the display module 1302 is also used to present a two-dimensional virtual viewing screen as the foreground of the mixed screen; and present a picture of multiple virtual characters of players competing in the virtual environment of the game on the two-dimensional virtual viewing screen.

[0238] In an optional embodiment, the display module 1302 is also used to present a two-dimensional virtual viewing screen embedded in a real plane of the real environment.

[0239] In an optional embodiment, the display module 1302 is also used to present a two-dimensional virtual viewing screen embedded in a real plane of the real environment with a first inclination angle and a first size; wherein the first inclination angle is adapted to the inclination angle of the real plane, and the first size is adapted to the size of the real plane.

[0240] In an optional embodiment, the display module 1302 is further configured to move the two-dimensional virtual viewing screen from the first real plane to the second real plane for embedded presentation in response to the display device receiving a trigger operation.

[0241] In an optional embodiment, the display module 1302 is also used to switch the AR mode to the virtual reality VR mode; in the VR mode, a live event scene is presented, and the live event scene is a scene related to the live event.

[0242] In an optional embodiment, the event live broadcast scenario includes at least one of the following:

[0243] A competition base scene, which includes at least one of a competition organizer's viewing base scene and a competition participant's preparation base scene;

[0244] Game scene: the game scene is a scene of a virtual environment where multiple players' virtual characters are located;

[0245] The event scene includes live footage of multiple players competing against each other.

[0246] In an optional embodiment, the display module 1302 is further used to present a mode switching control in response to the display device receiving a head-down operation; and to switch the AR mode to the VR mode in response to the mode switching control receiving a trigger operation.

[0247] In an optional embodiment, the display module 1302 is further used to present an initial mixed screen with the real environment as the screen background and the system interface as the screen foreground, and the system interface includes a running control of the live broadcast client. In response to the running control receiving a trigger operation, the live broadcast client is run.

[0248] In summary, in AR mode, the display device presents a mixed picture with the real environment as the picture background and the three-dimensional live event display elements as the picture foreground. This application provides a live event picture applied to a display device supporting AR mode. When watching live events, users can not only watch the live event content, but also be aware of changes in the surrounding environment (such as the presence of other objects who want to talk to the user), thereby improving the efficiency of users in obtaining information when watching live events.

[0249] In addition, the three-dimensional live broadcast display elements can better integrate the virtual and real environment with the real environment, thereby improving the authenticity of the live broadcast images.

[0250] Please refer to Fig.14 , which shows a structural block diagram of a display device 1400 provided by an exemplary embodiment of the present application. The display device 1400 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV) player. The display device 1400 may also be called a user device, a portable terminal, a head-mounted display device, or other names.

[0251] Typically, the display device 1400 includes a processor 1401 and a memory 1402 .

[0252] The processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1401 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1401 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0253] The memory 1402 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1402 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1402 is used to store at least one instruction, which is used to be executed by the processor 1401 to implement the method for presenting the live broadcast screen of the event provided in the embodiment of the present application.

[0254] In some embodiments, the display device 1400 may further include: a peripheral device interface 1403 and at least one peripheral device. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1404 , a display screen 1405 , a camera assembly 1406 , an audio circuit 1407 and a power supply 1408 .

[0255] The peripheral device interface 1403 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1401 and the memory 1402. In some embodiments, the processor 1401, the memory 1402, and the peripheral device interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1401, the memory 1402, and the peripheral device interface 1403 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0256] The radio frequency circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1404 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1404 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 1404 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1404 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0257] The display screen 1405 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. Optionally, the display device 1400 includes an internal display screen and an external display screen close to the eyes of the user. The external display screen is used to display the eye image of the user when the surrounding objects interact with the user of the display device 1400. Optionally, the display screen 1405 also has the ability to collect touch signals on the surface or above the surface of the display screen 1405. The touch signal can be input to the processor 1401 as a control signal for processing. The display screen 1405 is used to provide virtual buttons and / or comment keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1405 can be one, and the front panel of the display device 1400 is set; in other embodiments, the display screen 1405 can be at least two, which are respectively set on different surfaces of the display device 1400 or are folded; in some other embodiments, the display screen 1405 can be a flexible display screen, which is set on the curved surface or folded surface of the display device 1400. Even, the display screen 1405 can be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0258] The camera assembly 1406 is used to capture images or videos. Optionally, the camera assembly 1406 includes an internal camera and an external camera. Typically, the internal camera is used to capture and obtain user eye posture data. In some embodiments, there are at least two external cameras, which are any one of a main camera, a depth of field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, and the fusion of the main camera and the wide-angle camera to realize panoramic shooting and AR (Augmented Reality) shooting functions. In some embodiments, the camera assembly 1406 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0259] The audio circuit 1407 is used to provide an audio interface between the user and the display device 1400. The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1401 for processing, or input them into the radio frequency circuit 1404 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the display device 1400. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0260] The power supply 1408 is used to power the various components in the display device 1400. The power supply 1408 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1408 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0261] In some embodiments, the display device 1400 further includes one or more sensors 1409 , including but not limited to: an acceleration sensor 1410 , a gyroscope sensor 1411 , a pressure sensor 1412 , an optical sensor 1413 , and a proximity sensor 1414 .

[0262] The acceleration sensor 1410 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the display device 1400. For example, the acceleration sensor 1410 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 1401 can control the display screen 1405 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1410. The acceleration sensor 1410 can also be used to collect motion data of games or users.

[0263] The gyro sensor 1411 can detect the body direction and rotation angle of the display device 1400, and the gyro sensor 1411 can cooperate with the acceleration sensor 1410 to collect the user's three-dimensional actions on the display device 1400. The processor 1401 can implement the following functions based on the data collected by the gyro sensor 1411: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0264] The pressure sensor 1412 may be provided at the side frame of the display device 1400 and / or the lower layer of the display screen 1405. When the pressure sensor 1412 is provided at the side frame of the display device 1400, it may detect the user's holding signal of the display device 1400, and perform left and right hand recognition or shortcut operation according to the holding signal. When the pressure sensor 1412 is provided at the lower layer of the display screen 1405, it may realize the control of the operability control on the UI interface according to the user's pressure operation on the display screen 1405. The operability control includes at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0265] The optical sensor 1413 is used to collect the ambient light intensity. In one embodiment, the processor 1401 can control the display brightness of the display screen 1405 according to the ambient light intensity collected by the optical sensor 1413. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1405 is increased; when the ambient light intensity is low, the display brightness of the display screen 1405 is reduced. In another embodiment, the processor 1401 can also dynamically adjust the shooting parameters of the camera assembly 1406 according to the ambient light intensity collected by the optical sensor 1413.

[0266] The proximity sensor 1414, also called a distance sensor, is usually disposed on the front of the display device 1400. The proximity sensor 1414 is used to collect the distance between the user and the front of the display device 1400. In one embodiment, when the proximity sensor 1414 detects that the distance between the surrounding objects and the front of the display device 1400 is gradually decreasing, the processor 1401 controls the external display screen to display the user's eye image; when the proximity sensor 1414 detects that the distance between the user and the front of the display device 1400 is gradually increasing, the processor 1401 controls the internal display screen to switch from the on screen state to the off screen state.

[0267] Those skilled in the art will understand that Fig.14 The structure shown in the figure does not constitute a limitation on the display device 1400, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0268] An embodiment of the present application also provides a display device, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the method for presenting live event images provided in the above-mentioned method embodiments.

[0269] The embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. The computer program is used to be executed by a computer device to implement the above-mentioned method for presenting live event images.

[0270] Optionally, the computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid state drive (SSD) or an optical disk, etc. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM). The present application also provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the method for presenting the live broadcast screen of the event provided in the above method embodiment.

[0271] The present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for presenting a live event screen provided by the above method embodiment.

[0272] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0273] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0274] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for presenting live sports events, characterized in that: The method is performed by a display device supporting an augmented reality (AR) mode, and the method includes: Running a live event client on the display device; In the AR mode, a mixed picture is presented with a real environment as a picture background and at least one three-dimensional event live broadcast display element as a picture foreground; The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional event live broadcast display element is a three-dimensional virtual element related to the event live broadcast content.

2. The method according to claim 1, characterized in that: The at least one three-dimensional event live broadcast display element includes a three-dimensional virtual sandbox; The presenting of a mixed picture with a real environment as the picture background and at least one event live broadcast display element as the picture foreground includes: Presenting a mixed picture with the real environment as the picture background and the three-dimensional virtual sandbox as the picture foreground; The method further comprises: The locations of multiple player virtual characters are presented on the three-dimensional virtual sandbox, and the three-dimensional virtual sandbox is used to display the overall terrain of the virtual environment of the game.

3. The method according to claim 2, characterized in that The method further comprises: The three-dimensional virtual sandbox is presented and placed on real objects in the real environment.

4. The method according to claim 3, characterized in that The presenting of placing the three-dimensional virtual sand table on a real object in the real environment includes: The three-dimensional virtual sandbox is presented as being placed on a real object in the real environment with a first volume; wherein the first volume is adapted to the bearing capacity of the real object.

5. The method according to claim 2, characterized in that: The method further comprises at least one of the following: Presenting a color effect of the three-dimensional virtual sandbox, wherein the color effect is associated with at least one of a lighting condition and a temperature condition of the real environment; Presenting a meteorological effect of the three-dimensional virtual sandbox, wherein the meteorological effect is associated with the weather conditions of the real environment; A flickering special effect of the three-dimensional virtual sandbox is presented, and the flickering special effect is associated with the sound conditions of the real environment.

6. The method according to claim 2, characterized in that The method further comprises: In response to the display device receiving a trigger operation for a first player virtual character, a three-dimensional first virtual screen is newly presented, where the first player virtual character is any one of the multiple player virtual characters; A virtual environment picture observed by a first player is presented on the three-dimensional first virtual screen, and the first player is a player controlling the first player virtual character.

7. The method according to claim 2, characterized in that: The method further comprises: In response to the three-dimensional virtual sandbox receiving a trigger operation, a three-dimensional second virtual screen is newly presented; At least one of the game economic curves and current equipment conditions of the multiple player virtual characters is presented on the three-dimensional second virtual screen.

8. The method according to claim 2, characterized in that: The method further includes at least one of the following: At the beginning of the game between the multiple virtual characters of the players, an initial game scene in three-dimensional form is enlarged and presented as a foreground in the mixed screen; At the end of the game between the multiple virtual characters of the players, a three-dimensional end-game scene is enlarged and presented as a foreground in the mixed screen; In response to the presence of a wonderful operation scene in the real-time game performance displayed by the three-dimensional virtual sandbox, the wonderful operation scene in three-dimensional form is enlarged and reproduced as a screen foreground in the mixed screen.

9. The method according to claim 1, characterized in that: The at least one three-dimensional event live broadcast display element includes a three-dimensional virtual commentary; The presenting of a mixed picture with a real environment as the picture background and at least one event live broadcast display element as the picture foreground includes: Presenting a mixed picture with the real environment as the picture background and the three-dimensional virtual explanation as the picture foreground; The method further comprises: The evaluation of the real-time game situation of the multiple virtual characters of the players by the three-dimensional virtual commentator is presented, and / or the evaluation of the real-time game situation of the multiple virtual characters of the players by the three-dimensional virtual commentator is played.

10. The method according to claim 9, characterized in that The method further comprises: The three-dimensional virtual representation is presented to lean against, sit on, or lie on a real object in the real environment.

11. The method according to any one of claims 1 to 10, characterized in that: The method further comprises: In the mixed picture, a two-dimensional virtual viewing screen is presented as a picture foreground; The two-dimensional virtual viewing screen presents a picture of multiple player virtual characters competing against each other in a virtual game environment.

12. The method according to claim 11, characterized in that The method further comprises: The two-dimensional virtual viewing screen is presented as being embedded in the real plane of the real environment.

13. The method according to claim 12, characterized in that The presenting of the two-dimensional virtual viewing screen embedded in the real plane of the real environment includes: Presenting that the two-dimensional virtual viewing screen is embedded in the real plane of the real environment at a first tilt angle and a first size; The first inclination angle is adapted to the inclination angle of the real plane, and the first size is adapted to the size of the real plane.

14. The method according to claim 12, characterized in that The method further comprises: In response to the display device receiving a trigger operation, the two-dimensional virtual viewing screen is moved from the first real plane to the second real plane for embedded presentation.

15. The method according to any one of claims 1 to 10, characterized in that: The method further comprises: Switching the AR mode to a virtual reality VR mode; In the VR mode, a live event scene is presented, and the live event scene is a scene related to the live event.

16. The method according to claim 15, characterized in that The event live broadcast scenario includes at least one of the following: A competition base scene, wherein the competition base scene includes at least one of a competition organizer's viewing base scene and a competition participant's preparation base scene; A game scene, wherein the game scene is a scene of a virtual game environment in which multiple player virtual characters are located; A competition scene includes a scene of a game in which multiple players compete against each other.

17. The method according to claim 15, characterized in that The switching of the AR mode to the VR mode includes: In response to the display device receiving a head-down operation, presenting a mode switching control; In response to the mode switching control receiving a trigger operation, the AR mode is switched to the VR mode.

18. The method according to any one of claims 1 to 10, characterized in that: The running of the live event client on the display device includes: Presenting an initial mixed screen with a real environment as the screen background and a system interface as the screen foreground, wherein the system interface includes a running control of the event live broadcast client; In response to the running control receiving a trigger operation, the live event client is run.

19. A device for presenting live sports events, characterized in that: The device is applied to a display device supporting an AR mode, and the device includes: An operating module, used for operating a live event client on the display device; A display module, used for presenting, in the AR mode, a mixed picture with a real environment as a picture background and at least one three-dimensional event live broadcast display element as a picture foreground; The real environment includes the surrounding environment of the display device in the real space, and the three-dimensional event live broadcast display element is a three-dimensional virtual element related to the event live broadcast content.

20. A display device, characterized in that: The display device includes: a processor and a memory, the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the method for presenting live event images as described in any one of claims 1 to 18.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is loaded and executed by a processor to implement the method for presenting live event images as described in any one of claims 1 to 18.

22. A computer program product, characterized in that The computer program product stores a computer program, and the computer program is loaded and executed by a processor to implement the method for presenting live event images as described in any one of claims 1 to 18.

Images