Human-computer interaction method and device, equipment and storage medium
Through the method of presenting transition effects in the virtual space and quickly switching live content, the problem of single live content presentation in virtual reality live scenarios is solved, and the user's immersive experience and interactive fun is improved.
Patent Information
- Application Number
- CN202310519951.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-12
AI Technical Summary
In virtual reality live broadcast scenarios, when the user selects a live broadcast room in the virtual space, the live broadcast content is relatively single, lacking interactive fun, resulting in poor immersive experience.
When the selected command of the target live broadcast room is detected in the virtual space, the transition screen is first called out to present the transition special effect, and the transition screen is closed after the special effect is completed, and the live broadcast content of the target live broadcast room is directly presented in the playback room screen, thereby Achieve efficient live broadcast and diversified live broadcast effects.
Through the presentation of transition effects, the fun and user interaction atmosphere of live broadcasts in the virtual space are enhanced, the immersive live broadcast experience of users is enhanced, and the diversity and fluency of live broadcast content in the virtual space is ensured.
Smart Images

Figure CN118945385A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of extended reality (XR) technology, and in particular to a human-computer interaction method, apparatus, device and storage medium. Background Art
[0002] At present, the application scenarios of XR technology are becoming more and more extensive, including virtual reality (VR), augmented reality (AR) and mixed reality (MR). In the virtual live broadcast scenario, XR technology can enable users to immersively watch various virtual live broadcast images. For example, users can experience real live interactive scenes by wearing a head mounted display (HMD).
[0003] Normally, viewers can directly display the live content of the selected live room by clicking on the cover information of different live rooms in the virtual space, which makes the presentation effect of each live room in the virtual space relatively simple and lacks a certain degree of interactive fun. Summary of the invention
[0004] The embodiments of the present application provide a human-computer interaction method, apparatus, device and storage medium to achieve diversified live broadcast in a virtual space, enhance the fun of live broadcast interaction in a virtual space, and improve the user's immersive live broadcast experience in a virtual space.
[0005] In a first aspect, an embodiment of the present application provides a human-computer interaction method, which is applied to an XR device, and the method includes:
[0006] In response to a selection instruction of a target live broadcast room in the virtual space, a transition screen is called out in the virtual space to present a corresponding transition special effect in the transition screen, wherein the transition screen is between the virtual user and the playback screen;
[0007] When the transition special effect ends, the transition screen is closed, and the live broadcast content of the target live broadcast room is presented in the playback screen.
[0008] In a second aspect, an embodiment of the present application provides a human-computer interaction device, which is configured in an XR device, and the device includes:
[0009] A transition special effect presentation module, for responding to a selection instruction of a target live broadcast room in a virtual space, calling out a transition screen in the virtual space to present a corresponding transition special effect in the transition screen, wherein the transition screen is between the virtual user and the playback screen;
[0010] The live broadcast presentation module is used to close the transition screen when the transition special effect ends presentation, and present the live broadcast content of the target live broadcast room in the playback screen.
[0011] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising:
[0012] A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the human-computer interaction method provided in the first aspect of the present application.
[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, which enables a computer to execute the human-computer interaction method provided in the first aspect of the present application.
[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, which enable a computer to execute the human-computer interaction method provided in the first aspect of the present application.
[0015] Through the technical solution of this application, when a target live broadcast room is selected for presentation in the virtual space, a transition screen will first be called out between the virtual user and the playback screen in the virtual space to present the corresponding transition special effects to support the preprocessing of the live content of the target live broadcast room in the playback screen. Then, when the transition special effects finish presentation, the transition screen can be closed, and the live content of the target live broadcast room can be quickly presented in the playback screen, thereby achieving efficient live broadcast of the target live broadcast room in the virtual space and ensuring diversified live broadcast effects in the virtual space. Through the presentation of transition special effects, the fun of live broadcast interaction and the user interaction atmosphere in the virtual space are enhanced, thereby improving the user's immersive live broadcast experience in the virtual space. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0017] Figure 1 A flowchart of a human-computer interaction method provided in an embodiment of the present application;
[0018] Figure 2 An exemplary schematic diagram of an application scenario of a virtual space provided in an embodiment of the present application;
[0019] Figure 3A schematic diagram of the principle of calling out a transition screen in a virtual space provided in an embodiment of the present application;
[0020] Figure 4a A schematic diagram of the principle of switching the current live broadcast room to the target live broadcast room provided in an embodiment of the present application;
[0021] Figure 4b A schematic diagram of the principle of selecting a target live broadcast room from a live broadcast room list provided in an embodiment of the present application;
[0022] Figure 5 A flowchart of a method for presenting a specific process of a transition effect on a transition screen provided in an embodiment of the present application;
[0023] Figure 6 A schematic diagram of a human-computer interaction device provided in an embodiment of the present application;
[0024] Figure 7 It is a schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0027] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or scheme described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0028] In order to avoid the problem of a relatively single live broadcast presentation effect when a user selects a live broadcast room in a virtual space for live broadcast viewing, the inventive concept of the present application is: when a selection instruction of a target live broadcast room in a virtual space is detected, a transition screen is first called out between the virtual user and the playback screen to present the corresponding transition special effects. Then, when the transition special effect ends, the transition screen can be closed, and the live broadcast content of the target live broadcast room can be quickly presented on the playback screen, thereby achieving efficient live broadcast of the target live broadcast room in the virtual space and ensuring diversified live broadcast effects in the virtual space. By presenting transition special effects before the formal presentation of the live broadcast, the fun of live broadcast interaction and the user interaction atmosphere in the virtual space are enhanced.
[0029] Figure 1 A flowchart of a human-computer interaction method provided in an embodiment of the present application, which can be applied to XR devices, but is not limited thereto. The method can be executed by the human-computer interaction device provided in the present application, wherein the human-computer interaction device can be implemented by any software and / or hardware. Exemplarily, the human-computer interaction device can be configured in an electronic device such as AR / VR / MR that can simulate a virtual scene, and the present application does not impose any restrictions on the specific type of electronic device.
[0030] Specifically, Figure 1 As shown, the method may include the following steps:
[0031] S110, in response to a selection instruction of a target live broadcast room in the virtual space, calling out a transition screen in the virtual space to present corresponding transition special effects in the transition screen.
[0032] In this application, the virtual space can be a corresponding virtual environment simulated by the XR device for a live broadcast scene selected by any user, so as to display the corresponding live broadcast interactive information in the virtual space. For example, the anchor is supported to select a certain type of live broadcast scene to build a corresponding virtual live broadcast environment as the virtual space in this application, so that each audience can enter the virtual space to realize the corresponding live broadcast interaction.
[0033] The virtual space can be a simulation of the real world, a semi-simulated and semi-fictional virtual scene, or a purely fictional virtual scene.
[0034] Usually, after the user puts on the XR device, he turns on the XR device to put it in working state. Then, the XR device can simulate a specific virtual scene for the user after the real scene and the virtual scene are merged, so that the user enters the pre-built virtual space.
[0035] It is understandable that in order to ensure the live interaction of users in any live broadcast room in the virtual space, multiple virtual screens such as corresponding live broadcast screens, control screens and public screens can be set in the virtual space to facilitate users to perform different live broadcast functions. Among them, the playback screen in this application can be used to present the live content of any live broadcast room that the user wants to watch after obtaining the live stream of the live broadcast room, so that the user can immerse himself in the virtual space and feel the spatial sense and stereoscopic sense of the three-dimensional live interaction.
[0036] Moreover, if Figure 2 As shown, the virtual space of the present application may include two parts: a 3D video playback field and a Unity interactive field. Among them, the Unity interactive field can be used to present various virtual objects constructed by users using the Unity engine for corresponding live scenes, so as to support users to manipulate virtual controllers to generate corresponding interactive operations with various virtual objects. The 3D video playback field can be used to present the live video stream of any live room that users choose to watch, as well as the interactive special effects generated by users performing various interactive operations on various virtual objects.
[0037] Then, in order to ensure the accuracy of live broadcast in virtual space, this application will set up a playback field screen in the 3D video playback field, so that after obtaining the live stream of any live room that the user wants to watch, the live content of the live room will be presented in the playback field screen by performing corresponding processing on the live stream.
[0038] In this application, after a user enters a virtual space, if he wants to watch the live content of a certain live room, he will select the target live room from multiple live rooms in the virtual space. Therefore, after entering the virtual space, the selection command initiated by the user for any live room will be detected in real time. When the selection command of the target live room in the virtual space is detected, it means that the user currently wants to watch the live content of the target live room in the virtual space.
[0039] However, it takes a certain amount of time to obtain the live stream of the target live room, and it is impossible to instantly present the live content of the target live room on the playback screen. Therefore, in order to ensure the fun of the live interaction of users in the virtual space, the present application can first determine the relative position relationship between the virtual user in the virtual space and the playback screen in response to the selection instruction of the target live room. Then, according to the relative position relationship, such as Figure 3 As shown, a transition screen is called out between the virtual user and the playback screen, and the corresponding transition effects are presented in the transition screen, so as to reserve a certain time for acquiring the live stream of the target live room, so as to support the preprocessing of the live content of the target live room in the playback screen.
[0040] It is understandable that the transition effects in this application can be a pre-set transition animation, or a live frame in the target live room or a live room being presented before the target live room, and this application does not limit this. Figure 2 As shown, in order to ensure the user's sense of space and stereoscopic sense of live interaction in the virtual space, the playback screen and the transition screen can be a three-dimensional spherical panoramic display screen, such as the inner surface of a three-dimensional sphere with different radii presented around the user.
[0041] Moreover, from the perspective of the virtual user, the transition screen will block the playback screen behind it, which means that the live content presented in the playback screen will not affect the presentation of the transition effects. Therefore, when the corresponding transition effects are presented in the transition screen, the playback screen can continue to present the previously presented live content normally, or it can pre-present the first frame of live content in the target live room after pre-processing. Then, there is no need to switch to the transition effects first, and then switch to the live content of the target live room in the playback screen. You can directly switch to the live content of the target live room, thereby reducing the playback jamming caused by frequent video switching.
[0042] As an optional implementation scheme in the present application, for calling out the transition screen, the present application can be implemented through the following steps: based on the field of view of the virtual user in the virtual space and the position of the playback screen, calling out the transition screen in the virtual space; presenting the corresponding transition special effects in the transition screen.
[0043] That is to say, in order to ensure that the user can intuitively and comprehensively view the transition effects, the transition screen must be within the user's field of view in the virtual space. Therefore, according to the user's position and head orientation in the virtual space, the field of view of the virtual user in the virtual space can be determined. Then, Figure 3 As shown, according to the position of the playback screen in the virtual space, a position can be determined from the area in front of the playback screen within the field of view of the virtual user, and a transition screen can be called out at the position. Then, the corresponding transition effect is immediately presented in the transition screen, so that the virtual user can intuitively and comprehensively view the transition effect without affecting the live content presented in the playback screen behind.
[0044] S120, when the transition special effect ends, the transition screen is closed, and the live broadcast content of the target live broadcast room is presented on the playback screen.
[0045] During the presentation of the transition special effects, the XR device will continuously obtain the live stream of the target live broadcast room from the service background and perform corresponding analysis and processing on the live stream. Therefore, when the transition special effects are finished, in order to ensure the success of the live broadcast of the target live broadcast room in the virtual space, this application can directly close the transition screen in the virtual space, and present the live content of the live stream of the target live broadcast room after analysis and processing in real time on the playback screen, thereby achieving efficient live broadcast of the target live broadcast room in the virtual space and ensuring diversified live broadcast effects in the virtual space.
[0046] The technical solution provided by the embodiment of the present application, when a target live broadcast room is selected for presentation in the virtual space, will first call out a transition screen between the virtual user and the playback screen in the virtual space to present the corresponding transition special effects, so as to support the preprocessing of the live content of the target live broadcast room in the playback screen. Then, when the transition special effects finish presentation, the transition screen can be closed, and the live content of the target live broadcast room can be quickly presented in the playback screen, thereby achieving efficient live broadcast of the target live broadcast room in the virtual space and ensuring diversified live broadcast effects in the virtual space. Through the presentation of transition special effects, the fun of live broadcast interaction and the user interaction atmosphere in the virtual space are enhanced, and the user's immersive live broadcast experience in the virtual space is improved.
[0047] As an optional implementation scheme in this application, in order to ensure the accurate live broadcast of the target live broadcast room in the virtual space, the user can select the target live broadcast room that he wants to watch in the virtual space in a variety of ways. Next, this application can explain in detail the specific process of selecting the target live broadcast room in the virtual space from the two aspects of switching live broadcast from a certain live broadcast room to the target live broadcast room and directly selecting the target live broadcast room in the live broadcast room list.
[0048] 1) Switching live broadcast from a live broadcast room to the target live broadcast room
[0049] When the live broadcast content of a live broadcast room is currently displayed in the playback field screen in the virtual space, this application can use the live broadcast room as the current live broadcast room. Then, when the user is watching the live broadcast content of the current live broadcast room, he may want to switch to another live broadcast room instead of watching the content of the current live broadcast room.
[0050] In this case, the virtual user can manipulate the virtual controller in the virtual space to perform a corresponding live broadcast switching operation on the current live broadcast room presented in the playback field screen, such as manipulating the virtual controller to click a live broadcast switching option button displayed in the playback field screen. Then, when it is detected that the virtual user performs a corresponding live broadcast switching operation on the current live broadcast room, a live broadcast switching request initiated by the virtual user for the current live broadcast room presented in the playback field screen of the virtual space can be generated. Then, in response to the live broadcast switching request initiated by the virtual user for the current live broadcast room presented in the playback field screen of the virtual space, an associated live broadcast room panel of the current live broadcast room can be presented in the virtual space.
[0051] That is to say, when a live broadcast switching request initiated by a virtual user for the current live broadcast room presented in the playback field screen of the virtual space is detected, it means that the user does not want to continue watching the live broadcast content of the current live broadcast room, but wants to watch the live broadcast content of other live broadcast rooms. Therefore, in order to ensure convenient switching of live broadcasts in the virtual space, this application can first determine the various related live broadcast rooms of the current live broadcast room according to the user's live broadcast viewing habits. Then, the related live broadcast room panel of the current live broadcast room is presented in the virtual space, and the related live broadcast room panel can include multiple other live broadcast rooms for users to filter.
[0052] In some possible implementations, in order to ensure the convenience of live broadcast switching in the virtual space, such as Figure 4a As shown, the present application can adsorb the associated live broadcast room panel of the current live broadcast room onto a virtual controller controlled by a virtual user for close presentation, thereby supporting the user to perform various close operations on the associated live broadcast room panel of the current live broadcast room.
[0053] Then, the virtual controller in the free state can perform corresponding sliding operations in the associated live room panel of the current live room under the control of the virtual user, so that the virtual user can fully view each live room in the associated live room panel. Furthermore, when the virtual user wants to watch the target live room in the associated live room panel, he can control the virtual controller to perform the corresponding switching trigger operation on the target live room in the associated live room panel. Then, when the switching trigger operation of the target live room in the associated live room panel is detected, it means that the user wants to switch to watch the live content of the target live room, thereby generating a selection instruction for the target live room, so as to trigger the specific steps of executing the subsequent transition special effects presentation and the presentation of the live content of the target live room.
[0054] 2) Select the target live room directly in the live room list
[0055] After the user enters the virtual space, if the live broadcast content of any live broadcast room has not been presented in the virtual space's playback screen, then a corresponding live broadcast room list can be presented in the virtual space, so that the virtual user can select the target live broadcast room that he wants to watch from the live broadcast room list. Alternatively, if the live broadcast content of the current live broadcast room has been presented in the virtual space's playback screen, and the user does not want to continue watching the live broadcast content of the current live broadcast room, then the virtual user can control the virtual controller to exit the current live broadcast room, thereby returning to the corresponding live broadcast room list in the virtual space, so that the virtual user can continue to select the target live broadcast room that he wants to watch from the live broadcast room list.
[0056] It is understandable that the live broadcast room list in the present application may include multiple live broadcast rooms, and a corresponding live broadcast cover is set for each live broadcast room so that virtual users can accurately distinguish between each live broadcast room.
[0057] In some possible implementations, in order to ensure an interesting preview of the live broadcast cover of each live broadcast room in the live broadcast room list, such as Figure 4b As shown, a live broadcast window can be opened for each live broadcast room in the live broadcast room list, and a corresponding playback field sub-screen will be provided on the side of the live broadcast window of each live broadcast room away from the virtual user to present the live broadcast cover of the live broadcast room.
[0058] That is to say, from the perspective of the virtual user, the playback screen corresponding to the live broadcast window of each live broadcast room will be behind the live broadcast room list. Then, the virtual user can watch the live broadcast cover presented in the corresponding playback screen of each live broadcast room through the live broadcast window of each live broadcast room in the live broadcast room list. Moreover, when the virtual user keeps moving in the virtual space, the viewing angle range of the live broadcast window of each live broadcast room in the live broadcast room list will also change. Then, the viewing angle of the live broadcast cover presented in the corresponding playback screen of each live broadcast room viewed by the virtual user through the live broadcast window of each live broadcast room in the live broadcast room list will also change, thereby enhancing the presentation interest of each live broadcast room in the live broadcast room list.
[0059] Therefore, when a list of live broadcast rooms is presented in the virtual space, if the virtual user wants to watch a target live broadcast room in the list of live broadcast rooms, the virtual controller can be manipulated to perform a corresponding live broadcast trigger operation on the target live broadcast room in the list of live broadcast rooms. Then, when it is detected that the virtual user has performed a live broadcast trigger operation on a target live broadcast room in the list of live broadcast rooms presented in the virtual space, it indicates that the user wants to watch the live broadcast content of the target live broadcast room, thereby generating a selection instruction for the target live broadcast room, so as to trigger the specific steps of executing the subsequent presentation of transition special effects and the presentation of the live broadcast content of the target live broadcast room.
[0060] The technical solution provided in the embodiment of the present application supports users in selecting a target live broadcast room in a virtual space for live broadcast presentation by switching live broadcast from a certain live broadcast room to a target live broadcast room and directly selecting a target live broadcast room in a live broadcast room list, thereby ensuring the scalability of application scenarios of live broadcast interaction in the virtual space and enhancing the diversity of live broadcast interaction in the virtual space.
[0061] According to one or more embodiments of the present application, the network transmission efficiency of the scene in which the XR device is located will directly affect the live stream acquisition rate of the target live broadcast room. It is explained that in different network scenarios, the transition duration requirements for transition effects are different, so that different transition effects can be presented in the transition screen. The present application can provide a detailed explanation of the specific process of presenting transition effects in the transition screen.
[0062] Figure 5 A flowchart of a method for presenting a specific process of a transition effect on a transition screen provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the method may include the following steps:
[0063] S510, determining corresponding transition effects and transition duration according to the live stream acquisition rate of the target live broadcast room.
[0064] After detecting the selection instruction of the target live broadcast room in the virtual space, the live broadcast stream of the target live broadcast room will be continuously obtained from the service background, based on which the live broadcast stream acquisition rate of the target live broadcast room can be determined.
[0065] It is understandable that the faster the live stream of the target live room is obtained, the shorter the period of time it will take to successfully present the live content of the target live room on the playback screen of the virtual space; and the slower the live stream of the target live room is obtained, the longer the period of time it will take to successfully present the live content of the target live room on the playback screen of the virtual space.
[0066] Therefore, by analyzing the live stream acquisition rate of the target live broadcast room, it is possible to determine the length of the presentation delay required for the live content of the target live broadcast room to be normally presented on the playback screen. The presentation delay of the live content of the target live broadcast room on the playback screen can be represented by the presentation time of the transition special effect.
[0067] Therefore, if the target live broadcast room's live stream acquisition rate is fast, it means that the target live broadcast room's live stream can be successfully acquired in a short time to ensure the successful presentation of the target live broadcast room's live content on the playback screen, then a relatively short transition duration can be determined for the transition special effect. If the target live broadcast room's live stream acquisition rate is slow, it means that it takes a long time to successfully acquire the target live broadcast room's live stream to ensure the successful presentation of the target live broadcast room's live content on the playback screen, then a relatively long transition duration can be determined for the transition special effect.
[0068] Moreover, if the target live broadcast room's live stream acquisition rate is fast, it means that the target live broadcast room's live content will be successfully presented on the playback screen in a short time. Then, in order to prevent users from being affected by other irrelevant pictures on the target live broadcast room in a short time, this application can determine the corresponding transition effects according to the target live broadcast room's related live broadcast pictures, such as the target live broadcast room's live cover or the live broadcast frame of a live broadcast room that the target live broadcast room switched to before.
[0069] As an optional implementation scheme in the present application, in order to ensure the compatibility of the transition special effects with the presentation of the target live broadcast room, the present application can determine the corresponding transition special effects and transition duration through the following steps: if the live stream acquisition rate of the target live broadcast room is greater than or equal to the preset acquisition rate, then determine the selected source page and the first transition duration of the target live broadcast room; if the selected source page is the associated live broadcast room panel of the current live broadcast room presented in the playback field screen, then determine the current live broadcast frame presented in the playback field screen as the transition frame corresponding to the transition special effect; if the selected source page is a live broadcast room list presented in the virtual space, then determine the live cover of the target live broadcast room in the live broadcast room list as the transition frame corresponding to the transition special effect; if the live stream acquisition rate of the target live broadcast room is less than the preset acquisition rate, then use the preset picture under the live broadcast type of the target live broadcast room as the transition frame corresponding to the transition special effect, and determine the second transition duration.
[0070] That is to say, in order to intuitively analyze the speed of the live stream acquisition rate of the target live broadcast room, the present application can set an acquisition rate reference value as the preset acquisition rate in the present application.
[0071] If the target live broadcast room's live stream acquisition rate is greater than or equal to the preset acquisition rate, it means that the target live broadcast room's live stream acquisition is fast, and the target live broadcast room's live content can be successfully presented on the playback screen in a short time. Therefore, a relatively short presentation duration can be determined for the transition special effect as the first transition duration.
[0072] Moreover, in order to prevent users from being affected by other irrelevant images in the live broadcast of the target live broadcast room in a short period of time, it is required that there is a certain correlation between the transition special effects and the relevant live broadcast images of the target live broadcast room. When the user selects the target live broadcast room in the virtual space, it can be selected when switching the live broadcast of the current live broadcast room that has been presented, or it can be selected directly from the live broadcast room list. Different selection methods of the target live broadcast room will have different related live broadcast images, which will also result in different transition special effects. Therefore, in order to ensure the user's immersive viewing of the transition special effects and avoid the sense of separation between the transition special effects and the target live broadcast room when the live stream of the target live broadcast room is obtained faster, this application can determine the selected source page of the target live broadcast room according to the selection method of the target live broadcast room. The selected source page indicates which interface presented in the virtual space the user selected the target live broadcast room from.
[0073] If the selected source page is the associated live room panel of the current live room presented in the playback field screen, it means that the target live room is obtained by switching the live broadcast of the current live room presented in the playback field screen. Then, in order to enhance the live broadcast switching effect in the virtual space, the present application can directly intercept the presented current live frame from the live content of the current live room presented in the playback field screen. Then, the current live frame in the current live room is used as the transition frame corresponding to the transition special effect, so that in the subsequent transition special effect presentation process, the transition frame can be used to dynamically present the virtual user to form an effect that the current live room swallows the user and enters the target live room, thereby enhancing the interactive fun of the transition special effects in the virtual space.
[0074] If the selected source page is a list of live broadcast rooms presented in the virtual space, it means that the live broadcast content of other live broadcast rooms has not been presented before the target live broadcast room, but the target live broadcast room is selected by the live broadcast cover in the live broadcast room list. Therefore, in order to enhance the live broadcast switching effect in the virtual space, this application can directly obtain the live broadcast cover of the target live broadcast room in the live broadcast room list, and use the live broadcast cover as the transition frame corresponding to the transition special effect, so that in the subsequent transition special effect presentation process, the user can adapt to the live broadcast atmosphere of the target live broadcast room in advance.
[0075] However, if the live stream acquisition rate of the target live room is less than the preset acquisition rate, it means that the live stream acquisition of the target live room is slow, and it takes a long time to successfully present the live content of the target live room on the playback screen. Therefore, a relatively long presentation duration can be determined for the transition effect as the second transition duration. Among them, the first transition duration is less than the second transition duration.
[0076] It is understandable that the transition time of the target live broadcast room is longer, and the transition special effects can present the live content of the target live broadcast room on the playback screen after a long time, which will not cause a sense of disconnection to the user's immersive live broadcast viewing in the virtual space.
[0077] Therefore, in order to ensure the adaptability of the transition special effect and the target live broadcast room, the present application can directly pre-set a transition screen according to the live broadcast type of the target live broadcast room. Then, when the target live broadcast room is selected for presentation in the virtual space, and the live stream of the target live broadcast room is acquired slowly, the preset screen under the live broadcast type of the target live broadcast room can be directly used as the transition frame corresponding to the transition special effect, so that in the subsequent transition special effect presentation process, the preset screen can be used to dynamically present the virtual user's perspective to form an effect that a user enters the target live broadcast room through a tunnel, thereby enhancing the interactive fun of the transition special effect in the virtual space.
[0078] S520: Present a transition effect on the transition screen according to the transition duration.
[0079] After the corresponding transition special effect and transition duration are determined, the corresponding dynamic presentation of the transition special effect that is continuously executed in the transition screen can be controlled within the transition duration.
[0080] As an optional implementation scheme in the present application, in order to realize the diversity of presentation of transition special effects in the transition screen, the present application can specifically illustrate the presentation process of transition special effects in the transition screen through the following steps:
[0081] The first step is to determine the corresponding transition entry period, transition presentation period and transition exit period according to the transition duration and the selected time point of the target live broadcast room.
[0082] If the transition special effect is realized by presenting a transition frame in the transition screen, then the dynamic presentation stage of the transition frame in the transition screen needs to be divided. In the present application, the dynamic presentation stage of the transition frame in the transition screen can be divided into three stages: the transition entry stage, the transition presenting stage and the transition leaving stage.
[0083] Moreover, corresponding presentation durations can be set for different stages. Exemplarily, since the transition entry stage and the transition exit stage in the present application are mainly used to display the preliminary presentation and exit presentation of the transition frame in the transition screen, and the preliminary presentation and exit presentation usually require a certain duration. Therefore, the present application can pre-set a fixed duration for the transition entry stage and the transition exit stage, such as 1.5s, etc. Then, the transition presentation stage can be determined by the transition duration determined by the live stream acquisition rate of the target live broadcast room and the fixed durations of the other two stages.
[0084] Therefore, the duration of each of the three stages, namely, the transition entry stage, the transition presentation stage, and the transition exit stage, can be analyzed according to the corresponding transition duration. Then, starting from the selected time point of the target live broadcast room, the corresponding transition entry period, transition presentation period, and transition exit period can be determined in turn according to the duration of each stage.
[0085] The second step is to present the entry effects of the transition frame on the transition screen during the transition entry period.
[0086] During the transition entry period, the corresponding images of the transition frame can be gradually presented in the transition screen from any position in the transition screen until the entire transition frame is completely presented in the transition screen, thereby generating the transition frame entry effect. For example, the transition frame entry effect can be that the transition frame is gradually presented from the center point of the transition screen and dynamically covers the entire transition screen.
[0087] In some implementable methods, if the selected source page of the target live room is the associated live room panel of the current live room presented in the playback field screen, it means that the target live room is obtained by switching the current live room. Then, the live content of the current live room will be presented in the playback field screen. When the transition frame is just presented during the transition entry period, the presentation of the live content of the current live room will not affect the entry special effect of the transition frame. Therefore, during the transition entry period, it can be determined that the current live room is in a normal presentation state in the playback field screen. In other words, the playback field screen can normally present the live content of the current live room during the transition entry period without pausing it.
[0088] The third step is to present the transition frame's presentation effects on the transition screen during the transition presentation period.
[0089] During the transition presentation period, the transition frame has been completely presented in the entire transition screen. Then, the complete presentation state of the transition frame in the transition screen can be maintained during the transition presentation period, and the special effects of the transition frame being presented can be presented in the transition screen. Moreover, in order to enhance the transition effect in the virtual space, the present application can also additionally present information such as operation prompts of the corresponding live interaction on the basis of the transition frame presented in the transition screen to ensure the accuracy of the live interaction in the virtual space.
[0090] In some implementable methods, if the selected source page of the target live broadcast room is the associated live broadcast room panel of the current live broadcast room presented in the playback field screen, then the live broadcast content of the current live broadcast room will be presented in the playback field screen. During the transition presentation period, the normal presentation stage of the transition special effect has been entered, so it is necessary to exclude the effect of the live broadcast content of the current live broadcast room on the presentation of the transition special effect. Therefore, during the transition presentation period, it can be determined that the current live broadcast room is in a suspended presentation state in the playback field screen, so that the presentation of the live broadcast content of the current live broadcast room is suspended in the playback field screen.
[0091] The fourth step is to present the leaving special effect of the transition frame on the transition screen during the transition leaving period.
[0092] During the transition leaving period, the live stream of the target live broadcast room has been acquired and can be successfully presented on the playback screen. Then, starting from any position on the transition screen, the corresponding screen of the transition frame can be gradually cancelled on the transition screen until the transition frame completely exits the presentation on the transition screen, thereby generating the transition frame leaving special effect.
[0093] In some implementable ways, if the selected source page of the target live broadcast room is the associated live broadcast room panel of the current live broadcast room presented in the playback field screen, then during the transition presentation period, the live broadcast content of the current live broadcast room will be suspended in the playback field screen. Since the transition departure period is short, the present application can switch the live broadcast content of the current live broadcast room to the live broadcast content of the target live broadcast room in the playback field screen during the transition departure period, and make the target live broadcast room pre-presented during the transition departure period. At this time, the live broadcast content pre-presented by the target live broadcast room is relatively short, and on the basis of not affecting the user's viewing of the target live broadcast room, it can ensure the smoothness of the start of the live broadcast content of the target live broadcast room in the playback field screen.
[0094] The technical solution provided in the embodiment of the present application determines the corresponding transition effects and transition duration according to the live stream acquisition rate of the target live broadcast room, and sets different presentation styles for the transition effects in the transition screen according to different scenes, thereby enhancing the diversified transitions and interactive fun in the virtual space.
[0095] Figure 6 This is a schematic diagram of a human-computer interaction device provided in an embodiment of the present application. The human-computer interaction device 600 can be configured in an XR device. The human-computer interaction device 600 includes:
[0096] A transition special effect presentation module 610 is used to respond to a selection instruction of a target live broadcast room in the virtual space, call out a transition screen in the virtual space, and present a corresponding transition special effect in the transition screen, wherein the transition screen is between the virtual user and the playback screen;
[0097] The live broadcast presentation module 620 is used to close the transition screen and present the live broadcast content of the target live broadcast room in the playback screen when the transition special effect ends presentation.
[0098] In some implementations, the transition special effect presentation module 610 may be specifically used for:
[0099] Calling out a transition screen in the virtual space according to the field of view of the virtual user in the virtual space and the position of the playback screen;
[0100] The corresponding transition special effect is presented in the transition screen.
[0101] In some implementations, the selection instruction of the target live broadcast room in the virtual space is determined by the following live broadcast room selection module. The live broadcast room selection module can be used to:
[0102] In response to a live broadcast switching request initiated by the virtual user for a current live broadcast room presented in a playback field screen of the virtual space, presenting a live broadcast room panel associated with the current live broadcast room in the virtual space;
[0103] In response to a switching trigger operation of a target live broadcast room in the associated live broadcast room panel, generating a selection instruction of the target live broadcast room; or,
[0104] In response to the live broadcast triggering operation of the virtual user on a target live broadcast room in the live broadcast room list presented in the virtual space, a selection instruction of the target live broadcast room is generated.
[0105] In some implementations, the transition special effect presentation module 610 may include:
[0106] A transition determination unit, used to determine corresponding transition effects and transition duration according to the live stream acquisition rate of the target live broadcast room;
[0107] A transition presentation unit is used to present the transition special effect in the transition screen according to the transition duration.
[0108] In some possible implementations, the transition determination unit may be specifically configured to:
[0109] If the live stream acquisition rate of the target live room is greater than or equal to the preset acquisition rate, determining the selected source page and the first transition duration of the target live room;
[0110] If the selected source page is a live broadcast room panel associated with the current live broadcast room presented in the play field screen, determining the current live broadcast frame presented in the play field screen as the transition frame corresponding to the transition special effect;
[0111] If the selected source page is a list of live broadcast rooms presented in the virtual space, determining the live broadcast cover of the target live broadcast room in the live broadcast room list as a transition frame corresponding to the transition special effect;
[0112] If the live stream acquisition rate of the target live broadcast room is less than the preset acquisition rate, the preset picture under the live broadcast type of the target live broadcast room is used as the transition frame corresponding to the transition special effect, and the second transition duration is determined;
[0113] Among them, the first transition duration is shorter than the second transition duration.
[0114] In some possible implementations, the transition presentation unit may be specifically used for:
[0115] According to the transition duration and the selected time point of the target live broadcast room, determine the corresponding transition entry period, transition presenting period and transition exit period;
[0116] During the transition entry period, presenting an entry special effect of the transition frame on the transition screen;
[0117] During the transition presenting period, presenting the presenting special effect of the transition frame in the transition screen;
[0118] During the transition leaving period, a leaving special effect of the transition frame is presented on the transition screen.
[0119] In some implementations, if the selected source page of the target live broadcast room is the associated live broadcast room panel of the current live broadcast room presented in the playback field screen, the human-computer interaction device 600 may further include a live broadcast switching processing module. The live broadcast switching processing module may be used to:
[0120] During the transition entry period, determining that the current live broadcast room is in a normal presentation state on the playback screen;
[0121] During the transition presentation period, determining that the current live broadcast room is in a pause presentation state in the playback screen;
[0122] During the transition leaving period, the live broadcast content of the current live broadcast room is switched to the live broadcast content of the target live broadcast room for presentation on the playback screen.
[0123] In some possible implementations, a live broadcast window is opened for each live broadcast room in the live broadcast room list, and a corresponding playback sub-screen is provided on the side of the live broadcast window of each live broadcast room facing away from the virtual user to present the live broadcast cover of the live broadcast room.
[0124] In some possible implementations, the playback screen and the transition screen are three-dimensional spherical panoramic display screens.
[0125] In an embodiment of the present application, when a target live broadcast room is selected for presentation in a virtual space, a transition screen will first be called out between the virtual user and the playback screen in the virtual space to present the corresponding transition special effects, so as to support the preprocessing of the live content of the target live broadcast room in the playback screen. Then, when the transition special effects finish presentation, the transition screen can be closed, and the live content of the target live broadcast room can be quickly presented in the playback screen, thereby achieving efficient live broadcast of the target live broadcast room in the virtual space and ensuring diversified live broadcast effects in the virtual space. Through the presentation of transition special effects, the fun of live broadcast interaction and the user interaction atmosphere in the virtual space are enhanced, and the user's immersive live broadcast experience in the virtual space is improved.
[0126] It should be understood that the device embodiment and the method embodiment in the present application may correspond to each other, and similar descriptions may refer to the method embodiment in the present application. To avoid repetition, they will not be described here.
[0127] Specifically, Figure 6 The device 600 shown can execute any method embodiment provided in this application, and Figure 6 The aforementioned and other operations and / or functions of each module in the illustrated device 600 are respectively for implementing the corresponding processes of the above method embodiment, and for the sake of brevity, they are not described again here.
[0128] The above method embodiment of the embodiment of the present application is described from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above method embodiment in conjunction with its hardware.
[0129] Figure 7 It is a schematic block diagram of an electronic device provided in an embodiment of the present application.
[0130] like Figure 7 As shown, the electronic device 700 may include:
[0131] The memory 710 and the processor 720, the memory 710 is used to store the computer program and transmit the program code to the processor 720. In other words, the processor 720 can call and run the computer program from the memory 710 to implement the method in the embodiment of the present application.
[0132] For example, the processor 720 may be configured to execute the above method embodiments according to instructions in the computer program.
[0133] In some embodiments of the present application, the processor 720 may include but is not limited to:
[0134] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
[0135] In some embodiments of the present application, the memory 710 includes but is not limited to:
[0136] Volatile memory and / or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).
[0137] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 710 and executed by the processor 720 to complete the method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device 700.
[0138] like Figure 7 As shown, the electronic device may also include:
[0139] The transceiver 730 may be connected to the processor 720 or the memory 710 .
[0140] The processor 720 may control the transceiver 730 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 730 may include a transmitter and a receiver. The transceiver 730 may further include an antenna, and the number of antennas may be one or more.
[0141] It should be understood that the various components in the electronic device 700 are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.
[0142] The present application also provides a computer storage medium on which a computer program is stored. When the computer program is executed by a computer, the computer is enabled to execute the method of the above method embodiment.
[0143] The embodiment of the present application also provides a computer program product including instructions, which, when executed by a computer, enables the computer to execute the method of the above method embodiment.
[0144] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.
[0145] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A human-computer interaction method, characterized in that: Applied to an extended reality (XR) device, the method comprises: In response to a selection instruction of a target live broadcast room in the virtual space, a transition screen is called out in the virtual space to present a corresponding transition special effect in the transition screen, wherein the transition screen is between the virtual user and the playback screen; When the transition special effect ends, the transition screen is closed, and the live broadcast content of the target live broadcast room is presented in the playback screen.
2. The method according to claim 1, characterized in that The calling out of the transition screen in the virtual space to present the corresponding transition special effect in the transition screen includes: Calling out a transition screen in the virtual space according to the field of view of the virtual user in the virtual space and the position of the playback screen; The corresponding transition special effect is presented in the transition screen.
3. The method according to claim 1, characterized in that The selection instruction of the target live broadcast room in the virtual space is determined by the following steps: In response to a live broadcast switching request initiated by the virtual user for a current live broadcast room presented in a playback field screen of the virtual space, presenting a live broadcast room panel associated with the current live broadcast room in the virtual space; In response to a switching trigger operation of a target live broadcast room in the associated live broadcast room panel, generating a selection instruction of the target live broadcast room; or, In response to the live broadcast triggering operation of the virtual user on a target live broadcast room in the live broadcast room list presented in the virtual space, a selection instruction of the target live broadcast room is generated.
4. The method according to claim 1 or 3, characterized in that: The presenting of the corresponding transition special effect in the transition screen includes: Determine the corresponding transition effect and transition duration according to the live stream acquisition rate of the target live broadcast room; The transition special effect is presented in the transition screen according to the transition duration.
5. The method according to claim 4, characterized in that The determining of the corresponding transition effect and transition duration according to the live stream acquisition rate of the target live broadcast room includes: If the live stream acquisition rate of the target live room is greater than or equal to the preset acquisition rate, determining the selected source page and the first transition duration of the target live room; If the selected source page is a live broadcast room panel associated with the current live broadcast room presented in the play field screen, determining the current live broadcast frame presented in the play field screen as the transition frame corresponding to the transition special effect; If the selected source page is a list of live broadcast rooms presented in the virtual space, determining the live broadcast cover of the target live broadcast room in the live broadcast room list as a transition frame corresponding to the transition special effect; If the live stream acquisition rate of the target live broadcast room is less than the preset acquisition rate, the preset picture under the live broadcast type of the target live broadcast room is used as the transition frame corresponding to the transition special effect, and the second transition duration is determined; Among them, the first transition duration is shorter than the second transition duration.
6. The method according to claim 5, characterized in that The presenting the transition special effect in the transition screen according to the transition duration includes: According to the transition duration and the selected time point of the target live broadcast room, determine the corresponding transition entry period, transition presenting period and transition exit period; During the transition entry period, presenting an entry special effect of the transition frame on the transition screen; During the transition presenting period, presenting the presenting special effect of the transition frame in the transition screen; During the transition leaving period, a leaving special effect of the transition frame is presented on the transition screen.
7. The method according to claim 6, characterized in that If the selected source page is a live broadcast room panel associated with the current live broadcast room presented in the playback field screen, the method further includes: During the transition entry period, determining that the current live broadcast room is in a normal presentation state on the playback screen; During the transition presentation period, determining that the current live broadcast room is in a pause presentation state in the playback screen; During the transition leaving period, the live broadcast content of the current live broadcast room is switched to the live broadcast content of the target live broadcast room for presentation on the playback screen.
8. The method according to claim 3, characterized in that A live broadcast window of each live broadcast room is opened in the live broadcast room list, and a corresponding playback field sub-screen is provided on the side of the live broadcast window of each live broadcast room away from the virtual user to present the live broadcast cover of the live broadcast room.
9. The method according to claim 1, characterized in that: The play field screen and the transition screen are three-dimensional spherical panoramic display screens.
10. A human-computer interaction device, characterized in that: Configured in an extended reality XR device, the device includes: A transition special effect presentation module, for responding to a selection instruction of a target live broadcast room in a virtual space, calling out a transition screen in the virtual space to present a corresponding transition special effect in the transition screen, wherein the transition screen is between the virtual user and the playback screen; The live broadcast presentation module is used to close the transition screen when the transition special effect ends presentation, and present the live broadcast content of the target live broadcast room in the playback screen.
11. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the human-computer interaction method according to any one of claims 1 to 9 by executing the executable instructions.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the human-computer interaction method according to any one of claims 1 to 9 is implemented.
13. A computer program product comprising instructions, characterized in that When the computer program product runs on an electronic device, the electronic device executes the human-computer interaction method according to any one of claims 1 to 9.
