Virtual live scene processing method and device, storage medium, and electronic device

Abstract

The present disclosure belongs to the field of live broadcast technology, and relates to a scene processing method and device, storage medium, and electronic device for virtual live broadcast. The method includes: obtaining enhanced experience data of the target audience end and experience enhancement conditions corresponding to the enhanced experience data, and obtaining current scene data in the virtual scene; when the enhanced experience data meets the experience enhancement conditions, the virtual scene is updated by adjusting the current scene data to display the updated virtual scene on the target audience end. The present disclosure uses experience enhancement data to match and judge the enhanced experience data, so as to adjust the current scene data to achieve real-time dynamic update of the virtual scene, and provide users with a differentiated and customized visual experience that is different from the normal virtual live broadcast effect. At the same time, it does not affect the normal viewing experience of other users, achieves the effect of branched display of the same virtual live broadcast, meets the viewing needs of different users, and optimizes the user's virtual live viewing experience in depth and breadth.

Description

Technical Field

[0001] The present disclosure relates to the field of live broadcast technology, and in particular to a virtual live broadcast scene processing method and a virtual live broadcast scene processing device, a computer-readable storage medium, and an electronic device. Background Art

[0002] In current live broadcasts, the scene effects in the live broadcast room are all real-life decorations and are obtained through real shooting. However, virtual live broadcasts can be broadcast by placing portraits in pre-made virtual scenes through the UE (Unreal Engine) server. In comparison, virtual live broadcasts are cheaper because they do not require the purchase of real scenes, and do not require additional entities. They can achieve virtual effects and bring high scalability, so they are gradually being used more in daily live broadcast scenes.

[0003] However, in current virtual live broadcasts, the position of the virtual camera is too fixed and cannot be adjusted, and the performance consumption of the UE engine to render the entire virtual scene is huge, which results in a lot of ineffective overhead. In addition, the fixed position of the camera will also result in a small difference between the actual live broadcast and the regular live broadcast room, making it impossible for users to perceive the optimized experience and usage effect brought by virtual live broadcast.

[0004] In view of this, there is an urgent need in the art to develop a new virtual live scene processing method and device.

[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0006] The purpose of the present disclosure is to provide a scene processing method for virtual live broadcast, a scene processing device for virtual live broadcast, a computer-readable storage medium and an electronic device, so as to at least overcome the technical problems of high performance consumption and poor live broadcast effect caused by the limitations of related technologies to a certain extent.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0008] According to a first aspect of an embodiment of the present invention, a method for processing a virtual live scene is provided, the method comprising:

[0009] Acquire enhanced experience data of the target audience and experience enhancement conditions corresponding to the enhanced experience data, and acquire current scene data in the virtual scene;

[0010] When the enhanced experience data satisfies the experience enhancement condition, the virtual scene is updated by adjusting the current scene data, so as to display the updated virtual scene on the target audience end.

[0011] In an exemplary embodiment of the present invention, the enhanced experience data includes: audience image data and terminal device data.

[0012] In an exemplary embodiment of the present invention, the step of obtaining enhanced experience data of a target audience terminal and an experience enhancement condition corresponding to the enhanced experience data includes:

[0013] Acquire local position data of the target audience terminal, and perform scene depth recognition on the local position data to obtain audience image data;

[0014] The device inclination data of the target audience terminal is obtained, and the device trend determination is performed on the device inclination data to obtain the terminal device data, so as to obtain the experience enhancement conditions corresponding to the audience image data and the terminal device data.

[0015] In an exemplary embodiment of the present invention, the local position data includes: eye position data and pupil position data.

[0016] In an exemplary embodiment of the present invention, the step of performing scene depth recognition on the local position data to obtain audience image data includes:

[0017] Performing scene depth recognition on the pupil position data to obtain a sight line angle, and performing gaze line calculation on the sight line angle and the eye position data to obtain sight line range data;

[0018] The sight range data is cleaned by area range to obtain audience image data.

[0019] In an exemplary embodiment of the present invention, the step of performing device trend determination on the device inclination data to obtain terminal device data includes:

[0020] Performing angle range cleaning on the device inclination data to obtain target inclination data, and performing vector data calculation on the target inclination data to obtain initial device data of the target inclination data;

[0021] The acceleration condition corresponding to the initial device data is acquired, and the inclination data of the initial device data is eliminated by using the acceleration condition to obtain the terminal device data of the target inclination data.

[0022] In an exemplary embodiment of the present invention, before updating the virtual scene by adjusting the current scene data when the enhanced experience data satisfies the experience enhancement condition, the method further includes:

[0023] Performing coordinate mapping processing on the audience image data to determine whether the audience image data meets the experience enhancement condition;

[0024] Performing inclination mapping processing on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition.

[0025] In an exemplary embodiment of the present invention, the performing coordinate mapping processing on the audience image data to determine whether the audience image data satisfies the experience enhancement condition includes:

[0026] Acquire scene space data of the virtual scene, and perform scene hot zone division on the scene space data to obtain divided space data;

[0027] Performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result, and acquiring a counting threshold value corresponding to the counting processing result;

[0028] A counting comparison is performed on the counting processing result and the counting threshold to obtain a counting comparison result, and whether the audience image data meets the experience enhancement condition is determined according to the counting comparison result.

[0029] In an exemplary embodiment of the present invention, the step of performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result includes:

[0030] Performing hot zone counting processing on the audience image data and the divided space data to obtain a plurality of initial counting results;

[0031] The multiple initial counting results are compared to obtain a counting processing result.

[0032] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0033] If the counting processing result is greater than the counting threshold, it is determined that the audience image data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0034] In an exemplary embodiment of the present invention, the performing inclination mapping processing on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition includes:

[0035] Acquire a tilt angle threshold value corresponding to the target tilt angle data, and perform a tilt angle comparison on the target tilt angle data and the tilt angle threshold value to obtain a tilt angle comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the tilt angle comparison result;

[0036] A derivative threshold corresponding to the terminal device data is obtained, and a derivative comparison is performed on the terminal device data and the derivative threshold to obtain a derivative comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the derivative comparison result.

[0037] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0038] If the target inclination data is greater than the inclination threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0039] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0040] If the terminal device data is greater than the derivative threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0041] In an exemplary embodiment of the present invention, the current scene data includes: scene element data, lighting control data and scene camera data.

[0042] In an exemplary embodiment of the present invention, updating the virtual scene by adjusting the current scene data includes:

[0043] Adjusting the scene component data and the scene camera data to trigger component logic events in the virtual scene;

[0044] Adjusting the scene element data, the lighting control data and the scene camera data to trigger a lighting logic event of the virtual scene;

[0045] The scene element data, the lighting control data, and the scene camera data are adjusted to trigger a gameplay logic event of the virtual scene.

[0046] In an exemplary embodiment of the present invention, after updating the virtual scene by adjusting the current scene data, the method further includes:

[0047] Acquire current illumination data of the live broadcast end after the virtual scene is updated, and acquire previous illumination data corresponding to the current illumination data;

[0048] The lighting control data is adjusted according to the current lighting data and the previous lighting data.

[0049] In an exemplary embodiment of the present invention, the step of adjusting the lighting control data according to the current lighting data and the previous lighting data includes:

[0050] Performing illumination comparison processing on the current illumination data and the previous illumination data to obtain illumination difference data, and acquiring a mapping relationship between illumination adjustment conditions and control adjustment modes;

[0051] The illumination difference data and the illumination adjustment condition are matched with each other to determine a target adjustment condition, and the illumination control data is adjusted according to the target adjustment condition and the mapping relationship.

[0052] In an exemplary embodiment of the present invention, updating the virtual scene at the target audience terminal includes:

[0053] Acquire multiple terminal identifiers of all audience terminals before displaying and updating the virtual scene, and determine a target terminal identifier of the target audience terminal from among the multiple terminal identifiers;

[0054] The virtual scene of the target audience terminal is updated according to the target terminal identifier, and the virtual scenes of other audience terminals among the total audience terminals except the target audience terminal are maintained.

[0055] According to a second aspect of an embodiment of the present invention, a virtual live scene processing device is provided, comprising:

[0056] A data acquisition module is configured to acquire enhanced experience data of a target audience and experience enhancement conditions corresponding to the enhanced experience data, and acquire current scene data in a virtual scene;

[0057] The scene update module is configured to update the virtual scene by adjusting the current scene data when the enhanced experience data meets the experience enhancement condition, so as to display the updated virtual scene on the target audience end.

[0058] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor and a memory; wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the scene processing method of the virtual live broadcast in any of the above exemplary embodiments is implemented.

[0059] According to a fourth aspect of an embodiment of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the scene processing method for virtual live broadcast in any of the above exemplary embodiments is implemented.

[0060] It can be seen from the above technical solutions that the virtual live scene processing method, virtual live scene processing device, computer storage medium and electronic device in the exemplary embodiments of the present disclosure have at least the following advantages and positive effects:

[0061] In the method and device provided by the exemplary embodiments of the present disclosure, the enhanced experience data is used to match and judge the enhanced experience data, thereby adjusting the current scene data, realizing real-time dynamic update of the virtual scene, and providing users with a differentiated and customized visual experience that is different from the normal virtual live broadcast effect. At the same time, it does not affect the normal viewing experience of other users, and realizes the effect of branched display of the same virtual live broadcast, meeting the viewing needs and habits of different users, and optimizing the user's virtual live viewing experience in depth and breadth.

[0062] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0064] Figure 1 A schematic diagram schematically illustrates a flow chart of a method for processing a scene of a virtual live broadcast in an exemplary embodiment of the present disclosure;

[0065] Figure 2 A flowchart schematically illustrating a method for acquiring enhanced experience data in an exemplary embodiment of the present disclosure;

[0066] Figure 3 A schematic diagram schematically illustrates a flow chart of a method for scene depth recognition in an exemplary embodiment of the present disclosure;

[0067] Figure 4A flowchart schematically illustrating a method for determining a device trend in an exemplary embodiment of the present disclosure;

[0068] Figure 5 A flowchart schematically illustrates a method for determining whether enhanced experience data meets an experience enhancement condition in an exemplary embodiment of the present disclosure;

[0069] Figure 6 A flowchart schematically illustrating a method for coordinate mapping processing in an exemplary embodiment of the present disclosure;

[0070] Figure 7 A flowchart schematically illustrating a method for hot zone counting processing in an exemplary embodiment of the present disclosure is provided;

[0071] Figure 8 A schematic diagram schematically illustrates a flow chart of a method for tilt mapping processing in an exemplary embodiment of the present disclosure;

[0072] Fig. 9 A schematic diagram schematically illustrates a flow chart of a method for adjusting current scene data in an exemplary embodiment of the present disclosure;

[0073] Fig.10 A flowchart schematically illustrating a method for updating a virtual scene in an exemplary embodiment of the present disclosure;

[0074] Fig.11 A flowchart schematically illustrating a method for adjusting lighting control data in an exemplary embodiment of the present disclosure;

[0075] Fig.12 A flowchart schematically illustrating a method for further adjusting lighting control data in an exemplary embodiment of the present disclosure;

[0076] Fig.13 A schematic diagram schematically shows the structure of a scene processing device for virtual live broadcast in an exemplary embodiment of the present disclosure;

[0077] Fig.14 An electronic device for implementing a scene processing method for virtual live broadcast in an exemplary embodiment of the present disclosure is schematically shown;

[0078] Fig.15 A computer-readable storage medium for implementing a scene processing method for virtual live broadcast in an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0079] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0080] The terms "a", "an", "the" and "said" are used in this specification to indicate the presence of one or more elements / components / etc.; the terms "including" and "having" are used to express an open-ended inclusion and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first" and "second" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0081] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings represent the same or similar parts, and their repeated descriptions will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities.

[0082] In view of the problems existing in the related technologies, the present disclosure proposes a scene processing method for virtual live broadcast. Figure 1 A flowchart of a method for processing a virtual live scene is shown. Figure 1 As shown, the scene processing method of virtual live broadcast includes at least the following steps:

[0083] Step S110: Obtain enhanced experience data of the target audience and experience enhancement conditions corresponding to the enhanced experience data, and obtain current scene data in the virtual scene.

[0084] Step S120: When the enhanced experience data meets the experience enhancement condition, the virtual scene is updated by adjusting the current scene data to display the updated virtual scene on the target audience end.

[0085] In the exemplary embodiment of the present disclosure, the enhanced experience data is used to match and judge the enhanced experience data, thereby adjusting the current scene data, realizing real-time dynamic update of the virtual scene, and providing users with a differentiated and customized visual experience that is different from the normal virtual live broadcast effect. At the same time, it does not affect the normal viewing experience of other users, and realizes the effect of branched display of the same virtual live broadcast, meeting the viewing needs and habits of different users, and optimizing the user's virtual live viewing experience in depth and breadth.

[0086] The following describes in detail the various steps of the virtual live broadcast scene processing method.

[0087] In step S110, the enhanced experience data of the target audience and the experience enhancement conditions corresponding to the enhanced experience data are obtained, and the current scene data in the virtual scene is obtained.

[0088] In an exemplary embodiment of the present disclosure, the UE instance runs on the host's PC (Personal Computer) broadcast terminal, and the host selects a virtual scene through the UE instance. In addition, the host's video is collected through a video acquisition device such as a camera, and the collected host video is cut out to obtain the host's portrait, so that the host's portrait of consecutive frames is displayed in the constructed virtual scene. In addition, the host can also set other parameter items such as beauty and makeup to complete the virtual broadcast.

[0089] When users enter the virtual live broadcast room normally, they can send barrages in the live broadcast room, or give gifts to the anchor and other interactive activities.

[0090] In addition, an enhanced mode function entrance, namely, an "experience enhanced mode" control, can be provided in the live broadcast room of the user end. The user can enter the enhanced mode of the live broadcast room by clicking the "experience enhanced mode" control.

[0091] Furthermore, the live broadcast platform client of the user end can send the user instruction to the live broadcast platform server end. When the current virtual scene does not support the enhanced mode, an error message can be prompted to the user end; and when the current virtual scene supports the enhanced mode, the live broadcast platform server end can obtain the enhanced experience data of the target audience end that has the enhanced mode function turned on, and the experience enhancement conditions corresponding to the enhanced experience data.

[0092] In an optional embodiment, the enhanced experience data includes: audience image data and terminal device data.

[0093] Since the enhanced experience data includes two types, namely, audience image data and terminal device data, the corresponding enhanced experience data can be obtained in different ways.

[0094] In an alternative embodiment, Figure 2 A flow chart of a method for obtaining enhanced experience data is shown in FIG. Figure 2 As shown, the method includes at least the following steps: In step S210, local position data of the target audience terminal is acquired, and scene depth recognition is performed on the local position data to obtain audience image data.

[0095] After the user enters the "experience enhancement mode", the live broadcast platform client collects the image data sent back by the user's mobile phone camera through the hardware equipment already in the user's mobile phone. Furthermore, the local location data in the sent back image data can be identified through image recognition technology.

[0096] In an optional embodiment, the local position data includes: eye position data and pupil position data.

[0097] Specifically, the eye position data is data representing the position of the user's eyes, and the pupil position data is data representing the position of the user's pupils.

[0098] After the local position data is acquired, scene depth recognition may be performed on the local position data.

[0099] In an alternative embodiment, Figure 3 A flow chart of a method for scene depth recognition is shown, as Figure 3 As shown, the method includes at least the following steps: in step S310, scene depth recognition is performed on pupil position data to obtain a sight angle, and gaze angle and eye position data are calculated to obtain sight range data.

[0100] Based on pupil position data and scene depth recognition technology, we can preliminarily calculate the angle formed by the user's realization and the plane of the terminal device such as the mobile phone that logs into the live broadcast platform client, that is, the realization angle.

[0101] Furthermore, based on the injection realization emitted by the realization angle and the eye position data, a two-dimensional coordinate range on the screen of a terminal device such as a mobile phone that the user's eyes are looking at is obtained, that is, the realization range data.

[0102] In step S320, the sight range data is cleaned to obtain audience image data.

[0103] After obtaining the realization range data, the realization range data may be cleaned in an area range, the relevant coordinate point data of the non-video area may be removed, and the cleaned data may be saved to obtain the audience image data.

[0104] In this exemplary embodiment, the corresponding audience image data is obtained by performing scene depth recognition on the local position data, which provides a data basis for adjusting the current scene data and ensures the updating effect of the virtual scene.

[0105] In step S220, the device inclination data of the target audience is obtained, and the device trend is determined on the device inclination data to obtain terminal device data, so as to obtain experience enhancement conditions corresponding to the audience image data and the terminal device data.

[0106] After the user enters the "experience enhancement mode", the live broadcast platform client can also collect the inclination sensor data of the user's mobile phone, that is, the device inclination data, through the existing hardware devices of the user's mobile phone and other terminal devices.

[0107] Furthermore, the acquired equipment inclination data can be used to determine the equipment trend.

[0108] In an alternative embodiment, Figure 4 A flow chart of a method for determining a device trend is shown in FIG. Figure 4 As shown, the method comprises at least the following steps: in step S410, the device inclination data is cleaned in an angle range to obtain target inclination data, and vector data calculation is performed on the target inclination data to obtain initial device data of the target inclination data.

[0109] The device inclination data is cleaned within an angle range, and the device inclination data with large jitter is removed to obtain vector data within a certain range, that is, the target inclination data.

[0110] Furthermore, vector data calculation is performed on the target tilt angle data of the two frames before and after, that is, the difference and derivative of the target tilt angle data of the two frames are calculated as initial device data to provide an initial data basis for determining the tilt trend of the user's mobile phone.

[0111] For example, the target inclination data of the current frame is (1,0,0), and the target inclination data of the next frame is (2,0,0). The difference between the target inclination data of these two frames is (1,0,0), and the derivative is 0. Therefore, it can be determined that the movement trend of the target inclination data of these two frames is a uniform tilt to the right.

[0112] In step S420, the acceleration condition corresponding to the initial device data is obtained, and the initial device data is subjected to inclination data elimination using the acceleration condition to obtain terminal device data of the target inclination data.

[0113] In order to perform secondary cleaning on the initial device data, an acceleration condition may be obtained. For example, the acceleration condition may be a standard deviation between (-1, 1).

[0114] Furthermore, the acceleration condition can be used to eliminate the target inclination data corresponding to the initial device data that does not meet the acceleration condition, so as to obtain the terminal device data corresponding to the target inclination data that meets a certain acceleration condition. The terminal device data is the difference and derivative corresponding to the target inclination data that meets the acceleration condition, and can also include other data according to actual conditions, which is not particularly limited in this exemplary embodiment.

[0115] In this exemplary embodiment, the corresponding terminal device data is obtained by performing device trend determination on the device inclination data, which provides a data basis for adjusting the current scene data and ensures the update effect of the virtual scene.

[0116] After the enhanced experience data is obtained, the experience enhancement conditions corresponding to the enhanced experience data may also be obtained.

[0117] The experience enhancement condition may be a corresponding condition set for the viewer image data, and the target inclination data or the terminal device data, respectively. Furthermore, the experience enhancement condition may be set according to preset experience enhancement template data.

[0118] For example, the experience enhancement conditions include conditions for triggering component logic events in the virtual scene at the target audience end, conditions for triggering lighting logic events in the virtual scene at the target audience end, and conditions for triggering gameplay logic events in the virtual scene at the target audience end. Among them, component logic events can be controlling the horizontal lateral viewing angle movement of the virtual camera, or adjusting the focal length aperture, or controlling the lens of the virtual camera to shake 30° horizontally to the left and right, etc.; lighting logic events can be adjusting dynamic style effects when the derivative in the terminal device data exceeds a certain value, or adjusting the color temperature of the virtual light between 4k-7k in the virtual scene, etc.; the gameplay logic event can be other gameplay functions supported by the live broadcast client, etc.

[0119] In addition, the current scene data in the virtual scene can also be obtained.

[0120] In an optional embodiment, the current scene data includes: scene element data, lighting control data and scene camera data.

[0121] The scene component data includes coordinates and attribute data of existing components of the virtual scene. The existing components may include models of decorative components in the virtual scene, such as pendants and lamps.

[0122] The lighting control data may include coordinates and property data of the lighting control in the virtual field, etc.

[0123] The scene camera data may include the coordinates and attribute parameter data of the camera in the virtual scene, etc.

[0124] It is worth noting that after the live broadcast platform server obtains the enhanced experience data, it can further obtain the scene data of the current virtual live broadcast when requesting the live broadcast platform host to start broadcasting. When the server UE instance obtains the request, it can obtain the current scene data. In addition, the current scene data is not limited to scene component data, lighting control data, and scene camera data, and can also include other data according to actual conditions and needs, and this exemplary embodiment does not specifically limit this.

[0125] In step S120, when the enhanced experience data meets the experience enhancement condition, the virtual scene is updated by adjusting the current scene data to display the updated virtual scene on the target audience end.

[0126] In an exemplary embodiment of the present disclosure, after receiving the current scene data and the preset experience enhancement template data corresponding to the current scene data, that is, the experience enhancement conditions, the live broadcast platform server can map the virtual live broadcast element to be controlled according to the saved audience image data and terminal device data.

[0127] Therefore, after obtaining the enhanced experience data and the experience enhancement condition, it is possible to determine whether the enhanced experience data satisfies the experience enhancement condition before adjusting the current scene data.

[0128] In an alternative embodiment, Figure 5 A flow chart of a method for determining whether enhanced experience data meets the experience enhancement condition is shown in FIG. Figure 5 As shown, the method at least includes the following steps: In step S510, coordinate mapping processing is performed on the audience image data to determine whether the audience image data meets the experience enhancement condition.

[0129] In an alternative embodiment, Figure 6 A schematic diagram of the flow chart of the method for coordinate mapping processing is shown, as Figure 6 As shown, the method includes at least the following steps: In step S610, scene space data of a virtual scene is acquired, and scene hot zone division is performed on the scene space data to obtain divided space data.

[0130] Specifically, the scene space data may be data representing the three-dimensional space where the virtual scene is located.

[0131] After the scene space data of the virtual scene is obtained, the scene space data may be divided into scene hot zones, and the three-dimensional space of the virtual scene may be divided into nine equally divided space data.

[0132] In step S620, hot zone counting processing is performed on the audience image data and the divided space data to obtain a counting processing result, and a counting threshold corresponding to the counting processing result is obtained.

[0133] In an alternative embodiment, Figure 7 A schematic flow chart of a method for processing hot zone counting is shown, as Figure 7 As shown, the method at least includes the following steps: In step S710, hot zone counting processing is performed on the audience image data and the divided space data to obtain multiple initial counting results.

[0134] The read audience image data is processed by hot zone counting according to the nine-equally divided space data, and the number of points represented by the audience image data falling into the nine-equally divided space is determined as an initial counting result.

[0135] In step S720, a plurality of initial counting results are compared to obtain a counting processing result.

[0136] After obtaining nine initial counting results, the nine initial counting results may be compared to obtain the area with the most points in the nine-equally divided space as the counting result.

[0137] In this exemplary embodiment, counting processing results can be initially obtained by performing hot zone calculation on the audience image data and the divided space data, providing basic data support for gaze point coordinate mapping.

[0138] After obtaining the counting processing result, a counting threshold corresponding to the counting processing result may be obtained. Furthermore, the counting threshold may be preset experience enhancement template data, that is, specified by the experience enhancement condition.

[0139] In step S630, a counting comparison is performed between the counting processing result and the counting threshold to obtain a counting comparison result, and it is determined whether the audience image data meets the experience enhancement condition according to the counting comparison result.

[0140] After obtaining the counting processing result and the counting threshold, the counting processing result and the counting threshold may be compared to obtain a corresponding counting comparison result.

[0141] The counting comparison result may be that the counting processing result is greater than the counting threshold, or may be that the counting comparison result is less than or equal to the counting threshold.

[0142] When the count comparison result is that the count processing result is greater than the count threshold, it is determined that the audience image data meets the experience enhancement condition; when the count comparison result is that the count comparison result is less than or equal to the count threshold, it is determined that the audience image data does not meet the experience enhancement condition.

[0143] In this exemplary embodiment, by performing coordinate mapping processing on the audience image data, it can be determined whether the audience image data meets the corresponding experience enhancement conditions, providing an adjustment function support entry for adjusting the current scene data, and enriching the scene processing method of virtual live broadcast.

[0144] In step S520, a tilt mapping process is performed on the target tilt data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition.

[0145] Figure 8 A schematic diagram of the process of the tilt mapping process is shown in FIG. Figure 8 As shown, the method includes at least the following steps: in step S810, an inclination threshold corresponding to the target inclination data is obtained, and an inclination comparison is performed on the target inclination data and the inclination threshold to obtain an inclination comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the inclination comparison result.

[0146] The tilt angle threshold may also be a threshold specified in a preset experience enhancement template.

[0147] After obtaining the tilt angle threshold, the target tilt angle data can be compared with the tilt angle threshold to determine whether the experience enhancement condition is met according to the tilt angle comparison result. The tilt angle comparison result can be that the target tilt angle data is greater than the tilt angle threshold, or that the target tilt angle data is less than or equal to the tilt angle threshold.

[0148] When the target inclination data is greater than the inclination threshold, it is determined that the terminal device data meets the experience enhancement condition; when the target inclination data is less than or equal to the inclination threshold, it is determined that the terminal device data does not meet the experience enhancement condition.

[0149] In step S820, a derivative threshold corresponding to the terminal device data is obtained, and a derivative comparison is performed on the terminal device data and the derivative threshold to obtain a derivative comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the derivative comparison result.

[0150] The derivative threshold may also be a threshold specified in a preset experience enhancement template.

[0151] After obtaining the derivative threshold, the derivative in the terminal device data can be compared with the derivative threshold to determine whether the experience enhancement condition is met according to the derivative comparison result. The derivative comparison result can be that the derivative in the terminal device data is greater than the derivative threshold, or that the derivative in the terminal device data is less than or equal to the derivative threshold.

[0152] When the derivative in the terminal device data is greater than the derivative threshold, it is determined that the terminal device data meets the experience enhancement condition; when the derivative in the terminal device data is less than or equal to the derivative threshold, it is determined that the terminal device data does not meet the experience enhancement condition.

[0153] In this exemplary embodiment, by performing different mapping processes on the two enhanced experience data, it can be determined whether the experience enhancement conditions are met. A pre-judgment method is also provided before adjusting the current scene data, thereby ensuring the logical rigor and data accuracy of the current scene data adjustment and ensuring the adjustment effect of the enhanced experience.

[0154] After determining whether the enhanced experience data meets the experience enhancement condition, the current scene data may be adjusted according to the determination result.

[0155] In an optional embodiment, if the count comparison result is that the count processing result is greater than the count threshold, it is determined that the audience image data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0156] When the counting comparison result is obtained by comparing the counting processing result with the counting threshold, and whether the audience image data meets the experience enhancement condition is determined according to the counting comparison result, it can be determined that when the counting processing result is greater than the counting threshold, it is further determined that the audience image data meets the experience enhancement condition, so as to adjust the current scene data to realize the update of the virtual scene.

[0157] In an optional embodiment, if the inclination comparison result is that the target inclination data is greater than the inclination threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0158] When the inclination comparison result is determined by comparing the target inclination data with the inclination threshold, and whether the terminal device data meets the experience enhancement data is determined based on the inclination comparison result, it can be determined that when the target inclination data is greater than the inclination threshold, it can be further determined that the terminal device data meets the experience enhancement conditions, so as to adjust the current scene data to realize the update of the virtual scene.

[0159] In an optional embodiment, if the derivative comparison result is that the terminal device data is greater than the derivative threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0160] When a derivative comparison result is obtained by comparing the derivative in the terminal device data with the derivative threshold, and whether the terminal device data satisfies the experience enhancement data is determined based on the derivative comparison result, it can be determined that when the derivative in the terminal device data is greater than the derivative threshold, it can be further determined that the terminal device data satisfies the experience enhancement condition, so as to adjust the current scene data to realize the update of the virtual scene.

[0161] In this exemplary embodiment, three methods of determining whether the enhanced experience data meets the experience enhancement condition are provided, which provides diversified judgment criteria for adjusting the current scene data and enriches the application methods of adjusting the current scene data.

[0162] When it is determined that the enhanced experience data meets the experience enhancement condition, the current scene data may be further adjusted.

[0163] In an alternative embodiment, Fig. 9 A flow chart of a method for adjusting current scene data is shown, as shown in Fig. 9 As shown, the method includes at least the following steps: In step S910, scene component data and scene camera data are adjusted to trigger component logic events in the virtual scene.

[0164] Specifically, the coordinates and attribute data in the scene component data, as well as the coordinates and attribute parameter data in the scene camera data, can be adjusted to trigger component logic events in the virtual scene at the target audience end.

[0165] For example, the component logic event may be to control the horizontal lateral viewing angle movement of the virtual camera, or to adjust the focal length aperture, or to control the lens of the virtual camera to shake horizontally 30° left and right, etc. This exemplary embodiment does not specifically limit the component logic events.

[0166] In step S920, scene element data, lighting control data and scene camera data are adjusted to trigger a lighting logic event of the virtual scene.

[0167] Specifically, adjusting the coordinates and attribute data in the scene component data, the coordinates and attribute data of the lighting control in the lighting control data, and the coordinates and attribute parameter data in the scene camera data can trigger lighting logic events in the virtual scene at the target audience end.

[0168] For example, a lighting logic event may be to adjust a dynamic style effect when a derivative in the terminal device data exceeds a certain value, or to adjust the color temperature of virtual lights between 4k-7k in a virtual scene, etc. This exemplary embodiment does not impose any special limitations on lighting logic events.

[0169] In step S930, the scene element data, the lighting control data and the scene camera data are adjusted to trigger a gameplay logic event of the virtual scene.

[0170] Specifically, adjusting the coordinates and attribute data in the scene component data, the coordinates and attribute data of the lighting control in the lighting control data, and the coordinates and attribute parameter data in the scene camera data can also trigger gameplay logic events of the virtual scene at the target audience end.

[0171] For example, the gameplay logic event may be other gameplay functions supported by the live client, etc. Moreover, the gameplay functions supported by the live client can also simultaneously evoke the UI (User Interface) presentation of the client, such as a pop-up window, etc., which is not specifically limited in this exemplary embodiment.

[0172] It is worth noting that the adjustment of scene component data, scene camera data and lighting control data and the triggering of component logic events, lighting logic events and gameplay logic events are not limited to a one-to-one correspondence, or may be a one-to-many, or many-to-one, or many-to-many correspondence, which can be associated with the specific implementation settings of component logic events, lighting logic events or gameplay logic events.

[0173] In this exemplary embodiment, three methods of automatically adjusting and updating virtual scenes are provided, which improve the degree of automation and intelligence of the adjustment method of the virtual live broadcast scene, enrich the user's enhanced experience, and optimize the user's experience of watching live broadcasts to a certain extent.

[0174] However, before updating the virtual scene of the target audience end, the target audience end may also be identified and judged.

[0175] In an alternative embodiment, Fig.10 A flow chart of a method for updating a virtual scene is shown, Fig.10 As shown, the method includes at least the following steps: in step S1010, multiple terminal identifiers of all audience terminals before displaying and updating the virtual scene are obtained, and a target terminal identifier of a target audience terminal is determined from the multiple terminal identifiers.

[0176] Among them, the full audience terminal can be all the audience terminals entering the same live broadcast room. Therefore, multiple terminal identifiers of the full audience terminal can be obtained. The terminal identifier can be identification data that uniquely represents a viewer terminal. For example, the terminal identifier can be the client ID (Identity document) of each viewer terminal.

[0177] Furthermore, the client ID of the target audience terminal entering the experience enhancement mode may be read from the multiple terminal identifiers as the target terminal identifier.

[0178] In step S1020, the virtual scene of the target audience terminal is updated according to the target terminal identifier, and the virtual scenes of other audience terminals among all audience terminals except the target audience terminal are maintained.

[0179] The server-side UE instance can simultaneously return a normal virtual live video stream with an undifferentiated image, and an image after adjusting the current scene data, which are sent to the live broadcast platform server via the anchor-side broadcast end.

[0180] After receiving the two video streams, the live broadcast platform server can read multiple terminal identifiers and target terminal identifiers. In addition, the live broadcast platform server pushes the video stream of the image after adjusting the current scene data to the target viewer terminal corresponding to the target terminal identifier, thereby completing the process of displaying the updated virtual scene on the target viewer terminal in an enhanced experience mode.

[0181] In addition, the live broadcast platform server can also push the normal virtual live video stream, the undifferentiated image picture to other audience terminals except the target audience terminal, so that users who have not entered the enhanced experience mode can watch the live broadcast normally.

[0182] In this exemplary embodiment, through differentiated push to different audience terminals, the viewing needs of both users who have entered the enhanced experience mode and those who have not entered the enhanced experience mode can be met at the same time, and there will be no impact between different users. Multi-branch optimizes the live viewing experience of different users.

[0183] In addition, after adjusting the current scene data, the lighting control data of the current virtual scene can be further controlled according to the adjusted current scene data.

[0184] In an alternative embodiment, Fig.11 A flow chart of a method for adjusting lighting control data is shown, such as Fig.11 As shown, the method includes at least the following steps: in step S1110, the current lighting data of the live broadcast end after the virtual scene is updated is obtained, and the previous lighting data corresponding to the current lighting data is obtained.

[0185] After determining the triggered logical event based on the current scene data, the live broadcast platform server can send the instruction back to the server UE instance via the anchor side broadcast terminal.

[0186] The server UE instance adjusts each component in the virtual scene in real time according to the control instructions.

[0187] Furthermore, after the adjustment is completed, the server UE instance will capture the scene image to be updated and send it to the live broadcast platform server via the anchor side broadcast end.

[0188] The live broadcast platform server sends back the host character's facial illumination information for the current frame and the previous frame, that is, the current illumination data and the previous illumination data.

[0189] The current illumination data may be the coordinate data of the anchor character's face sheet obtained after the virtual scene is updated, and the current illumination data may include the coordinate data of the upper body of the anchor character.

[0190] Correspondingly, the previous illumination data may be the coordinate data of the host character's face piece of the previous frame of the updated virtual scene, and the previous illumination data may also include the coordinate data of the upper body of the host character.

[0191] It is worth noting that the illumination data of the current illumination data and the illumination data of the previous illumination data may also belong to the current scene data.

[0192] In step S1120, the lighting control data is adjusted according to the current lighting data and the previous lighting data.

[0193] In an alternative embodiment, Fig.12 A flow chart of a method for further adjusting the lighting control data is shown. Fig.12 As shown, the method includes at least the following steps: In step S1210, current illumination data and previous illumination data are subjected to illumination comparison processing to obtain illumination difference data, and a mapping relationship between illumination adjustment conditions and control adjustment modes is obtained.

[0194] After obtaining the current illumination data and the previous illumination data, illumination comparison processing can be performed on the current illumination data and the previous illumination data, that is, illumination difference data can be calculated to obtain the illumination difference data, wherein the illumination difference data can include color temperature, light intensity and illumination focusing point difference data.

[0195] Furthermore, a mapping relationship between the lighting adjustment condition and the control adjustment mode can also be obtained. The mapping relationship between the lighting adjustment condition and the control adjustment mode can be specified by a preset experience enhancement template, and can include multiple mapping relationships. There is no fixed one-to-one, many-to-one, one-to-many or many-to-many quantitative correspondence relationship in the mapping relationship, and this exemplary embodiment does not specifically limit this.

[0196] In step S1220, data condition matching is performed on the illumination difference data and the illumination adjustment condition to determine the target adjustment condition, and the illumination control data is adjusted according to the target adjustment condition and the mapping relationship.

[0197] After the mapping relationship between the illumination adjustment condition and the control adjustment mode is obtained, the illumination difference data and the illumination adjustment condition may be used to perform data condition matching to determine the target adjustment condition satisfied by the illumination difference data from the illumination adjustment condition.

[0198] Furthermore, a corresponding control adjustment template may be determined according to the target adjustment condition and the mapping relationship, and the illumination control data may be adjusted according to the control adjustment template.

[0199] The live broadcast platform server combines the instruction requirements in the preset experience enhancement template, that is, the mapping relationship between the lighting adjustment conditions and the control adjustment mode to obtain the lighting control instructions to be adjusted.

[0200] The live broadcast platform server transmits the lighting control instruction back to the server UE instance via the anchor side broadcast end, so that after receiving the lighting control instruction, the server UE instance can control the lighting control data in the virtual scene to dynamically adjust the color temperature, light or light intensity, thereby ensuring that the overall visual effect does not change too much and maintaining the smoothness of the changes in the viewing experience.

[0201] In this exemplary embodiment, the lighting control data is further adjusted through the adjusted current scene data to adjust the lighting effect of the virtual scene in real time and dynamically.

[0202] In short, through the conventional hardware devices equipped in the user's mobile phone, such as cameras and mobile phone inclination sensors, when the user enters the anchor's live broadcast room in a virtual broadcast and is authorized to enter the experience enhancement mode, the live broadcast platform client collects the required audience image data and inclination vector data and other target inclination data through sensors in real time to the live broadcast platform server.

[0203] After receiving the enhanced experience data, the live broadcast platform server requests the live broadcast side of the live broadcast platform to obtain the current virtual scene data and the preset experience enhancement template corresponding to this scene. By matching the enhanced experience data with the template, the scene component data, lighting control data and scene camera data required for control adjustment are obtained, and the logical event to be triggered is determined. Further, the control command is sent back to the server UE instance for real-time adjustment.

[0204] After the adjustment is completed, the server UE instance sends the scene screenshot to be updated to the live broadcast platform server. The live broadcast platform server compares the lighting information of the anchor character face sheet of the previous frame, and determines the control adjustment mode of the dynamic balance or style lighting according to the template lighting adjustment instruction, and returns the control instruction corresponding to the control adjustment mode to the server UE instance to control the light source in the virtual scene to dynamically adjust the color temperature, lighting angle or lighting intensity to complete the update of the virtual scene in the experience enhancement mode. In addition, the scene processing process of the virtual live broadcast can be repeatedly executed until the user exits the experience enhancement mode.

[0205] In the exemplary embodiment of the present disclosure, the scene processing method of virtual live broadcast uses the experience enhancement data to match and judge the enhanced experience data, thereby adjusting the current scene data, realizing the real-time dynamic update of the virtual scene, and providing users with a differentiated and customized visual experience that is different from the normal virtual live broadcast effect. At the same time, it does not affect the normal viewing experience of other users, realizes the effect of branching display of the same virtual live broadcast, meets the viewing needs and habits of different users, and optimizes the user's virtual live viewing experience in depth and breadth.

[0206] In addition, in an exemplary embodiment of the present disclosure, a scene processing device for virtual live broadcast is also provided. Fig.13 A schematic diagram of the structure of a virtual live scene processing device is shown. Fig.13 As shown, the virtual live scene processing device 1300 may include: a data acquisition module 1310 and a scene update module 1320. Among them:

[0207] The data acquisition module 1310 is configured to acquire the enhanced experience data of the target audience and the experience enhancement conditions corresponding to the enhanced experience data, and acquire the current scene data in the virtual scene; the scene update module 1320 is configured to update the virtual scene by adjusting the current scene data when the enhanced experience data meets the experience enhancement conditions, so as to display the updated virtual scene on the target audience.

[0208] In an exemplary embodiment of the present invention, the enhanced experience data includes: audience image data and terminal device data.

[0209] In an exemplary embodiment of the present invention, the step of obtaining enhanced experience data of a target audience terminal and an experience enhancement condition corresponding to the enhanced experience data includes:

[0210] Acquire local position data of the target audience terminal, and perform scene depth recognition on the local position data to obtain audience image data;

[0211] The device inclination data of the target audience terminal is obtained, and the device trend determination is performed on the device inclination data to obtain the terminal device data, so as to obtain the experience enhancement conditions corresponding to the audience image data and the terminal device data.

[0212] In an exemplary embodiment of the present invention, the local position data includes: eye position data and pupil position data.

[0213] In an exemplary embodiment of the present invention, the step of performing scene depth recognition on the local position data to obtain audience image data includes:

[0214] Performing scene depth recognition on the pupil position data to obtain a sight line angle, and performing gaze line calculation on the sight line angle and the eye position data to obtain sight line range data;

[0215] The sight range data is cleaned by area range to obtain audience image data.

[0216] In an exemplary embodiment of the present invention, the step of performing device trend determination on the device inclination data to obtain terminal device data includes:

[0217] Performing angle range cleaning on the device inclination data to obtain target inclination data, and performing vector data calculation on the target inclination data to obtain initial device data of the target inclination data;

[0218] The acceleration condition corresponding to the initial device data is acquired, and the inclination data of the initial device data is eliminated by using the acceleration condition to obtain the terminal device data of the target inclination data.

[0219] In an exemplary embodiment of the present invention, before updating the virtual scene by adjusting the current scene data when the enhanced experience data satisfies the experience enhancement condition, the method further includes:

[0220] Performing coordinate mapping processing on the audience image data to determine whether the audience image data meets the experience enhancement condition;

[0221] Performing inclination mapping processing on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition.

[0222] In an exemplary embodiment of the present invention, the performing coordinate mapping processing on the audience image data to determine whether the audience image data satisfies the experience enhancement condition includes:

[0223] Acquire scene space data of the virtual scene, and perform scene hot zone division on the scene space data to obtain divided space data;

[0224] Performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result, and acquiring a counting threshold value corresponding to the counting processing result;

[0225] A counting comparison is performed on the counting processing result and the counting threshold to obtain a counting comparison result, and whether the audience image data meets the experience enhancement condition is determined according to the counting comparison result.

[0226] In an exemplary embodiment of the present invention, the step of performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result includes:

[0227] Performing hot zone counting processing on the audience image data and the divided space data to obtain a plurality of initial counting results;

[0228] The multiple initial counting results are compared to obtain a counting processing result.

[0229] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0230] If the counting processing result is greater than the counting threshold, it is determined that the audience image data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0231] In an exemplary embodiment of the present invention, the performing inclination mapping processing on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition includes:

[0232] Acquire a tilt angle threshold value corresponding to the target tilt angle data, and perform a tilt angle comparison on the target tilt angle data and the tilt angle threshold value to obtain a tilt angle comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the tilt angle comparison result;

[0233] A derivative threshold corresponding to the terminal device data is obtained, and a derivative comparison is performed on the terminal device data and the derivative threshold to obtain a derivative comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the derivative comparison result.

[0234] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0235] If the target inclination data is greater than the inclination threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0236] In an exemplary embodiment of the present invention, when the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes:

[0237] If the terminal device data is greater than the derivative threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

[0238] In an exemplary embodiment of the present invention, the current scene data includes: scene element data, lighting control data and scene camera data.

[0239] In an exemplary embodiment of the present invention, updating the virtual scene by adjusting the current scene data includes:

[0240] Adjusting the scene component data and the scene camera data to trigger component logic events in the virtual scene;

[0241] Adjusting the scene element data, the lighting control data and the scene camera data to trigger a lighting logic event of the virtual scene;

[0242] The scene element data, the lighting control data, and the scene camera data are adjusted to trigger a gameplay logic event of the virtual scene.

[0243] In an exemplary embodiment of the present invention, after updating the virtual scene by adjusting the current scene data, the method further includes:

[0244] Acquire current illumination data of the live broadcast end after the virtual scene is updated, and acquire previous illumination data corresponding to the current illumination data;

[0245] The lighting control data is adjusted according to the current lighting data and the previous lighting data.

[0246] In an exemplary embodiment of the present invention, the step of adjusting the lighting control data according to the current lighting data and the previous lighting data includes:

[0247] Performing illumination comparison processing on the current illumination data and the previous illumination data to obtain illumination difference data, and acquiring a mapping relationship between illumination adjustment conditions and control adjustment modes;

[0248] The illumination difference data and the illumination adjustment condition are matched with each other to determine a target adjustment condition, and the illumination control data is adjusted according to the target adjustment condition and the mapping relationship.

[0249] In an exemplary embodiment of the present invention, updating the virtual scene at the target audience terminal includes:

[0250] Acquire multiple terminal identifiers of all audience terminals before displaying and updating the virtual scene, and determine a target terminal identifier of the target audience terminal from among the multiple terminal identifiers;

[0251] The virtual scene of the target audience terminal is updated according to the target terminal identifier, and the virtual scenes of other audience terminals among the total audience terminals except the target audience terminal are maintained.

[0252] The specific details of the above-mentioned virtual live scene processing device 1300 have been described in detail in the corresponding virtual live scene processing method, so they will not be repeated here.

[0253] It should be noted that although several modules or units of the virtual live scene processing device 1300 are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0254] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0255] Refer to the following Fig.14 1400 according to this embodiment of the present invention is described. Fig.14 The electronic device 1400 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0256] like Fig.14 As shown, the electronic device 1400 is in the form of a general computing device. The components of the electronic device 1400 may include, but are not limited to: the at least one processing unit 1410, the at least one storage unit 1420, a bus 1430 connecting different system components (including the storage unit 1420 and the processing unit 1410), and a display unit 1440.

[0257] The storage unit stores program codes, which can be executed by the processing unit 1410, so that the processing unit 1410 executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0258] The storage unit 1420 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 1421 and / or a cache storage unit 1422 , and may further include a read-only storage unit (ROM) 1423 .

[0259] The storage unit 1420 may also include a program / utility 1424 having a set (at least one) of program modules 1425, such program modules 1425 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0260] Bus 1430 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0261] The electronic device 1400 may also communicate with one or more external devices 1600 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1400, and / or communicate with any device that enables the electronic device 1400 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1450. In addition, the electronic device 1400 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 1460. As shown, the network adapter 1460 communicates with other modules of the electronic device 1400 via a bus 1430. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0262] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0263] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0264] refer to Fig.15 As shown, a program product 1500 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0265] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0266] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0267] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0268] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0269] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

Claims

1. A method for processing a virtual live scene, characterized in that: The method comprises: Acquire the enhanced experience data of the target audience end and the experience enhancement conditions corresponding to the enhanced experience data, and acquire the current scene data in the virtual scene; the enhanced experience data includes audience image data and terminal device data; the current scene data includes scene component data, lighting control data and scene camera data; the experience enhancement conditions include conditions for triggering component logic events in the virtual scene of the target audience end, conditions for triggering lighting logic events in the virtual scene of the target audience end and conditions for triggering gameplay logic events in the virtual scene of the target audience end; the acquisition of the enhanced experience data of the target audience end and the experience enhancement conditions corresponding to the enhanced experience data include: acquiring local position data of the target audience end, and performing scene depth recognition on the local position data to obtain audience image data, the local position data including eye position data and pupil position data; acquiring device inclination data of the target audience end, and performing device trend determination on the device inclination data to obtain terminal device data, so as to acquire the experience enhancement conditions corresponding to the audience image data and the terminal device data; When the enhanced experience data satisfies the experience enhancement condition, the virtual scene is updated by adjusting the current scene data, so as to display the updated virtual scene on the target audience end.

2. The method for processing a virtual live scene according to claim 1, characterized in that: The performing scene depth recognition on the local position data to obtain audience image data includes: Performing scene depth recognition on the pupil position data to obtain a sight line angle, and performing gaze line calculation on the sight line angle and the eye position data to obtain sight line range data; Performing area cleaning on the sight range data to obtain audience image data.

3. The method for processing a virtual live scene according to claim 1, characterized in that: The step of performing device trend determination on the device inclination data to obtain terminal device data includes: Performing angle range cleaning on the device inclination data to obtain target inclination data, and performing vector data calculation on the target inclination data to obtain initial device data of the target inclination data; The acceleration condition corresponding to the initial device data is acquired, and the inclination data of the initial device data is eliminated by using the acceleration condition to obtain the terminal device data of the target inclination data.

4. The method for processing a virtual live scene according to claim 3, characterized in that: Before updating the virtual scene by adjusting the current scene data when the enhanced experience data satisfies the experience enhancement condition, the method further includes: Performing coordinate mapping processing on the audience image data to determine whether the audience image data meets the experience enhancement condition; Performing inclination mapping processing on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition.

5. The method for processing a virtual live scene according to claim 4, characterized in that: The performing coordinate mapping processing on the audience image data to determine whether the audience image data meets the experience enhancement condition includes: Acquire scene space data of the virtual scene, and perform scene hot zone division on the scene space data to obtain divided space data; Performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result, and acquiring a counting threshold value corresponding to the counting processing result; A counting comparison is performed on the counting processing result and the counting threshold to obtain a counting comparison result, and whether the audience image data meets the experience enhancement condition is determined according to the counting comparison result.

6. The method for processing a virtual live scene according to claim 5, characterized in that: The performing hot zone counting processing on the audience image data and the divided space data to obtain a counting processing result includes: Performing hot zone counting processing on the audience image data and the divided space data to obtain a plurality of initial counting results; The multiple initial counting results are compared to obtain a counting processing result.

7. The method for processing a virtual live scene according to claim 5, characterized in that: When the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes: If the counting comparison result is that the counting processing result is greater than the counting threshold, it is determined that the audience image data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

8. The method for processing a virtual live scene according to claim 4, characterized in that: The performing the inclination mapping process on the target inclination data or the terminal device data to determine whether the terminal device data meets the experience enhancement condition includes: Acquire a tilt angle threshold value corresponding to the target tilt angle data, and perform a tilt angle comparison on the target tilt angle data and the tilt angle threshold value to obtain a tilt angle comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the tilt angle comparison result; A derivative threshold corresponding to the terminal device data is obtained, and a derivative comparison is performed on the terminal device data and the derivative threshold to obtain a derivative comparison result, so as to determine whether the terminal device data meets the experience enhancement condition according to the derivative comparison result.

9. The method for processing a virtual live scene according to claim 8, characterized in that: When the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes: If the inclination comparison result is that the target inclination data is greater than the inclination threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

10. The method for processing a virtual live scene according to claim 8, characterized in that: When the enhanced experience data satisfies the experience enhancement condition, updating the virtual scene by adjusting the current scene data includes: If the derivative comparison result is that the terminal device data is greater than the derivative threshold, it is determined that the terminal device data meets the experience enhancement condition, and the virtual scene is updated by adjusting the current scene data.

11. The method for processing a virtual live scene according to claim 1, characterized in that: The updating of the virtual scene by adjusting the current scene data includes: Adjusting the scene component data and the scene camera data to trigger component logic events in the virtual scene; Adjusting the scene element data, the lighting control data and the scene camera data to trigger a lighting logic event of the virtual scene; The scene element data, the lighting control data, and the scene camera data are adjusted to trigger a gameplay logic event of the virtual scene.

12. The method for processing a virtual live scene according to claim 1, characterized in that: After updating the virtual scene by adjusting the current scene data, the method further includes: Acquire current illumination data of the live broadcast end after the virtual scene is updated, and acquire previous illumination data corresponding to the current illumination data; The lighting control data is adjusted according to the current lighting data and the previous lighting data.

13. The method for processing a virtual live scene according to claim 12, characterized in that: The adjusting the lighting control data according to the current lighting data and the previous lighting data comprises: Performing illumination comparison processing on the current illumination data and the previous illumination data to obtain illumination difference data, and acquiring a mapping relationship between illumination adjustment conditions and control adjustment modes; The illumination difference data and the illumination adjustment condition are matched with each other to determine a target adjustment condition, and the illumination control data is adjusted according to the target adjustment condition and the mapping relationship.

14. The method for processing a virtual live scene according to claim 1, characterized in that: Updating the virtual scene at the target audience end includes: Acquire multiple terminal identifiers of all audience terminals before displaying and updating the virtual scene, and determine a target terminal identifier of the target audience terminal from among the multiple terminal identifiers; The virtual scene of the target audience terminal is updated according to the target terminal identifier, and the virtual scenes of other audience terminals among the total audience terminals except the target audience terminal are maintained.

15. A virtual live scene processing device, characterized in that: include: A data acquisition module is configured to acquire enhanced experience data of a target audience and experience enhancement conditions corresponding to the enhanced experience data, and acquire current scene data in a virtual scene; The enhanced experience data includes audience image data and terminal device data; the current scene data includes scene element data, lighting control data and scene camera data; The experience enhancement conditions include conditions for triggering element logic events in the virtual scene at the target audience end, conditions for triggering lighting logic events at the virtual scene at the target audience end, and conditions for triggering gameplay logic events at the virtual scene at the target audience end; The obtaining of the enhanced experience data of the target audience end and the experience enhancement conditions corresponding to the enhanced experience data includes: obtaining local position data of the target audience end, and performing scene depth recognition on the local position data to obtain audience image data, wherein the local position data includes eye position data and pupil position data; obtaining device inclination data of the target audience end, and performing device trend determination on the device inclination data to obtain terminal device data, so as to obtain the experience enhancement conditions corresponding to the audience image data and the terminal device data; The scene update module is configured to update the virtual scene by adjusting the current scene data when the enhanced experience data meets the experience enhancement condition, so as to display the updated virtual scene on the target audience end.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the virtual live broadcast scene processing method described in any one of claims 1-14 is implemented.

17. An electronic device, characterized in that: include: processor; A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the virtual live scene processing method described in any one of claims 1-14 by executing the executable instructions.

Images