Light control method and device, electronic device, storage medium

Abstract

The present disclosure provides a lighting control method and apparatus, an electronic device, and a storage medium, relating to the technical field of data processing. The lighting control method for a virtual live broadcast scenario includes: obtaining a currently played audio segment and current virtual lighting parameters corresponding to the currently played audio segment; invoking host light and shadow parameters corresponding to the current virtual lighting parameters, and determining real lighting parameters based on the current virtual lighting parameters and the host light and shadow parameters; transmitting the real lighting parameters to a real lighting system to obtain real lighting, and obtaining host image data captured under the real lighting; and constructing a target virtual live broadcast scenario according to the host image data and the current virtual lighting parameters. The technical solution of the embodiments of the present disclosure can synchronously control virtual lighting and real lighting, and improve the fusion degree of virtual lighting and host image data in the target virtual live broadcast scenario.

Description

Background Art

[0002] With the continuous development of live streaming platforms, the virtual live broadcast method of synthesizing virtual scenes with real people is becoming more and more common.

[0003] However, currently, virtual lights in virtual live broadcasts are mainly static lights, resulting in limited types of virtual lights in virtual live broadcasts, and poor fusion between the real lights for shooting real person images and virtual lights. Therefore, it is of great practical significance in the live broadcast field to improve a lighting control method to achieve dynamic transformation of virtual lights in virtual live broadcast scenes and improve the fusion degree between real person images and virtual lights.

[0004] It should be noted that the information disclosed in the above background art section is only used to enhance the understanding of the background of the present disclosure, and thus may include information that does not constitute the prior art known to those of ordinary skill in the art. Summary of the Invention

[0005] The purpose of the embodiments of the present disclosure is to provide a lighting control method, a virtual lighting control device, an electronic device, and a computer-readable storage medium, so as to at least to some extent overcome the problems of single virtual lights and poor fusion between virtual lights and real lights in virtual live broadcast scenes.

[0006] Other features and advantages of the present disclosure will become apparent through the following detailed description, or will be partially learned through the practice of the present disclosure.

[0007] According to the first aspect of the embodiments of the present disclosure, a lighting control method is provided, including: obtaining a currently played audio segment and current virtual lighting parameters corresponding to the currently played audio segment; calling host light and shadow parameters corresponding to the current virtual lighting parameters, and determining real lighting parameters based on the current virtual lighting parameters and the host light and shadow parameters; transmitting the real lighting parameters to a real lighting system to obtain real lights, and obtaining host image data captured under the real lights; constructing a target virtual live broadcast scene with synchronous transformation of virtual lights and real lights according to the host image data and the current virtual lights.

[0008] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the obtaining of the currently played audio segment and the current virtual lighting parameters corresponding to the currently played audio segment includes: pre-obtaining an audio data stream, performing spectrum analysis and sound frequency range division on the audio data stream to obtain audio segments corresponding to the audio data stream; establishing a mapping relationship between the audio segments and virtual lighting parameters; obtaining the currently played audio segment, and matching from the audio segments to obtain a target audio segment identical to the currently played audio segment; determining the current virtual lighting parameters corresponding to the target audio segment based on the mapping relationship.

[0009] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the calling of the host light and shadow parameters corresponding to the current virtual light parameters includes: obtaining light and shadow transformation configuration information; the light and shadow transformation configuration information is obtained by simulating the light and shadow transformation of a test object with sample characteristic parameters under test lights; and calling the host light and shadow parameters corresponding to the current virtual light parameters based on the light and shadow transformation configuration information.

[0010] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the light and shadow transformation configuration information includes sample characteristic parameters, test virtual lights, and light and shadow parameter samples. The calling of the host light and shadow parameters corresponding to the current virtual light parameters based on the light and shadow transformation configuration information includes: reading the characteristic parameters of the host, and when the characteristic parameters are detected to be the same as the sample characteristic parameters, determining the key light and shadow parameters corresponding to the characteristic parameters under the test lights from the light and shadow parameter samples; matching the target light and shadow parameters corresponding to the current virtual light parameters from the key light and shadow parameters, and using the target light and shadow parameters as the host light and shadow parameters.

[0011] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the determining of the real light parameters based on the current virtual light parameters and the host light and shadow parameters includes: reading the portrait light and shadow area in the host light and shadow parameters, and determining the virtual reflected light intensity data, virtual key light intensity data, virtual refraction intensity data, and trichromatic data in the current virtual light parameters; calculating the real light luminous flux based on the portrait light and shadow area, virtual light reflection intensity data, virtual key light intensity data, and virtual light refraction intensity data, and calculating the real light and shadow intensity according to the real light luminous flux; and using the trichromatic data, as well as the real light luminous flux and the real light and shadow intensity as the real light parameters.

[0012] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the constructing of the target virtual live broadcast scene with synchronous transformation of virtual lights and real lights according to the host image data and the current virtual light parameters includes: calling a virtual scene template; the virtual scene template includes virtual scene rendering data and key image processing logics; rendering an initial virtual scene based on the virtual scene rendering data in the virtual scene template; adjusting the initial virtual scene according to the current virtual light parameters to obtain a standard virtual scene; obtaining a host image taken under real lights corresponding to the real light parameters, and synchronizing the host image data to the standard virtual scene in combination with the key image processing logics, and synchronizing the current audio segment to the standard virtual scene to obtain a target virtual live broadcast scene with synchronous transformation of virtual lights and real lights.

[0013] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the method further includes: when it is detected that the current audio segment changes, obtaining an updated audio segment; determining updated virtual lighting parameters corresponding to the updated audio segment based on the mapping relationship, and switching the current virtual lighting parameters to the updated virtual lighting parameters; calling the updated lighting and shadow parameters of the anchor corresponding to the updated virtual lighting parameters, and determining updated real lighting parameters according to the updated virtual lighting parameters and the updated lighting and shadow parameters of the anchor; obtaining updated anchor image data captured under the real lighting corresponding to the updated real lighting parameters, and updating the target virtual live broadcast scene through the updated anchor image data and the updated audio segment.

[0014] According to a second aspect of the embodiments of the present disclosure, there is provided a lighting control device, including:

[0015] A data acquisition module, configured to acquire a currently played audio segment and current virtual lighting parameters corresponding to the currently played audio segment; a real lighting parameter determination module, configured to call the lighting and shadow parameters of the anchor corresponding to the current virtual lighting parameters, and determine real lighting parameters based on the current virtual lighting parameters and the lighting and shadow parameters of the anchor; a real lighting parameter transmission module, configured to transmit the real lighting parameters to a real lighting system to obtain real lighting, and acquire anchor image data captured under the real lighting; a target virtual live broadcast scene construction module, configured to construct a target virtual live broadcast scene with synchronous transformation of virtual lighting and real lighting according to the anchor image data and the current virtual lighting parameters.

[0016] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the data acquisition module includes a data acquisition unit, and the data acquisition unit is configured to pre-acquire an audio data stream, perform spectrum analysis and sound frequency range division on the audio data stream to obtain an audio segment corresponding to the audio data stream; establish a mapping relationship between the audio segment and virtual lighting parameters; acquire a currently played audio segment, and match a target audio segment identical to the currently played audio segment from the audio segments; and determine current virtual lighting parameters corresponding to the target audio segment based on the mapping relationship.

[0017] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the real lighting parameter determination module includes a lighting and shadow transformation configuration information acquisition unit, and the lighting and shadow transformation configuration information acquisition unit is configured to acquire lighting and shadow transformation configuration information; the lighting and shadow transformation configuration information is obtained by simulating the lighting and shadow transformation of a test object with sample characteristic parameters under test lighting; and call the lighting and shadow parameters of the anchor corresponding to the current virtual lighting parameters based on the lighting and shadow transformation configuration information.

[0018] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the real light parameter determination module further includes an anchor light and shadow parameter determination unit, which is configured to read the characteristic parameters of the anchor, and when it detects that the characteristic parameters are the same as the sample characteristic parameters, determine the key light and shadow parameters corresponding to the characteristic parameters under the test light from the light and shadow parameter samples; match the target light and shadow parameters corresponding to the current virtual light parameters from the key light and shadow parameters, and use the target light and shadow parameters as the anchor light and shadow parameters.

[0019] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the real light parameter determination module includes a real light parameter determination unit, which is configured to read the portrait light and shadow area in the anchor light and shadow parameters, and determine the virtual reflected light intensity data, virtual face light intensity data, virtual refraction intensity data, and three primary color data in the current virtual light parameters; calculate the real light luminous flux based on the portrait light and shadow area, virtual light reflection intensity data, virtual face light intensity data, and virtual light refraction intensity data, and calculate the real light light and shadow intensity according to the real light luminous flux; use the three primary color data, the real light luminous flux, and the real light light and shadow intensity as the real light parameters.

[0020] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the target virtual live broadcast scene construction module includes a target virtual live broadcast scene construction unit, which is configured to call a virtual scene template; the virtual scene template includes virtual scene rendering data and key image processing logics; render an initial virtual scene based on the virtual scene rendering data in the virtual scene template; adjust the initial virtual scene according to the current virtual light parameters to obtain a standard virtual scene; obtain an anchor image captured under the real light corresponding to the real light parameters, and synchronize the anchor image data to the standard virtual scene in combination with the key image processing logics, and synchronize the current audio segment to the standard virtual scene to obtain a target virtual live broadcast scene with synchronous transformation of virtual light and real light.

[0021] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the lighting control device further includes a target live data stream generation module, which is configured to obtain an updated audio segment when it detects a change in the current audio segment; determine updated virtual lighting parameters corresponding to the updated audio segment based on the mapping relationship, and switch the current virtual lighting parameters to the updated virtual lighting parameters; call the updated light and shadow parameters of the anchor corresponding to the updated virtual lighting parameters, and determine updated real lighting parameters according to the updated virtual lighting parameters and the updated light and shadow parameters of the anchor; obtain updated anchor image data captured under the real lighting corresponding to the updated real lighting parameters, and update the target virtual live scene with the updated anchor image data and the updated audio segment.

[0022] According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, including: a processor; and a memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, the lighting control method described in any one of the above is implemented.

[0023] According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the lighting control method described in any one of the above is implemented.

[0024] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0025] The lighting control method in the exemplary embodiments of the present disclosure obtains the currently playing audio segment and the current virtual lighting parameters corresponding to the currently playing audio segment; calls the host light and shadow parameters corresponding to the current virtual lighting parameters, and determines the real lighting parameters based on the current virtual lighting parameters and the host light and shadow parameters; transmits the real lighting parameters to the real lighting system to obtain real lighting, and obtains the host image data captured under the real lighting; constructs a target virtual live broadcast scene with synchronous transformation of virtual lighting and real lighting according to the host image data and the current virtual lighting parameters. On the one hand, the real lighting parameters can be determined based on the current virtual lighting parameters and the host light and shadow parameters, and the real lighting parameters are transmitted to the real lighting system to obtain real lighting, realizing the synchronous change of virtual lighting and real lighting; on the other hand, a target virtual live broadcast scene can be constructed according to the host image data captured under the real lighting corresponding to the current virtual lighting parameters and the current virtual lighting parameters, increasing the fusion degree of the host image data captured under the real lighting and the virtual lighting, thereby improving the authenticity of the target virtual live broadcast scene; on the other hand, the virtual lighting effect in the virtual live broadcast scene can be regulated based on the audio segment corresponding to the virtual lighting parameters, realizing the dynamic change of the virtual lighting and increasing the richness of the virtual lighting in the virtual live broadcast scene.

[0026] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts. In the drawings:

[0028] Figure 1 Schematically shows a schematic diagram of the process of the lighting control method according to some embodiments of the present disclosure;

[0029] Figure 2 Schematically shows a schematic diagram of the process of the method for determining the current virtual lighting parameters according to some embodiments of the present disclosure;

[0030] Figure 3 Schematically shows a schematic diagram of the process of the method for determining the host light and shadow parameters according to some embodiments of the present disclosure;

[0031] Figure 4 Schematically shows a schematic diagram of the process of the method for determining the real lighting parameters according to some embodiments of the present disclosure;

[0032] Figure 5 Schematically shows a schematic diagram of a method flow for constructing a target virtual live broadcast scene according to some embodiments of the present disclosure;

[0033] Figure 6 Schematically shows a schematic diagram of a method flow for updating a target virtual live broadcast scene according to some embodiments of the present disclosure;

[0034] Figure 7 Schematically shows a schematic diagram of a lighting control device according to some embodiments of the present disclosure;

[0035] Figure 8 Schematically shows a schematic diagram of the structure of a computer system of an electronic device according to some embodiments of the present disclosure;

[0036] Figure 9 Schematically shows a schematic diagram of a computer-readable storage medium according to some embodiments of the present disclosure.

[0037] In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts. Detailed Description of the Invention

[0038] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0039] In addition, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will realize that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be used. In other cases, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the present disclosure.

[0040] In addition, the drawings are only schematic diagrams and are not necessarily drawn to scale. The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0041] In this exemplary embodiment, first, a lighting control method is provided. This lighting control method can be applied to terminal devices, such as electronic devices like mobile phones and computers. The terminal device includes a sound collection unit, such as a microphone device, and an image collection unit, such as a camera. Figure 1 Schematically shows a schematic diagram of the process of the lighting control method according to some embodiments of the present disclosure. Refer to Figure 1 As shown, the lighting control method may include the following steps:

[0042] Step S110, obtaining the currently playing audio segment and the current virtual lighting parameters corresponding to the currently playing audio segment;

[0043] Step S120, calling the host light and shadow parameters corresponding to the current virtual lighting parameters, and determining the real lighting parameters based on the current virtual lighting parameters and the host light and shadow parameters;

[0044] Step S130, transmitting the real lighting parameters to the real lighting system to obtain real lighting, and obtaining the host image data captured under the real lighting;

[0045] Step S140, constructing a target virtual live broadcast scene with synchronous transformation of virtual lighting and real lighting according to the host image data and the current virtual lighting parameters.

[0046] According to the lighting control method in this exemplary embodiment, on the one hand, the real lighting parameters can be determined based on the current virtual lighting parameters and the host light and shadow parameters, and the real lighting parameters are transmitted to the real lighting system to obtain real lighting, realizing the synchronous change of virtual lighting and real lighting; on the other hand, a target virtual live broadcast scene can be constructed according to the host image data captured under the real lighting corresponding to the current virtual lighting parameters and the current virtual lighting parameters, increasing the fusion degree of the host image data captured under the real lighting and the virtual lighting, thereby improving the authenticity of the target virtual live broadcast scene; on the further hand, the virtual lighting effect in the virtual live broadcast scene can be adjusted based on the audio segment corresponding to the virtual lighting parameters, realizing the dynamic change of the virtual lighting and increasing the richness of the virtual lighting in the virtual live broadcast scene.

[0047] Next, the lighting control method in this exemplary embodiment will be further described.

[0048] In step S110, the currently playing audio segment and the current virtual lighting parameters corresponding to the currently playing audio segment are obtained.

[0049] In an exemplary embodiment of the present disclosure, the currently playing audio segment may refer to an audio segment obtained by pre - performing spectral analysis and sound frequency division on the currently playing audio data stream. For example, the currently playing audio segment may be an audio segment of ultra - low frequency from 20 to 60 Hz obtained by pre - performing spectral analysis and sound frequency division on the currently playing audio data stream. The currently playing audio segment may also be an audio segment of low frequency from 60 to 250 Hz obtained by pre - performing spectral analysis and sound frequency division on the currently playing audio data stream. The currently playing audio segment may further be an audio segment of low - medium frequency from 250 to 500 Hz obtained by pre - performing spectral analysis and sound frequency division on the currently playing audio data stream. Of course, the currently playing audio segment may also be other audio segments such as mid - frequency audio segments from 500 to 2000 Hz obtained by pre - performing spectral analysis and sound frequency division on the currently playing audio data stream. This exemplary embodiment does not make special limitations on this.

[0050] The current virtual light parameters may refer to the attribute parameters of the virtual lights in the current virtual live - broadcast scene. For example, the current virtual light parameters may be the three - primary - color (RGB) parameters of the virtual lights in the current virtual live - broadcast scene. The current virtual light parameters may also be the reflected - light intensity parameter, the frontal - light intensity parameter, and the refracted - light intensity parameter of the virtual lights in the current virtual live - broadcast scene. The current virtual light parameters may further be the current inclination parameter of the virtual lights. Of course, the current virtual light parameters may also be other attribute parameters of the virtual lights in the current virtual live - broadcast scene, such as the type parameter of the virtual lights, such as the parameters of rhythm lights. This exemplary embodiment does not make special limitations on this.

[0051] The virtual live - broadcast scene can be obtained by acquiring the currently playing audio segment and the corresponding current virtual light parameters, and adjusting the virtual lights according to the current virtual light parameters based on the virtual engine. Since the played audio segments are constantly changing, different audio segments and different corresponding virtual light parameters can be acquired, and virtual live - broadcast scenes with different lighting effects can be obtained based on different virtual light parameters, improving the diversity of the virtual lights in the virtual live - broadcast scene.

[0052] In step S120, the host's light and shadow parameters corresponding to the current virtual light parameters are called, and based on the current virtual light parameters and the host's light and shadow parameters, the real - light parameters are determined.

[0053] In an exemplary embodiment of the present disclosure, the host light and shadow parameters may refer to the transformation parameters of the host portrait light and shadow simulated in a virtual live broadcast scene corresponding to the current virtual light parameters. For example, the host light and shadow parameters may be the bright area parameters of the host portrait light and shadow simulated in a virtual live broadcast scene corresponding to the current virtual light parameters, the host light and shadow parameters may also be the bright position parameters of the host portrait light and shadow simulated in a virtual live broadcast scene corresponding to the current virtual light parameters, the host light and shadow parameters may further be the brightness parameters of the host portrait light and shadow. Of course, the host light and shadow parameters may also refer to other transformation parameters of the host portrait light and shadow simulated in a virtual live broadcast scene corresponding to the current virtual light parameters, such as light and shadow shape parameters. This example embodiment does not make special limitations on this.

[0054] The real light parameters may refer to the parameters of the real light calculated based on the current virtual light parameters and the host light and shadow parameters. For example, the real light parameters may be the luminous flux of the real light calculated based on the current virtual light parameters and the host light and shadow parameters, the real light parameters may also be the brightness of the real light calculated based on the current virtual light parameters and the host light and shadow parameters. Of course, the real light parameters may also be other parameters of the real light calculated based on the current virtual light parameters and the host light and shadow parameters. This example embodiment does not make special limitations on this.

[0055] The real light parameters can be calculated according to the current virtual light parameters and the host light and shadow parameters corresponding to the current virtual light parameters. For example, the luminous flux of the real light can be calculated according to the portrait light and shadow area in the host light and shadow parameters, the reflected light intensity, the face light intensity, and the refracted light intensity of the current virtual light, and the brightness of the real light can be determined according to the luminous flux of the real light. Furthermore, by converting the virtual light parameters into real light parameters, the synchronous transformation of the real light and the virtual light is realized.

[0056] In step S130, the real light parameters are transmitted to the real light system to obtain real light, and the host image data captured under the real light is acquired.

[0057] In an exemplary embodiment of the present disclosure, the real light system may be a system for controlling the lighting effects of real lights. For example, the real light system may be a system for controlling the lighting effects of real lights including devices such as a control box, real lights, and a dimming console. Of course, the real light system may also be a system for controlling the lighting effects of real lights including other devices. This example embodiment does not make special limitations on this. The host image data may refer to the host patch data captured based on the real light effects.

[0058] The real light parameters corresponding to the current virtual light parameters can be transmitted to the real light system through a local area network, and the real light device can be adjusted by the real light system according to the real light parameters determined by the current virtual light parameters and the host's light and shadow parameters. For example, the light luminous flux of the real light device can be adjusted by the real light system according to the light luminous flux in the real light parameters, or the light brightness of the real light device can be adjusted by the real light system according to the light brightness in the real light parameters. At the same time, the host image data captured under the real light is obtained to be used for the construction of the target virtual live broadcast scene.

[0059] In step S140, a target virtual live broadcast scene with synchronous transformation of virtual light and real light is constructed according to the host image data and the current virtual light parameters.

[0060] In an exemplary embodiment of the present disclosure, the target virtual live broadcast scene may refer to a virtual live broadcast scene constructed based on the current virtual light parameters and the host image data. For example, the target virtual live broadcast scene may be a virtual live broadcast scene obtained by synchronizing the current virtual light corresponding to the current virtual light parameters and the host image data to a pre-constructed virtual scene template through a virtual engine. The target virtual live broadcast scene may also be a virtual live broadcast scene obtained by synchronizing the current virtual light, the current played audio segment, and the host image to a pre-constructed virtual scene template through a virtual engine. Of course, the target virtual live broadcast scene may also be other virtual live broadcast scenes constructed based on the current virtual light parameters and the host image data. This exemplary embodiment does not make special limitations on this.

[0061] The current audio segment and the current virtual light parameters corresponding to the current audio segment can be obtained; the preset host light and shadow parameters corresponding to the current virtual light parameters are called, and the real light parameters are determined based on the host light and shadow parameters and the current virtual light parameters, and the real light parameters are transmitted to the real light system to adjust the real light device according to the real light parameters to obtain real light. Furthermore, a target virtual live broadcast scene can be constructed through the host image data captured under the real light and the current virtual light corresponding to the current virtual light parameters.

[0062] During this process, a mapping relationship can be established between different audio segments and virtual lighting parameters. When an updated audio segment is obtained, the updated virtual lighting parameters corresponding to the updated audio segment, the updated virtual lighting corresponding to the updated virtual lighting parameters, and the host light and shadow parameters under the updated virtual lighting can be directly determined according to the mapping relationship. At the same time, an association relationship can also be established between virtual lighting parameters, light and shadow parameter samples, and real lighting parameters. After obtaining the current virtual lighting parameters and matching the target light and shadow parameters corresponding to the host light and shadow parameters from the light and shadow parameter samples, the real lighting parameters can be directly determined according to the current virtual lighting parameters and the target light and shadow parameters. Furthermore, the real lighting equipment can be adjusted according to the real lighting parameters through the real lighting system to obtain real lighting, and a target virtual live broadcast scene can be constructed based on the host image data captured under the real lighting and the current virtual lighting parameters, thereby increasing the integration degree of the current virtual lighting and real lighting, improving the flexibility of constructing the target virtual live broadcast scene, and also improving the authenticity of the target virtual live broadcast scene.

[0063] Figure 2 Schematically shows a schematic diagram of a method flow for determining current virtual lighting parameters according to some embodiments of the present disclosure. Refer to Figure 2 As shown, the method for determining the current virtual lighting parameters may include the following steps:

[0064] In step S210, an audio data stream is acquired in advance, and the audio data stream is subjected to spectrum analysis and sound frequency range division to obtain audio segments corresponding to the audio data stream;

[0065] In step S220, a mapping relationship is established between the audio segments and virtual lighting parameters;

[0066] In step S230, the currently playing audio segment is acquired, and a target audio segment identical to the currently playing audio segment is matched from the audio segments;

[0067] In step S230, based on the mapping relationship, the current virtual lighting parameters corresponding to the target audio segment are determined.

[0068] Among them, according to the Nyquist frequency and the discrete Fourier transform method, the audio data stream can be subjected to spectrum analysis and sound frequency sampling, and the audio data stream after spectrum analysis and sound frequency sampling can be divided into sound frequency ranges according to the sensitivity of the ear to audio to obtain multiple audio segments constituting the audio data stream. Furthermore, a mapping relationship can be established between audio segments in different sound frequency ranges and different types of virtual lighting, so that when a mutated audio segment is detected, the virtual lighting can be dynamically adjusted based on the mapping relationship.

[0069] For example, the audio data stream after spectrum analysis and audio frequency sampling can be divided according to the sound frequency range to obtain different audio segments. Table 1-1 exemplarily shows the division of the audio data stream by sound frequency range and the establishment of the mapping relationship between the audio segments in different sound frequency ranges and the virtual lights. When the current audio segment is obtained, the target audio segment identical to the current audio segment can be matched from multiple audio segments of the audio data stream, and the virtual light corresponding to the target audio segment can be called based on the mapping relationship, so that when the audio segment changes, the type of the virtual light can also be dynamically adjusted, realizing the synchronous change of the virtual light following the audio rhythm, improving the interactivity between the audio data stream and the virtual light in the virtual live broadcast scene, and avoiding the problem of single virtual light in the virtual live broadcast scene.

[0070] Table 1-1 Mapping Relationship between Audio Segments and Virtual Lights

[0071]

[0072] In an exemplary embodiment of the present disclosure, the light and shadow transformation configuration information can be obtained, and the host light and shadow parameters corresponding to the current virtual light parameters can be called based on the light and shadow transformation configuration information; wherein, the light and shadow transformation configuration information is obtained by simulating the light and shadow transformation of a test object with sample characteristic parameters under a test light.

[0073] Among them, the light and shadow transformation configuration information may refer to the configuration information obtained by simulating the light and shadow transformation of a test object under a test virtual light. For example, the light and shadow transformation configuration information may be the configuration information including the sample characteristic parameters of the test object, the test light, and the light and shadow parameter samples obtained by simulating the light and shadow transformation of the test object under the test virtual light. Of course, the light and shadow transformation configuration information may also be the configuration information including other associated data such as the projection shape of the virtual light obtained by simulating the light and shadow transformation of the test object under the test virtual light. This example embodiment does not make special limitations on this. The light and shadow parameter samples may refer to the samples of the light and shadow parameters obtained by simulating the light and shadow transformation of the test object under different test virtual lights.

[0074] An association relationship can be established between the sample feature parameters of the test object and the light and shadow parameters of the test object under the test virtual light corresponding to the test virtual light parameters, and light and shadow transformation configuration information including the sample feature parameters, the test light, and the light and shadow parameters can be generated, so as to determine the host light and shadow parameters corresponding to the current virtual light parameters based on the light and shadow transformation configuration information and the feature parameters of the host. For example, the light and shadow parameters of test objects with heights of 150 cm, 155 cm, 160 cm, 165 cm, 170 cm, 175 cm, and 180 cm can be recorded under the same test light, and then, after the test light changes, the light and shadow parameters of the test object under the changed test light can be recorded; thus, light and shadow transformation configuration information including the light and shadow parameters of test objects with different sample feature parameters under different virtual lights can be obtained. Of course, a mapping relationship can also be established between other feature parameters of the test object, such as pose data, and the light and shadow parameters, and this example embodiment does not make special limitations on this.

[0075] Figure 3 Schematically shows a schematic diagram of the process for determining the host light and shadow parameters according to some embodiments of the present disclosure. Refer to Figure 3 As shown, the method for determining the host light and shadow parameters may include the following steps:

[0076] In step S310, the feature parameters of the host are read, and when it is detected that the feature parameters are the same as the sample feature parameters, the key light and shadow parameters corresponding to the feature parameters under the test light are determined from the light and shadow parameter samples;

[0077] In step S320, the target light and shadow parameters corresponding to the current virtual light parameters are matched from the key light and shadow parameters, and the target light and shadow parameters are used as the host light and shadow parameters.

[0078] Among them, the sample feature parameters may refer to the morphological feature parameters of the test object. For example, the sample feature parameters may be morphological feature parameters including the height data of the test object, the sample feature parameters may also be morphological feature parameters including the pose data of the test object, and of course, the sample feature parameters may also be morphological feature parameters including other data of the test object, and this example embodiment does not make special limitations on this.

[0079] The feature parameters may refer to the morphological feature parameters of the host. For example, the feature parameters may be morphological feature parameters including the height data of the host, the feature parameters may also be morphological feature parameters including the pose data of the host, and of course, the feature parameters may also be morphological feature parameters including other data of the host, and this example embodiment does not make special limitations on this.

[0080] The key lighting parameters may refer to the lighting parameters matched from the lighting parameters and matching the characteristic parameters of the host. For example, the characteristic parameters of the host may be the height data of the host, and the key lighting parameters may be the lighting parameters corresponding to the host height data matched from the lighting parameter samples based on the lighting transformation configuration information. The characteristic parameters of the host may also be the pose data of the host, and the key lighting parameters may also be the lighting parameters corresponding to the host's pose data matched from the lighting parameter samples based on the association relationship. Of course, the key lighting parameters may also be the lighting parameters corresponding to other characteristic parameters of the host matched from the lighting parameter samples. This example embodiment does not make special limitations on this.

[0081] The characteristic parameters of the host can be read, and the characteristic parameters of the host are compared with the sample characteristic parameters of the test object. When it is detected that there are characteristic parameters in the sample characteristic parameters that are the same as the characteristic parameters of the host, the key lighting parameters matching the characteristic parameters of the host are called, and the key lighting parameters matching the characteristic parameters of the host under all test virtual lights are determined, so as to match the target lighting parameters corresponding to the current virtual light parameters from the key lighting parameters, and use the target lighting parameters as the host lighting parameters. Thus, the real light parameters can be determined according to the host lighting parameters and the current virtual light parameters.

[0082] Figure 4 Schematically shows a schematic diagram of the real light parameter determination method flow according to some embodiments of the present disclosure. Refer to Figure 4 As shown, the real light parameter determination method may include the following steps:

[0083] In step S410, read the portrait lighting area in the host lighting parameters, and determine the virtual reflected light intensity data, virtual surface light intensity data, virtual refraction intensity data, and three primary color data in the current virtual light parameters;

[0084] In step S420, based on the portrait lighting area, virtual light reflection intensity data, virtual surface light intensity data, and virtual light refraction intensity data, calculate the real light luminous flux, and calculate the real light lighting intensity according to the real light luminous flux;

[0085] In step S430, use the three primary color data, the real light luminous flux, and the real light lighting intensity as the real light parameters.

[0086] Among them, the portrait light and shadow area may refer to the light and shadow area formed by virtual light projected onto a test object with the same characteristic parameters as the host. The real light luminous flux may refer to the luminous intensity of the real light. The real light light and shadow intensity may refer to the real light and shadow intensity parameter used to control the real light projected onto the host. For example, the real light light and shadow intensity may be the light and shadow intensity parameter obtained by unifying the light and shadow intensity obtained by projecting the real light onto the host to the host light and shadow parameter corresponding to the current virtual light parameter called based on the light and shadow transformation configuration information. Of course, the real light light and shadow intensity may also be used to adjust other real light and shadow intensities obtained by projecting the real light onto the host. This example embodiment does not make special limitations on this.

[0087] The real light luminous flux can be calculated according to the portrait light and shadow area in the host light and shadow parameter, as well as the virtual light reflection intensity data, virtual face light intensity data, and virtual light refraction intensity data in the current virtual light parameter. Specifically, the real light luminous flux corresponding to the current virtual light parameter can be calculated according to the calculation expression (1):

[0088] L = (A * 0.1 + B * 0.6 + C * 0.3) / S (1)

[0089] Among them, A represents the virtual light reflected light intensity, B represents the virtual face light intensity data, C represents the virtual light refraction intensity data, S represents the portrait light and shadow area of the host, and L represents the real light luminous flux.

[0090] At the same time, the real light light and shadow intensity corresponding to the current virtual light parameter can be calculated according to the calculation expression (2).

[0091] Y = L * 0.5 (2)

[0092] Among them, Y represents the virtual light reflected light intensity.

[0093] Preferably, the models and brands of entity lights can be collected in advance, and according to different virtual light parameters and light and shadow parameter samples, the real light luminous flux and real light light and shadow intensity of different entity lights can be budgeted to generate a real light parameter query table. After obtaining the host light and shadow parameter and the real light model and brand, the real light luminous flux and real light light and shadow intensity matching the host light and shadow parameter and the real light model and brand can be directly called from the real light parameter query table, and the three - primary - color data in the current virtual light parameter, as well as the real light luminous flux and real light light and shadow intensity, are used as real light parameters, which improves the efficiency of determining real light parameters.

[0094] Figure 5 Schematically shows a schematic diagram of the process of constructing a target virtual live - broadcast scene according to some embodiments of the present disclosure. Refer to Figure 5As shown, the method for constructing the target virtual live broadcast scene may include the following steps:

[0095] In step S510, a virtual scene template is called; the virtual scene template includes virtual scene rendering data and key image processing logic;

[0096] In step S520, an initial virtual scene is rendered based on the virtual scene rendering data in the virtual scene template, and the initial virtual scene is adjusted according to the current virtual lighting parameters to obtain a standard virtual scene; and

[0097] In step S530, an anchor image taken under the real lighting corresponding to the real lighting parameters is obtained, and the anchor image data is synchronized to the standard virtual scene in combination with the key image processing logic, and the current audio segment is synchronized to the standard virtual scene to obtain a target virtual live broadcast scene with synchronous transformation of virtual lighting and real lighting.

[0098] Among them, the virtual scene template may refer to a scene template containing virtual scene rendering data and key image processing logic. An initial virtual scene can be rendered based on the virtual scene rendering data, and at the same time, the virtual lighting in the initial virtual scene can be dynamically adjusted according to the current virtual lighting parameters to obtain a standard virtual scene. In addition, in combination with the key image processing logic, the anchor image taken under the real lighting corresponding to the real lighting parameters can be synchronized to the standard virtual scene, and at the same time, the currently played audio segment can be synchronized to the standard virtual scene to obtain a target virtual live broadcast scene with synchronous changes in virtual lighting and real lighting.

[0099] An initial virtual scene can be rendered by a virtual engine according to the virtual scene rendering data, and the virtual lighting in the initial virtual scene can be adjusted according to the current virtual lighting parameters to obtain a standard virtual scene. At the same time, in combination with the key image processing logic, the anchor image data taken under the real lighting corresponding to the real lighting parameters can be synchronized to the standard virtual scene, and the current audio segment can be synchronized to the standard virtual scene to obtain a target virtual live broadcast scene, so as to synchronize the target virtual live broadcast scene to a live broadcast client through a server, so that the live broadcast client can interact with the anchor in the target virtual live broadcast scene in real time.

[0100] Figure 6 Schematically shows a schematic diagram of the process of the method for updating the target virtual live broadcast scene according to some embodiments of the present disclosure. Refer to Figure 6 As shown, the method for updating the target virtual live broadcast scene may include the following steps:

[0101] In step S610, when it is detected that the current audio segment has changed, an updated audio segment is obtained;

[0102] In step S620, determine the updated virtual lighting parameters corresponding to the updated audio segment based on the mapping relationship, and switch the current virtual lighting parameters to the updated virtual lighting parameters;

[0103] In step S630, call the updated light and shadow parameters of the host corresponding to the updated virtual lighting parameters, and determine the updated real lighting parameters according to the updated virtual lighting parameters and the updated light and shadow parameters of the host;

[0104] In step S640, obtain the updated host image data captured under the real lighting corresponding to the updated real lighting parameters, and update the target virtual live broadcast scene with the updated host image data and the updated audio segment.

[0105] Among them, when it is detected that the current audio segment changes, an updated audio segment can be obtained, and the updated virtual lighting parameters corresponding to the updated audio segment can be determined based on the mapping relationship between the audio segment and the virtual lighting parameters to generate a virtual lighting switching instruction. The virtual lighting switching instruction can be sent to the virtual engine, and the virtual engine can adjust the current virtual lighting to the updated virtual lighting corresponding to the updated virtual lighting parameters according to the virtual lighting switching instruction. At the same time, the updated light and shadow parameters of the host that also change with the change of the current audio segment can be read, and the light flux and light and shadow intensity of the updated real lighting parameters can be determined according to the updated virtual lighting parameters and the updated light and shadow parameters of the host.

[0106] After determining the updated real lighting parameters, the updated real lighting parameters can be transmitted to the SDK (Software Development Kit) of the real lighting system through TCP (Transfer Control Protocol), and the color temperature, brightness, intensity, color, etc. of the entity lighting can be adjusted to make the human figure light and shadow effect captured under the real lighting and the virtual lighting effect of the virtual live broadcast scene more integrated. In addition, by updating the target virtual live broadcast scene with the host image captured under the real lighting corresponding to the updated real lighting parameters and the updated audio segment, and sending the updated target virtual live broadcast scene to the server, the updated target virtual live broadcast scene can be synchronized to the live broadcast client through the server, realizing the real-time update of the target virtual live broadcast scene and improving the fluency of the interaction between the user and the host in the target virtual live broadcast scene.

[0107] For example, the current audio segment is a bass audio segment of 20 to 60 Hz. The current virtual light parameter corresponding to this bass audio segment is rhythm light with heavy beats and vibrations. The host light and shadow parameter corresponding to this rhythm light can be the area of the figure light and shadow where a circular blue light is projected onto the whole body of the host. Among them, the current virtual light parameter can include virtual light reflected light intensity data, virtual surface light intensity data, and virtual light refracted light intensity data. And the three primary color data of the current virtual light can be {"R": 30, "G": 152, "B": 69}. Furthermore, based on the current virtual light parameter and the area of the figure light and shadow of the host light and shadow parameter, the true light flux and true light and shadow intensity in the true light parameter can be calculated. If the calculated true light flux is 700 and the true light and shadow intensity is 36, then the three primary color data {"R": 30, "G": 152, "B": 69} in the current virtual light parameter, as well as the true light flux of 700 and the true light and shadow intensity of 36, can be sent to the true light system so that the true light system adjusts the physical light according to the three primary color data {"R": 30, "G": 152, "B": 69}, as well as the true light flux and true light and shadow intensity, to achieve synchronous changes between the virtual light and the true light.

[0108] When detecting that the current audio segment has changed, obtain the updated audio segment, and based on the mapping relationship between the audio segment and the virtual light parameter, determine the updated virtual light parameter corresponding to the updated audio segment. At the same time, by obtaining in real time the characteristic parameters of the host that change with the updated audio segment, and calling from the light and shadow parameter samples the updated host light and shadow parameter that matches the changed characteristic parameters of the host, to read the updated area of the figure light and shadow in the updated host light and shadow parameter, and combine the three primary color data, virtual light reflected light intensity data, virtual surface light intensity data, and virtual light refracted light intensity data in the updated virtual light parameter to determine the updated true light parameter, and transmit the true light parameter to the true light system. The true light system adjusts the true light device to obtain the updated true light. In addition, obtain the host image taken under the updated true light, and update the target virtual live broadcast scene according to this host image and the updated audio segment.

[0109] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be executed in this specific order, or that all the steps shown must be executed to achieve the desired result. Additionally or alternatively, some steps can be omitted, multiple steps can be combined into one step for execution, and / or one step can be decomposed into multiple steps for execution, etc.

[0110] In addition, in this exemplary embodiment, a light control device is also provided. Refer to Figure 7As shown, the lighting control device 700 includes: a data acquisition module 710, an actual lighting parameter determination module 720, an actual lighting parameter transmission module 730, and a target virtual live broadcast scene construction module 740. Among them: The data acquisition module 710 is used to acquire the currently played audio segment and the current virtual lighting parameters corresponding to the currently played audio segment; the actual lighting parameter determination module 720 is used to call the host light and shadow parameters corresponding to the current virtual lighting parameters, and based on the current virtual lighting parameters and the host light and shadow parameters, determine the actual lighting parameters; the actual lighting parameter transmission module is used to transmit the actual lighting parameters to the actual lighting system to obtain actual lighting, and acquire the host image data captured under the actual lighting; the target virtual live broadcast scene construction module 740 is used to construct a target virtual live broadcast scene with synchronous transformation of virtual lighting and actual lighting according to the host image data and the current virtual lighting parameters.

[0111] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the data acquisition module 710 includes a data acquisition unit, and the data acquisition unit is used to pre-acquire an audio data stream, perform spectrum analysis and sound frequency range division on the audio data stream to obtain an audio segment corresponding to the audio data stream; establish a mapping relationship between the audio segment and the virtual lighting parameters; acquire the currently played audio segment, and match and obtain a target audio segment identical to the currently played audio segment from the audio segments; based on the mapping relationship, determine the current virtual lighting parameters corresponding to the target audio segment.

[0112] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the actual lighting parameter determination module 720 includes a light and shadow transformation configuration information acquisition unit, and the light and shadow transformation configuration information acquisition unit is used to acquire light and shadow transformation configuration information; the light and shadow transformation configuration information is obtained by simulating the light and shadow transformation of a test object with sample characteristic parameters under test lighting; based on the light and shadow transformation configuration information, call the host light and shadow parameters corresponding to the current virtual lighting parameters.

[0113] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the actual lighting parameter determination module 720 further includes a host light and shadow parameter determination unit, and the host light and shadow parameter determination unit is used to read the characteristic parameters of the host, and when it detects that the characteristic parameters are the same as the sample characteristic parameters, determine the key light and shadow parameters corresponding to the characteristic parameters under the test lighting from the light and shadow parameter samples; match and obtain the target light and shadow parameters corresponding to the current virtual lighting parameters from the key light and shadow parameters, and use the target light and shadow parameters as the host light and shadow parameters.

[0114] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the real light parameter determination module 720 further includes a real light parameter determination unit, which is configured to read the portrait light and shadow area in the host light and shadow parameters, and determine the virtual reflected light intensity data, virtual surface light intensity data, and virtual refraction intensity data in the current virtual light parameters; based on the portrait light and shadow area, virtual light reflection intensity data, virtual surface light intensity data, and virtual light refraction intensity data, calculate the real light luminance, and calculate the real light light and shadow intensity according to the real light luminance; use the real light luminance and the real light light and shadow intensity as real light parameters.

[0115] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the target virtual live broadcast scene construction module 740 includes a target virtual live broadcast scene construction unit, which is configured to call a virtual scene template; the virtual scene template includes virtual scene rendering data and key image processing logic; render an initial virtual scene based on the virtual scene rendering data in the virtual scene template; adjust the initial virtual scene according to the current virtual light parameters to obtain a standard virtual scene; obtain a host image captured under the real light corresponding to the real light parameters, and synchronize the host image data to the standard virtual scene in combination with the key image processing logic, and synchronize the current audio segment to the standard virtual scene to obtain a target virtual live broadcast scene with synchronous transformation of virtual light and real light.

[0116] In some exemplary embodiments of the present disclosure, based on the foregoing solution, the light control device 700 further includes a target virtual live broadcast scene update module, which is configured to determine an updated audio segment when it detects that the current audio segment has changed; determine updated virtual light parameters corresponding to the updated audio segment based on the mapping relationship, and switch the current virtual light parameters to the updated virtual light parameters; call the updated host light and shadow parameters corresponding to the updated virtual light parameters, and determine updated real light parameters according to the updated virtual light parameters and the updated host light and shadow parameters; obtain updated host image data captured under the real light corresponding to the updated real light parameters, and update the target virtual live broadcast scene with the updated host image data and the updated audio segment.

[0117] The specific details of each module of the light control device described above have been described in detail in the corresponding light control method, so they will not be repeated here.

[0118] It should be noted that although several modules or units of the lighting control device are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0119] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above lighting control method is also provided.

[0120] Those skilled in the art can understand that various aspects of the present disclosure can be implemented as a system, a method, or a program product. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware embodiment, a complete software embodiment (including firmware, microcode, etc.), or an embodiment combining hardware and software aspects, which can be collectively referred to as "circuit", "module", or "system" here.

[0121] The following refers to Figure 8 to describe the electronic device 800 according to such an embodiment of the present disclosure. Figure 8 The illustrated electronic device 800 is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0122] As Figure 8 shown, the electronic device 800 is presented in the form of a general-purpose computing device. The components of the electronic device 800 may include, but are not limited to: at least one of the above-mentioned processing units 810, at least one of the above-mentioned storage units 820, a bus 830 connecting different system components (including the storage unit 820 and the processing unit 810), and a display unit 840.

[0123] Among them, the storage unit stores program codes, and the program codes can be executed by the processing unit 810, so that the processing unit 810 executes the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of this specification. For example, the processing unit 810 can execute as Figure 1In step S110 shown in the figure, obtain the currently played audio segment and the current virtual lighting parameters corresponding to the currently played audio segment; in step S120, call the host light and shadow parameters corresponding to the current virtual lighting parameters, and determine the real lighting parameters based on the current virtual lighting parameters and the host light and shadow parameters; in step S130, transmit the real lighting parameters to the real lighting system, and obtain the host image data captured under the real lighting system corresponding to the real lighting parameters; in step S140, construct a target virtual live broadcast scene with synchronous transformation of virtual lighting and real lighting according to the host image data and the current virtual lighting parameters.

[0124] The storage unit 820 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 821 and / or a cache storage unit 822, and may further include a read-only storage unit (ROM) 823.

[0125] The storage unit 820 may also include a program / utilities 824 having a set (at least one) of program modules 825. Such program modules 825 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment.

[0126] The bus 830 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of a variety of bus structures.

[0127] The electronic device 800 may also communicate with one or more external devices 870 (such as a keyboard, a pointing device, a Bluetooth device, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 800, and / or may communicate with any device that enables the electronic device 800 to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication may be through the input / output (I / O) interface 850. And, the electronic device 800 may also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 860. As shown in the figure, the network adapter 860 communicates with other modules of the electronic device 800 through the bus 830. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 800, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0128] From the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, mobile hard disk, etc.) or on the network, including several instructions to enable a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0129] In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having a program product stored thereon that can implement the above method of this specification. In some possible embodiments, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of this specification.

[0130] Refer to Figure 9 As shown, a program product 900 for implementing the above lighting control method according to an embodiment of the present disclosure is described. It can be a portable compact disc read-only memory (CD-ROM) and includes program code and can run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0131] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can, for example, but not be limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0132] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which readable program code is carried. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.

[0133] The program code contained on the readable medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0134] The program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0135] In addition, the above drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not for limiting purposes. It is easy to understand that the processes shown in the above drawings do not indicate or limit the chronological order of these processes. Additionally, it is also easy to understand that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0136] Through the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which may be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0137] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.

[0138] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A lighting control method, characterized in that, Including: Obtain the currently playing audio segment and the current virtual lighting parameters corresponding to the currently playing audio segment; Obtain the light and shadow transformation configuration information; the light and shadow transformation configuration information is obtained by simulating the light and shadow transformation of a test object with sample characteristic parameters under test lights; based on the light and shadow transformation configuration information, call the host light and shadow parameters corresponding to the current virtual lighting parameters; wherein, the host light and shadow parameters are the transformation parameters of the host portrait light and shadow simulated in the virtual live broadcast scene corresponding to the current virtual lighting parameters; read the portrait light and shadow area in the host light and shadow parameters, and determine the virtual reflected light intensity data, virtual surface light intensity data, virtual refraction intensity data, and three primary color data in the current virtual lighting parameters; based on the portrait light and shadow area, virtual light reflection intensity data, virtual surface light intensity data, and virtual light refraction intensity data, calculate the real light luminous flux, and calculate the real light light and shadow intensity according to the real light luminous flux; use the three primary color data, the real light luminous flux, and the real light light and shadow intensity as the real light parameters; Transmit the real light parameters to the real light system, and obtain the host image data captured under the real light system corresponding to the real light parameters; Construct a target virtual live broadcast scene with synchronous transformation of virtual light and real light according to the host image data and the current virtual lighting parameters.

2. The lighting control method according to claim 1, characterized in that, The obtaining the currently playing audio segment and the current virtual lighting parameters corresponding to the currently playing audio segment includes: Pre-obtain the audio data stream, and perform spectrum analysis and sound frequency range division on the audio data stream to obtain the audio segment corresponding to the audio data stream; Establish a mapping relationship between the audio segment and the virtual lighting parameters; Obtain the currently playing audio segment, and match and obtain the target audio segment identical to the currently playing audio segment from the audio segment; Based on the mapping relationship, determine the current virtual lighting parameters corresponding to the target audio segment.

3. The lighting control method according to claim 1, characterized in that, The light and shadow transformation configuration information includes sample characteristic parameters, test virtual lights, and light and shadow parameter samples. The calling the host light and shadow parameters corresponding to the current virtual lighting parameters based on the light and shadow transformation configuration information includes: Read the characteristic parameters of the host, and when it is detected that the characteristic parameters are the same as the sample characteristic parameters, determine the key light and shadow parameters corresponding to the characteristic parameters under the test lights from the light and shadow parameter samples; Match and obtain the target light and shadow parameters corresponding to the current virtual lighting parameters from the key light and shadow parameters, and use the target light and shadow parameters as the host light and shadow parameters.

4. The lighting control method according to claim 1, wherein The constructing a target virtual live broadcast scene with synchronous transformation of virtual light and real light according to the host image data and the current virtual lighting parameters includes: Call the virtual scene template; the virtual scene template includes virtual scene rendering data and key image processing logic; Render an initial virtual scene based on the virtual scene rendering data in the virtual scene template, and adjust the initial virtual scene according to the current virtual lighting parameters to obtain a standard virtual scene; and Obtain the host image captured under the real light corresponding to the real light parameters, synchronize the host image data to the standard virtual scene in combination with the key image processing logic, and synchronize the current played audio segment to the standard virtual scene to obtain a target virtual live scene with synchronous transformation of virtual light and real light.

5. The lighting control method according to claim 1 or 2, characterized in that, The method further includes: When it is detected that the currently played audio segment changes, obtain an updated audio segment; Based on the mapping relationship between the audio segment and the virtual lighting parameters, determine the updated virtual lighting parameters corresponding to the updated audio segment, and switch the current virtual lighting parameters to the updated virtual lighting parameters; Call the updated host lighting and shadow parameters corresponding to the updated virtual lighting parameters, and determine the updated real light parameters according to the updated virtual lighting parameters and the updated host lighting and shadow parameters; Obtain the updated host image data captured under the real light corresponding to the updated real light parameters, and update the target virtual live scene through the updated host image data and the updated audio segment.

6. A lighting control device, characterized in that, Includes: A data acquisition module for acquiring the currently played audio segment and the current virtual lighting parameters corresponding to the currently played audio segment; A real light parameter determination module for acquiring the light and shadow transformation configuration information; the light and shadow transformation configuration information is obtained by simulating the light and shadow transformation of a test object with sample characteristic parameters under a test light; calling the host light and shadow parameters corresponding to the current virtual lighting parameters based on the light and shadow transformation configuration information; wherein, the host light and shadow parameters are the transformation parameters of the host portrait light and shadow simulated in the virtual live scene corresponding to the current virtual lighting parameters; read the portrait light and shadow area in the host light and shadow parameters, and determine the virtual reflected light intensity data, virtual surface light intensity data, virtual refraction intensity data, and three primary color data in the current virtual lighting parameters; calculate the real light luminous flux based on the portrait light and shadow area, virtual light reflection intensity data, virtual surface light intensity data, and virtual light refraction intensity data, and calculate the real light light and shadow intensity according to the real light luminous flux; use the three primary color data, the real light luminous flux, and the real light light and shadow intensity as the real light parameters; A real light parameter transmission module for transmitting the real light parameters to the real light system to obtain real light, and acquiring the host image data captured under the real light; A target virtual live scene construction module for constructing a target virtual live scene with synchronous transformation of virtual light and real light according to the host image data and the current virtual lighting parameters.

7. An electronic device, comprising: A processor; And A memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, the lighting control method according to any one of claims 1 to 5 is implemented.

8. A computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the lighting control method according to any one of claims 1 to 5 is implemented.

Images