Method and system for controlling atmosphere lighting in science and education venues and integrating audio and video data

Abstract

The present invention belongs to the field of computer technology. A method and system for controlling the fusion of atmosphere lights and audio and video data in science and education venues are provided. The method includes: extracting the display content type from the first audio and video data of the first exhibition hall, and analyzing and obtaining the display scene specifications and the first atmosphere light control parameters based on the first audio and video data; determining a number of display screens for displaying the first audio and video data according to the display scene specifications, and determining the first display area set of the atmosphere light according to the distribution position of each display screen; receiving the second display area set and the second atmosphere light control parameters of the adjacent second exhibition hall, and comprehensively analyzing the atmosphere light control parameters and the display area sets of the two exhibition halls to obtain the third display area set; controlling the atmosphere light of the first exhibition hall to output the atmosphere light color according to the third display area set and the first atmosphere light control parameters. The present invention realizes the best intelligent control of the atmosphere light through the regional control of the atmosphere light and the consideration of the adjacent exhibition halls.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and system for controlling the fusion of atmosphere lights in science and education venues and audio and video data. Background Art

[0002] Science and education venues are important places to popularize scientific knowledge and improve the public's scientific literacy. They stimulate the public's interest in science and the spirit of exploration, especially among young people, through exhibitions, interactive experiences, and educational activities.

[0003] Audio and video data are commonly used in science and education venues to output relevant scientific knowledge content. In order to enhance the immersion of young people in learning these scientific knowledge, some science and education venues have linked audio and video data with the atmosphere lights in the venues. When outputting audio and video data, the linkage system will determine the control parameters of the atmosphere lights according to the specific content contained in the audio and video data, thereby achieving an organic integration of the atmosphere lights and audio and video data. For example, when the video being played is about ocean exploration, the atmosphere lights turn dark blue to adapt to the ocean scene.

[0004] However, in the prior art, the solution for integrating the above-mentioned atmosphere lights with audio and video data still has many shortcomings, such as the inability to perform targeted regional control of the atmosphere lights and failure to consider the coordination of the atmosphere lights in adjacent display areas, which urgently need to be improved. Summary of the invention

[0005] In this regard, the present invention provides a method, system, electronic device, computer storage medium and computer program product for controlling the fusion of atmosphere lights and audio and video data in a science and education venue to solve the above technical problems.

[0006] The present invention provides a method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue, the method comprising the following steps: receiving first audio and video data to be displayed in a first exhibition hall, extracting a display content type from the first audio and video data, and analyzing and deriving a display scene specification and a first atmosphere light control parameter according to the display content type; determining and deriving a plurality of display screens for displaying the first audio and video data according to the display scene specification, and determining and deriving a first display area set of the atmosphere light according to the distribution position of each of the display screens; receiving a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and comprehensively analyzing the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; and controlling the atmosphere light of the first exhibition hall to output an atmosphere light color according to the third display area set and the first atmosphere light control parameter.

[0007] In some embodiments, the extracting of the display content type from the first audio and video data, and analyzing the display scene specifications and the first atmosphere light control parameters based on the display content type include: using a 3D convolutional neural network model to extract the display content type from the first audio and video data, wherein the display content type includes any one of a close-up type, a mid-shot type, and a long-shot type, and also includes scene attribute information; determining the display scene specifications based on the display content type and a preset comparison table, and determining the first atmosphere light control parameters based on the scene attribute information.

[0008] In some embodiments, the extracting of display content types from the first audio and video data, and analyzing the display scene specifications and the first atmosphere light control parameters based on the display content types also include: using a 3D convolutional neural network model to extract several display content types from the first audio and video data, each display content type including any one of a close-up type, a mid-shot type, and a long-shot type, and also including scene attribute information; determining the corresponding display scene specifications based on each display content type and a preset comparison table, determining the corresponding third atmosphere light control parameters based on each scene attribute information, and integrating each third atmosphere light control parameter into the second atmosphere light control parameter.

[0009] In some embodiments, the determining of a number of display screens for displaying the first audio and video data according to the display scene specifications, and the determining of a first display area set of atmosphere lights according to the distribution positions of each of the display screens, include: determining a number of display screens for displaying the first audio and video data according to the display scene specifications, wherein each of the display screens is adjacent to each other, and the two display screens located at the outermost periphery are determined as edge display screens; matching the atmosphere light segments with each of the display screens according to the distribution positions of each of the display screens and each atmosphere light segment in the first exhibition hall, and determining the atmosphere light segments located outside the two edge display screens as edge atmosphere light segments; determining a portion of the edge atmosphere light segments for atmosphere display according to the number of the display screens, wherein the length of the portion used for atmosphere display is positively correlated with the number of the display screens; and deriving the first display area set based on the portion of each edge atmosphere light segment used for atmosphere display and each non-edge atmosphere light segment.

[0010] In some embodiments, the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set are comprehensively analyzed to obtain the third display area set, including: extracting the first part of the edge atmosphere light segment for atmosphere display from the first display area set, extracting the second part of the edge atmosphere light segment for atmosphere display from the second display area set, and calculating the distance value between the first part and the second part; inputting the first atmosphere light control parameter, the second atmosphere light control parameter, and the distance value into an atmosphere interference analysis model to obtain an atmosphere interference index obtained by analysis; wherein the atmosphere interference analysis model is obtained by fine-tuning and training a general large model; if the atmosphere interference index is higher than an interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is retracted to obtain the third display area set; if the atmosphere interference index is lower than the interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is used as the third display area set.

[0011] In some embodiments, the atmosphere interference analysis model is obtained by fine-tuning and training in the following manner: collecting several groups of atmosphere light control parameter pairs, the atmosphere light control parameter pairs including a third atmosphere light control parameter, a fourth atmosphere light control parameter, a set distance value, and an artificially calibrated atmosphere interference index label; using each of the atmosphere light control parameter pairs to fine-tune the general large model to obtain the atmosphere interference analysis model.

[0012] The present invention also provides a system for controlling the fusion of atmosphere lights and audio and video data in science and education venues, the system comprising a processing module and a storage module, the storage module storing computer program code, the processing module executing the computer program code to implement the following steps: receiving first audio and video data to be displayed in a first exhibition hall, extracting the display content type from the first audio and video data, and analyzing the display scene specifications and first atmosphere light control parameters according to the display content type; determining a number of display screens for displaying the first audio and video data according to the display scene specifications, and determining a first display area set of atmosphere lights according to the distribution positions of each of the display screens; receiving a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and performing a comprehensive analysis of the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; controlling the atmosphere lights of the first exhibition hall to output the atmosphere light color according to the third display area set and the first atmosphere light control parameter.

[0013] The present invention also provides an electronic device, comprising: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor executes the computer program to implement any of the methods described above.

[0014] The present invention also provides a computer storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement any of the above methods.

[0015] The present invention also provides a computer program product, wherein the computer program includes a number of computer codes, and when the computer codes are executed by a processor, any of the above methods is implemented.

[0016] The solution of the present invention determines the display area of ​​the atmosphere light for integrated display by analyzing the content of audio and video data, and also takes into account the mutual influence of the atmosphere lights in adjacent exhibition halls, and finally determines the optimal atmosphere light display area, so that the fusion result of the atmosphere light and audio and video data in the exhibition hall of the science and education venue is better, and a better immersive experience can be provided for the teenagers in the exhibition hall. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a flow chart of a method for controlling atmosphere lighting in a science and education venue and fusing audio and video data disclosed in an embodiment of the present invention.

[0019] Figure 2 It is a schematic diagram of the layout of display screens in an exhibition hall disclosed in an embodiment of the present invention.

[0020] Figure 3 It is a structural schematic diagram of a system for controlling atmosphere lighting in a science and education venue and integrating audio and video data disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The following is a description of the implementation of the present application by specific specific embodiments. People familiar with the technology can easily understand other advantages and effects of the present application from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0022] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0023] like Figure 1 As shown, an embodiment of the present invention discloses a method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue, the method comprising the following steps: receiving first audio and video data to be displayed in a first exhibition hall, extracting a display content type from the first audio and video data, and analyzing the display scene specifications and first atmosphere light control parameters according to the display content type; determining a number of display screens for displaying the first audio and video data according to the display scene specifications, and determining a first display area set of atmosphere lights according to the distribution positions of the display screens; receiving a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and comprehensively analyzing the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; controlling the atmosphere lights of the first exhibition hall to output the atmosphere light colors according to the third display area set and the first atmosphere light control parameter.

[0024] The science and education venue includes multiple exhibition halls, some of which are adjacent exhibition halls, and each exhibition hall is equipped with a corresponding audio and video data display screen and atmosphere light. On this basis, the present invention first understands the content of the first audio and video data to be displayed in the first exhibition hall, extracts the display content type, and analyzes the display scene specifications and the first atmosphere light control parameters based on the display content type. Among them, the display scene specification is used to characterize how many display screens in the first exhibition hall are needed to coordinate the display of the first audio and video data, and then according to the display scene specification, a number of display screens used to display the first audio and video data can be calculated, and then according to the layout of each display screen and the atmosphere light, the first display area set of atmosphere lights that need to be coordinated can be determined. The first display area set contains the numbers of each atmosphere light that needs to coordinate with the first audio and video data.

[0025] At the same time, the second display area set and the second atmosphere light control parameters of the second exhibition hall adjacent to the first exhibition hall are also received, and the display area sets and the atmosphere light control parameters of the first exhibition hall and the second exhibition hall are comprehensively analyzed to derive a more suitable third display area set, which can ensure that the atmosphere light effect of the first exhibition hall will not affect the atmosphere light effect of the second exhibition hall.

[0026] Finally, the atmosphere light of the first exhibition hall is controlled to output the atmosphere light color according to the third display area set and the first atmosphere light control parameter. Thus, the atmosphere light in the first exhibition hall is integrated with the audio and video data, thereby providing a better immersive experience for the teenagers in the first exhibition hall.

[0027] The solution of the present invention determines the display area of ​​the atmosphere light for integrated display by analyzing the content of audio and video data, and also takes into account the mutual influence of the atmosphere lights in adjacent exhibition halls, and finally determines the optimal atmosphere light display area, so that the fusion result of the atmosphere light and audio and video data in the exhibition hall of the science and education venue is better, and a better immersive experience can be provided for the teenagers in the exhibition hall.

[0028] In some embodiments, the extracting of the display content type from the first audio and video data, and analyzing the display scene specifications and the first atmosphere light control parameters according to the display content type include: using a 3D convolutional neural network model to extract the display content type from the first audio and video data, wherein the display content type includes any one of a close-up type, a mid-shot type, and a long-shot type, and also includes scene attribute information; determining the display scene specifications according to the display content type and a preset comparison table, and determining the first atmosphere light control parameters according to the scene attribute information.

[0029] In this embodiment, the 3D convolutional neural network model is an extension of CNN. The three-dimensional convolution kernel can be used to directly extract the spatiotemporal features of the video, and the spatial and temporal information can be considered simultaneously in the model, thereby accurately obtaining the display content type contained in the first audio and video data. The display content type includes the depth of field type and the scene attribute information. The depth of field type is the close-up type, the mid-range type, and the long-range type, while the scene attribute information refers to the ocean scene, grassland scene, human scene, science fiction scene, etc.

[0030] The display scene specification can be determined according to the display content type and the preset comparison table. The display scene specification is used to characterize the optimal display screen size of the first audio and video data. In the present invention, the display screen size is formed by splicing multiple display screens. The preset comparison table contains display scene specifications corresponding to the close-up type, the mid-view type, and the long-view type, and the display scene specifications of the three types gradually increase.

[0031] Also, different scene attributes should be configured with different atmosphere light control parameters, including but not limited to light color, brightness, light color switching speed, etc., so as to enhance the integration of atmosphere and content, and thus bring a better immersive experience effect. For example, the light color corresponding to the ocean scene is blue, the light color corresponding to the grassland scene is green, the light color corresponding to the humanities scene is warm white, and the light color corresponding to the science fiction scene is titanium gray; and, different brightness can be configured for the above-mentioned multiple scene attributes, and the brightness can be adapted to the picture brightness of the first audio and video data, and the light color switching speed can be determined according to the picture switching speed of the first audio and video data. The faster the picture switching speed, the faster the rhythm of the audio and video content, and the faster the light color switching speed between different light colors is set to achieve adaptation.

[0032] It should be noted that the 3D convolutional neural network model typically includes 3D convolutional layers, activation functions, 3D pooling layers (MaxPool3D), batch normalization layers, fully connected layers, Dropout layers and other main functional layers. Among them, the 3D convolutional layer uses a 3D convolution kernel to filter the input data to extract spatial and temporal features, and each convolutional layer usually contains multiple filters (or kernels), each of which is responsible for detecting specific features in the input data. The construction and training process of the 3D convolutional neural network model will not be repeated here.

[0033] In some embodiments, the extracting of display content types from the first audio and video data, and analyzing the display scene specifications and the first atmosphere light control parameters based on the display content types also include: using a 3D convolutional neural network model to extract several display content types from the first audio and video data, each display content type including any one of a close-up type, a mid-shot type, and a long-shot type, and also including scene attribute information; determining the corresponding display scene specifications based on each display content type and a preset comparison table, determining the corresponding third atmosphere light control parameters based on each scene attribute information, and integrating each third atmosphere light control parameter into the second atmosphere light control parameter.

[0034] In this embodiment, the first audio and video data may also include multiple different paragraphs, such as an ocean paragraph, a grassland paragraph, a science fiction paragraph, etc. Therefore, a 3D convolutional neural network model can be used to extract several display content types from the above-mentioned first audio and video data, and then a number of third atmosphere light control parameters are obtained by analyzing in the same way as above, and each third atmosphere light control parameter corresponds to the above-mentioned different paragraphs. Finally, all these third atmosphere light control parameters are sorted and integrated according to the order of the above-mentioned paragraphs in the first audio and video data to obtain the second atmosphere light control parameter.

[0035] In some embodiments, the determining of a number of display screens for displaying the first audio and video data according to the display scene specifications, and the determining of a first display area set of atmosphere lights according to the distribution positions of each of the display screens, include: determining a number of display screens for displaying the first audio and video data according to the display scene specifications, wherein each of the display screens is adjacent to each other, and the two display screens located at the outermost periphery are determined as edge display screens; matching the atmosphere light segments with each of the display screens according to the distribution positions of each of the display screens and each atmosphere light segment in the first exhibition hall, and determining the atmosphere light segments located outside the two edge display screens as edge atmosphere light segments; determining a portion of the edge atmosphere light segments for atmosphere display according to the number of the display screens, wherein the length of the portion used for atmosphere display is positively correlated with the number of the display screens; and deriving the first display area set based on the portion of each edge atmosphere light segment used for atmosphere display and each non-edge atmosphere light segment.

[0036] In this embodiment, a plurality of display screens are generally arranged horizontally at a certain interval in the exhibition hall, so that each display screen is adjacent to each other, and each atmosphere light segment (not shown in the figure) is arranged at intervals from each display screen. In this way, a portion of the picture is displayed on each of the plurality of display screens, and each portion of the picture can be "joined" into a complete picture. Moreover, the arrangement of multiple display screens is more difficult to construct and more cost-effective than that of a single large-size display screen.

[0037] Specifically, according to the display scene specifications determined above, several display screens for displaying the first audio and video data can be further determined, such as Figure 2 As shown (the gray one in the figure is the selected display screen). Obviously, the number of display screens is positively correlated with the above-mentioned display scene specifications. According to the distribution positions of each display screen and each atmosphere light segment in the first exhibition hall, the atmosphere light segment is matched with each display screen, so that the edge display screen and the edge atmosphere light segment located outside the edge display screen are obtained. For non-edge atmosphere light segments, a full lighting method is adopted to achieve fusion with the first audio and video data, while for edge atmosphere light segments, a partial lighting method is adopted for fusion. Starting from the end of the edge atmosphere light segment close to the edge display screen, it spans to the end away from the edge display screen until it spans to the specified length, and the specified length is positively correlated with the number of display screens. The part of each edge atmosphere light segment used for atmosphere display and each non-edge atmosphere light segment constitute the first display area set.

[0038] The edges of the picture observed by the human eye are relatively blurred and weakened. Therefore, by setting the edge atmosphere light segments in the above manner, the edges of the atmosphere light can be "blurred" and "weakened", which is adapted to the viewing effect of the human eye. In addition, the edge atmosphere light segments can also be set to adopt a gradient effect to further enhance the above-mentioned edge "blurring" and "weakening" effects. In addition, the method for determining the lighting length of the edge atmosphere light segment can also improve the naturalness of the edge transition of the overall atmosphere light segment.

[0039] In some embodiments, the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set are comprehensively analyzed to obtain the third display area set, including: extracting the first part of the edge atmosphere light segment for atmosphere display from the first display area set, extracting the second part of the edge atmosphere light segment for atmosphere display from the second display area set, and calculating the distance value between the first part and the second part; inputting the first atmosphere light control parameter, the second atmosphere light control parameter, and the distance value into an atmosphere interference analysis model to obtain an atmosphere interference index obtained by analysis; wherein the atmosphere interference analysis model is obtained by fine-tuning and training a general large model; if the atmosphere interference index is higher than an interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is retracted to obtain the third display area set; if the atmosphere interference index is lower than the interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is used as the third display area set.

[0040] In this embodiment, the first display area set of the first exhibition hall and the second display area set of the adjacent second exhibition hall respectively include the first part and the second part of the edge atmosphere light segment for atmosphere display, and the distance value between the first part and the second part can be calculated according to the layout positions of the two parts, and the distance value can be used to analyze whether the actual effect of the atmosphere light used for fusion with the second audio and video data in the second exhibition hall will be affected by the atmosphere light of the first exhibition hall, or whether the actual effect of the atmosphere light used for fusion with the first audio and video data in the first exhibition hall will be affected by the atmosphere light of the second exhibition hall. Generally speaking, if the distance is far enough, it can be determined that it is not affected, otherwise it may be affected.

[0041] However, the above interference effect is not only related to the distance, but also to the atmosphere light control parameters in the first exhibition hall and the second exhibition hall. For example, there will be obvious differences between some light colors, and this difference will cause the consistency of the effect of the teenagers participating in the exhibition hall watching the audio and video data to be destroyed, thereby reducing the sense of immersion. For example, the first exhibition hall is playing a science fiction scene, and the corresponding atmosphere light color is titanium gray, flaming red, and green light multi-color switching. Moreover, the content of the science fiction scene has a brisk rhythm, and the switching speed of the above light colors is fast. The adjacent second exhibition hall is playing an ocean scene, and the corresponding atmosphere light color is blue, and the switching speed of multiple light colors is slow. In this way, the atmosphere light of the first exhibition hall will have an impact on the second exhibition hall, so it is necessary to adjust the first display area set of the first exhibition hall. Specifically, if the atmosphere interference index is higher than the interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is retracted to obtain the third display area set; if the atmosphere interference index is lower than the interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is used as the third display area set, that is, the first display area set is not retracted. Among them, the above-mentioned "retraction processing" can be to remove a part of the non-edge atmosphere light segments, or to appropriately shorten the length of the edge atmosphere light segments used for atmosphere display, and the number of non-edge atmosphere light segments removed or the length of the shortened part of the edge atmosphere light segments used for atmosphere display can be determined according to a positive correlation based on the above-mentioned atmosphere interference index, that is, the higher the atmosphere interference index of the first exhibition hall to the second exhibition hall, the greater the number of removals or shortened lengths.

[0042] The above is explained using the example of the first exhibition hall interfering with the atmosphere lighting effect of the second exhibition hall. In fact, the second exhibition hall will also interfere with the atmosphere lighting effect of the first exhibition hall. The specific processing method is the same and will not be repeated here.

[0043] It should be noted that some exhibition halls in the science and education exhibition hall are relatively closed, and the atmosphere lights between the exhibition halls will not interfere with each other, but there are still a large number of exhibition halls that are relatively open, and the interference of the atmosphere lights between the exhibition halls still needs to be considered. This is exactly the practical application requirement of the solution of the present invention.

[0044] In some embodiments, the atmosphere interference analysis model is obtained by fine-tuning and training in the following manner: collecting several groups of atmosphere light control parameter pairs, the atmosphere light control parameter pairs including a third atmosphere light control parameter, a fourth atmosphere light control parameter, a set distance value, and an artificially calibrated atmosphere interference index label; using each of the atmosphere light control parameter pairs to fine-tune the general large model to obtain the atmosphere interference analysis model.

[0045] In this embodiment, the general large model (LLMs) has billions or even hundreds of billions of parameters, and its design goal is to improve the expressiveness and predictive performance of the model so that it can handle more complex tasks and data. The general large model learns complex patterns and features by training massive data, has a stronger generalization ability, and can make accurate predictions on unseen data. However, the general large model is generally "large in size" and difficult to deploy locally directly. Therefore, the present invention uses pre-built training data to fine-tune the general large model, so as to obtain a "slimmed down" dedicated to analyzing the degree of atmosphere interference felt by the human eye when two sets of atmosphere light control parameters are at a specific distance, that is, the atmosphere interference index. The present invention does not make any limitation to the above-mentioned general large model, but preferably uses mature models that have been widely recognized, such as ChatGPT, KIMI, Wenxin Yiyan, Tongyi Qianwen, etc.

[0046] The format of the training data is [third atmosphere light control parameter, fourth atmosphere light control parameter, set distance value, atmosphere interference index label]. The above training data can be measured, that is, two groups of atmosphere lights are arranged in two areas of the set distance value, and they are controlled to execute the third atmosphere light control parameter and the fourth atmosphere light control parameter respectively, so that multiple people can perform actual sensing and fill in the corresponding atmosphere interference index, and the average value of all atmosphere interference indexes is used as the atmosphere interference index label corresponding to the group [third atmosphere light control parameter, fourth atmosphere light control parameter, set distance value].

[0047] like Figure 3 As shown, an embodiment of the present invention also discloses a system for controlling the fusion of atmosphere lights and audio and video data in science and education venues, the system comprising a processing module and a storage module, the storage module storing computer program code, the processing module executing the computer program code to implement the following steps: receiving first audio and video data to be displayed in a first exhibition hall, extracting a display content type from the first audio and video data, and analyzing the display scene specifications and first atmosphere light control parameters according to the display content type; determining a number of display screens for displaying the first audio and video data according to the display scene specifications, and determining a first display area set of atmosphere lights according to the distribution positions of the display screens; receiving a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and comprehensively analyzing the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; controlling the atmosphere lights of the first exhibition hall to output the atmosphere light colors according to the third display area set and the first atmosphere light control parameters.

[0048] An embodiment of the present invention further discloses an electronic device, comprising: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor executes the computer program to implement the method described in the above embodiment.

[0049] An embodiment of the present invention further discloses a computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is executed by a processor to implement the method described in the above embodiment.

[0050] The embodiment of the present invention further discloses a computer program product. The computer program includes a number of computer codes. When the computer codes are executed by a processor, any of the above methods is implemented.

[0051] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0052] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0053] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue, characterized in that: The method comprises the following steps: receiving first audio and video data to be displayed in a first exhibition hall, extracting a display content type from the first audio and video data, and analyzing and obtaining a display scene specification and a first atmosphere light control parameter according to the display content type; Determine a number of display screens for displaying the first audio and video data according to the display scene specifications, and determine a first display area set of atmosphere lights according to the distribution positions of the display screens; receive a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and perform a comprehensive analysis on the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; control the atmosphere lights of the first exhibition hall to output atmosphere light colors according to the third display area set and the first atmosphere light control parameter.

2. A method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue according to claim 1, characterized in that: Extracting a display content type from the first audio and video data, and analyzing the display content type to obtain a display scene specification and a first atmosphere light control parameter, including: using a 3D convolutional neural network model to extract the display content type from the first audio and video data, the display content type including any one of a close-up type, a mid-shot type, and a long-shot type, and also including scene attribute information; determining the display scene specification based on the display content type and a preset comparison table, and determining the first atmosphere light control parameter based on the scene attribute information.

3. A method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue according to claim 2, characterized in that: The method further comprises: extracting a display content type from the first audio and video data, analyzing the display content type to obtain a display scene specification and a first atmosphere light control parameter, and using a 3D convolutional neural network model to extract a plurality of the display content types from the first audio and video data, wherein each display content type comprises any one of a close-up type, a mid-shot type, and a long-shot type, and also comprises scene attribute information; determining the corresponding display scene specification according to each display content type and a preset comparison table, determining the corresponding third atmosphere light control parameter according to each scene attribute information, and integrating each third atmosphere light control parameter into the second atmosphere light control parameter.

4. The method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue according to claim 3, characterized in that: Determine a number of display screens for displaying the first audio and video data according to the display scene specifications, and determine a first display area set of atmosphere lights according to the distribution positions of each of the display screens, including: determine a number of display screens for displaying the first audio and video data according to the display scene specifications, each of the display screens is adjacent to each other, and the two display screens located at the outermost periphery are determined as edge display screens; match the atmosphere light segments with each of the display screens according to the distribution positions of each of the display screens and each atmosphere light segment in the first exhibition hall, and determine the atmosphere light segments located outside the two edge display screens as edge atmosphere light segments; determine a portion of the edge atmosphere light segments for atmosphere display according to the number of the display screens, wherein the length of the portion used for atmosphere display is positively correlated with the number of the display screens; and derive the first display area set based on the portion of each edge atmosphere light segment used for atmosphere display and each non-edge atmosphere light segment.

5. A method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue according to claim 4, characterized in that: A comprehensive analysis is performed on the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set, including: extracting the first part of the edge atmosphere light segment for atmosphere display from the first display area set, extracting the second part of the edge atmosphere light segment for atmosphere display from the second display area set, and calculating the distance value between the first part and the second part; inputting the first atmosphere light control parameter, the second atmosphere light control parameter, and the distance value into an atmosphere interference analysis model to obtain an atmosphere interference index obtained by analysis; wherein the atmosphere interference analysis model is obtained by fine-tuning and training a general large model; if the atmosphere interference index is higher than an interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is retracted to obtain the third display area set; if the atmosphere interference index is lower than the interference threshold and the atmosphere interference index is that the first exhibition hall interferes with the second exhibition hall, the first display area set is used as the third display area set.

6. A method for controlling the fusion of atmosphere lights and audio and video data in a science and education venue according to claim 5, characterized in that: The atmosphere interference analysis model is obtained by fine-tuning and training in the following manner: collecting a plurality of sets of atmosphere light control parameter pairs, wherein the atmosphere light control parameter pairs include a third atmosphere light control parameter, a fourth atmosphere light control parameter, a set distance value, and an artificially calibrated atmosphere interference index label; The atmosphere light control parameters are used to perform fine-tuning training on the universal large model to obtain the atmosphere interference analysis model.

7. A system for controlling the fusion of atmosphere lights and audio and video data in a science and education venue, the system comprising a processing module and a storage module, the storage module storing computer program codes, characterized in that: The processing module executes the computer program code to implement the following steps: receiving first audio and video data to be displayed in the first exhibition hall, extracting the display content type from the first audio and video data, and analyzing the display scene specification and the first atmosphere light control parameter according to the display content type; Determine a number of display screens for displaying the first audio and video data according to the display scene specifications, and determine a first display area set of atmosphere lights according to the distribution positions of the display screens; receive a second display area set and a second atmosphere light control parameter of a second exhibition hall adjacent to the first exhibition hall, and perform a comprehensive analysis on the first atmosphere light control parameter, the first display area set, the second atmosphere light control parameter, and the second display area set to obtain a third display area set; control the atmosphere lights of the first exhibition hall to output atmosphere light colors according to the third display area set and the first atmosphere light control parameter.

8. An electronic device comprising: At least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor executes the computer program to implement the method according to any one of claims 1 to 6.

9. A computer storage medium storing a computer program, characterized in that: The computer program is executed by a processor to implement the method according to any one of claims 1 to 6.

10. A computer program product, characterized in that: The computer program includes a number of computer codes, and when the computer codes are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images