Music visualization method and device for light show

Abstract

In one aspect, a music visualization method for light show is provided. According to the method, artificial intelligence neural network machine learning is adopted, and judgment standards of multiple music modes are defined through training, so that any song can be identified to be composed of one or multiple music modes through the music mode detection neural network. In another aspect, a music visualization device for light show is provided. According to the device, different light show styles can be selected according to different music modes by using a real-time artificial intelligence music mode detection / beat detection result, and then a cool acousto-optic effect is realized through combination of light elements arranged on the device and intelligent processing. The music visualization device can generate a light show effect matched with music intensity, intensity, emotion style and the like, and creates an audio-visual effect with immersive artistic appeal.

Description

Technical Field

[0001] The inventive subject matter relates generally to music visualization, and more particularly to a music visualization method and a music visualization apparatus for a light show. Background Art

[0002] Light show is a performance that combines light art with music, performance and other elements to create a visual and auditory feast. Light shows are usually held in city squares, parks, theme parks, museums, concerts and concerts, and have become a novel cultural and artistic expression for people to entertain and watch at night.

[0003] While light shows are increasingly becoming an indispensable part of modern culture and art by showing the charm of human creativity, they are also gradually being used in indoor and outdoor environments such as homes and small parties, bars and nightclubs, or advertising conferences. Therefore, it is desirable to provide a more convenient and real-time music visualization method and device for light shows. This music visualization method can help many commercial units and private places related to light shows, including using party speakers, accessories, fixtures and other music visualization devices, to perform light shows in different occasions, so as to bring users a better music visualization experience. Summary of the invention

[0004] According to one aspect of the inventive subject matter, a music visualization method for a light show is provided, the steps of which may include constructing a music mode detection neural network through a music mode detection neural network unit; inputting a song to be played into a trained music mode detection neural network for detection based on time intervals, so as to detect the song as one of a plurality of music modes in each of its time intervals. The steps of the music visualization method may also include receiving a detection result of the music mode of the song to be played from the music mode detection neural network unit through a control unit and dynamically controlling a light element to display at least one of a plurality of light show styles accordingly while playing the song.

[0005] According to another aspect of the inventive subject matter, a music visualization device for a light show is provided. The music visualization device may include a music mode detection neural network unit. The music mode detection neural network unit is configured to construct and / or train a music mode detection neural network. The music mode detection neural network may input a song to be played therein to detect it based on a time interval, and detect it as one of a plurality of music modes in each of its time intervals. The music visualization device may also include a control unit configured to receive the music mode of the song to be played from the music mode detection neural network unit. The music visualization device may also include a lighting element, which may be or include a light source such as an LED. The lighting element may also be configured to be dynamically controlled by the control unit to display one of a plurality of light show styles accordingly while playing the song.

[0006] According to yet another aspect of the inventive subject matter, a non-transitory computer-readable medium having instructions stored thereon is provided, which, when executed by one or more processors, causes the one or more processors to perform the music visualization method for light show provided by the inventive subject matter. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] These and / or other features, aspects and advantages of the present invention will be better understood upon reading the following detailed description with reference to the accompanying drawings, wherein like characters represent like parts throughout, and wherein:

[0008] Figure 1 A flow chart showing a method for music visualization for a light show according to one or more embodiments of the inventive subject matter;

[0009] Figure 2 A schematic diagram illustrating exemplary music pattern detection neural network training in accordance with one or more embodiments of the inventive subject matter;

[0010] Figure 3 A structural block diagram of a music visualization device for light show according to one or more embodiments of the inventive subject matter is shown;

[0011] Figure 4A A front view showing a music visualization device for a light show in accordance with one or more embodiments of the inventive subject matter;

[0012] Figure 4B Another front view of a music visualization device for a light show according to one or more embodiments of the inventive subject matter is shown;

[0013] Figure 4CA perspective view showing a music visualization device for a light show according to one or more embodiments of the inventive subject matter;

[0014] Figure 4D A side view of a music visualization device for a light show is shown in accordance with one or more embodiments of the inventive subject matter;

[0015] Figure 5 A schematic diagram showing a mapping pattern 500 of a lighting element according to one or more embodiments of the inventive subject matter;

[0016] Figure 6A-6B A schematic diagram showing a lighting element designed to implement a windshield wiper-style swinging lighting action according to one or more embodiments of the present inventive subject matter;

[0017] Figure 7 , Figure 8A-8C , Figure 9A-9B as well as Figure 10A-10B Schematic diagrams showing respectively how to design a lighting element to realize a lighting action of longitudinal and / or lateral movement according to one or more embodiments of the present invention;

[0018] Figure 11A-11B A schematic diagram showing a lighting action in which a lighting element is designed to realize a rotational motion according to one or more embodiments of the present inventive subject matter, and

[0019] FIG. 12A to FIG. 12C A schematic diagram showing a lighting action in which a lighting element is designed to implement another rotational motion according to one or more embodiments of the present inventive subject matter. DETAILED DESCRIPTION

[0020] The following description of various embodiments is given for the purpose of illustration, but is not intended to be exhaustive or to limit the disclosed embodiments.Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments.

[0021] Generally speaking, the inventive subject matter provides a method for music visualization for a light show.

[0022] The music visualization method can detect music patterns and extract music information, such as physical information contained in the music, so that the music pattern of each music clip can be identified based on the physical information, and then the identified music pattern can be displayed by combining the music patterns with electromechanical devices. For example, the music rhythm, style, and mood information can be reflected by combining sound, light, and electricity into a speaker device, thereby creating a light show that changes the viewing atmosphere.

[0023] Figure 1 A flowchart 100 is shown of a method for music visualization for a light show in accordance with one or more embodiments of the inventive subject matter.

[0024] In order to combine the objective music measurement standard with the audience's perceived music experience, the inventive subject matter selects artificial intelligence neural network machine learning as a method for defining the threshold of each physical information of each music mode. Therefore, in the step of frame 102 of the music visualization method, it is first necessary to build a dynamic neural network so that the neural network can detect the music mode within each time range of the music by detecting the music mode, that is, to establish a music mode detection neural network, which can determine the music as one of multiple music modes through the judgment of artificial intelligence.

[0025] In some examples, after analyzing different music genres, four music modes can be obtained, for example. These four music modes represent four levels of music intensity and excitement (from 1 to 4). For example, music from mode 1 to mode 4 can represent four excitement and intensity levels from low to high in music. There are many measurement standards of physical information in music that can be used to define the intensity and excitement of music, including but not limited to: music speed, music intensity, diversity of instrument types, timbre saturation, attack degree, bass level, etc. However, intensity and excitement are an abstract conclusion, which should not only draw on the above standards, but also draw on the perceived music experience and mode level definition of real audiences.

[0026] Figure 2 A schematic diagram of an exemplary music pattern detection neural network 200 according to one or more embodiments of the inventive subject matter is shown. The music pattern detection neural network 200 is a dynamic neural network. In one or more embodiments of the inventive subject matter, the neural network 200 can detect any song or song segment input therein as one of the four music patterns.

[0027] like Figure 2 The music pattern detection neural network 200 shown first detects some key music representations of the song clip input from the input layer. These key music representations can be physical information carried in some music. For example, these key music representations may include, for example: (1) low attack speed, (2) low attack intensity, (3) high attack speed, (4) high attack intensity, (5) bass level, (6) instrument diversity, (7) vocal speed, and (8) vocal intensity. These key music representations enter the neural network for judgment, thereby detecting the music pattern of the input song clip.

[0028] In one or more embodiments of the inventive subject matter, the processing process of the music pattern detection neural network 200 can be described as follows: the above-mentioned eight music representations of the song clip are fed from the input layer to the corresponding eight neurons 212, 214, 216, 218, 222, 224, 226, and 228 of the first layer, each of which can represent a judgment criterion (threshold) for a key music representation, for example, the low-frequency sound attack speed is judged in neuron 212, the low-frequency sound attack intensity is judged in neuron 214, the high-frequency sound attack speed is judged in neuron 216, the high-frequency sound attack intensity is judged in neuron 218, the bass level is judged in neuron 222, the instrument diversity is judged in neuron 224, the vocal speed is judged in neuron 226, and the vocal intensity is judged in neuron 228, which can detect whether the key music representation corresponding to the song clip is within the threshold range.

[0029] The judgment result is applied with the corresponding weight when entering the next neuron, and their sum is sent as input to the neurons in the hidden layer 230. The deviations associated with each neuron in the neurons are also added to the sum, and then the output result of the activation function is used to determine whether a specific neuron will be activated. The activated neuron can transmit data to the neurons in the next layer. For example, if the judgment of neuron 212 and the judgment of neuron 216 are satisfied at the same time, then after entering the next layer, the judgment results of these two neurons 212 and 216 are merged into the same neuron 232 in the next layer, so the number of neurons making judgments in the next layer is reduced to seven, corresponding to the seven neurons 232, 234, 236, 238, 242, 244, 246 in the hidden layer 230. Then, after the judgment of this layer, the judgment criteria of two of the seven neurons, for example, neuron 232 and neuron 236, are met at the same time. In addition, the criteria of judging neuron 238 and judging neuron 244 are also met at the same time. Then, when entering the next layer, neurons 232 and 236 enter the same neuron 254, and neurons 238 and 244 also meet the conditions and enter the same neuron 258. The neurons in this layer become five 252, 254, 256, 258 and 260. It can be seen that the number of neurons gradually decreases when entering the next layer. Figure 2 shown.

[0030] Data is propagated through the network in such a way that it is forward propagated (e.g. Figure 2 (processing from left to right in the music pattern detection neural network 200). In the output layer, the neuron with the highest value fires and determines the output, which is basically a probability value. Figure 2In the neural network 200, the probability of judging that the music mode 1 is the highest is that the criteria of the five neurons 252, 254, 256, 258 and 260 are simultaneously met in the final output layer, so the output result of the output layer is the detection result 272, which means that the input song clip is judged to belong to the music mode 1. In the example of the music mode detection neural network 200, the judgment of the key representations is reduced from 8 to 7, and then to 5. However, in other examples, it can be reduced to even fewer key representations, so that a combination of judgment criteria for key representations of a specific mode can also be provided.

[0031] The neural network described above can detect a song clip as input and classify it into one of four musical modes.

[0032] However, in order to accurately judge the music pattern, the neural network must be trained before it is put into use to gradually reduce the judgment error and increase the probability of correct judgment.

[0033] During the training process of the neural network, the output is fed into the neural network in the same way as the input. The predicted output is compared with the actual output to obtain the error in the prediction. The size of the error indicates the degree of error, and the predicted value is higher or lower than expected. The predicted value information is then back-propagated through the neural network (such as Figure 2 The music pattern detection neural network 200 is processed from right to left), and forward propagation and back propagation are iteratively performed through multiple inputs, and the weights are adjusted simultaneously until the assigned weights enable the neural network to correctly predict the music pattern.

[0034] The method of the inventive subject matter uses song samples whose music patterns of each segment have been artificially identified for training the neural network. These song samples can be songs belonging to different styles or genres, such as but not limited to electronic dance music (EDM), rock, jazz, dubstep, technology music, R&B, country music, and pop music.

[0035] In the step of frame 104 of the music visualization method provided in the inventive subject matter, sufficient song samples are selected to train the music mode detection neural network. Each segment of these song samples has been manually identified as to which music mode it belongs to, for example, among the four music modes.

[0036] The following lists three groups of sample sets of exemplary original soundtrack music fragments and their music modes. In this example, the first group of original soundtrack music ST1, the second group of original soundtrack music ST2 and the third group of original soundtrack music ST3 are respectively from three song samples with different styles. The first group of original soundtrack music ST1 includes the sample sets of each fragment from the first song and its mode 1 to mode 4, the second group of original soundtrack music ST1 includes the sample sets of each fragment from the second song and its mode 1 to mode 4, and the third group of original soundtrack music ST1 includes the sample sets of each fragment from the third song and its mode 1 to mode 4. From the examples of these three groups of sample sets, it can be seen that the music modes of each fragment have been identified for these three songs, and the time range corresponding to each fragment is recorded according to different modes (mode 1 to mode 4).

[0037] Original Soundtrack ST1: Original Soundtrack ST2: Original Soundtrack ST3:

[0038] Mode 3 --- 1s-10s Mode 2 --- 1s-32s Mode 2 --- 1s-16s

[0039] Mode 4 --- 10s-21s Mode 1 --- 33s-40s Mode 3 --- 17s-28s

[0040] Mode 2 --- 22s-31s Mode 2 --- 40s-46s Mode 1 --- 29s-31s

[0041] Mode 1 --- 31s-33s Mode 3 --- 47s-1:18s Mode 3 --- 32s-47s

[0042] Mode 2 --- 34s-38s Mode 2 --- 1:19s-1:48s Mode 4 --- 48s-54s

[0043] Mode 3 --- 1:49s-2:04s Mode 3 --- 55s-1:03s

[0044] Mode 4 --- 2:05s-2:12s Mode 1 --- 1:04s-1:17s

[0045] Mode 3 --- 2:12s-2:18s Mode 2 --- 1:18s-1:30s

[0046] Mode 2 --- 2:19s-2:34s Mode 1 --- 1:31s-1:33s

[0047] Mode 4 --- 2:35s-2:43s Mode 3 --- 1:34s-1:48s

[0048] Mode 3 --- 2:44s-3:05s Mode 4 --- 1:49s-1:55s

[0049] Mode 2 --- 3:05s-3:18s Mode 3 --- 1:56s-2:01s

[0050] Mode 1 --- 3:19s-End Mode 2 --- 2:02s-2:05s

[0051] Mode 1---2:06s-End

[0052] like Figure 2 The music pattern detection neural network 200 shown, in the training example for music pattern 1, the segment identified as pattern 1 can be input into the pattern 1 input module 202 of the music pattern detection neural network 200, such as the song segment identified as pattern 1 from 31s to 33s in the original soundtrack ST1 can be used as a training sample for pattern 1. In addition, it can be seen from the three groups of original soundtracks ST1, ST2 and ST3 given above that the segments 33s-40s and 3:19s-End in the original soundtrack ST2 and the segments 29s-31s, 1:04s-1:17s, 1:31s-1:33s and 2:06s-End in the original soundtrack ST3 are also song segments belonging to pattern 1, which can also be input into the pattern 1 input module 202 of the music pattern neural network for iterative training of pattern 1. In some other examples, the segments identified as mode 1 in other song samples can also be input into the mode 1 input module 202 of the music mode detection neural network to train mode 1 for more iterations, and the input predictions of these mode 1 samples should all be judged as the detection output 272 of mode 1. The output 272 is used as input again and back-propagated by the music mode detection neural network 200. In this way, by using enough song samples for training, a standard range combination for mode 1 is obtained.

[0053] Similarly, for the training of training mode 2 in the music mode detection neural network, the segments identified as mode 2 in the original music ST1, ST2 and ST3 can be selected as mode 2 song segments and input into the mode 2 input module 204 of the neural network, and the output 274 of the output layer is used as input for back propagation. For example, the segments of 21s-31s and 31s-48s in the original music ST1, the segments of 1s-32s, 40s-46s, 1:19s-1:48s, 2:19s-2:34s and 3:05s-3:18s in the original music ST2, and the segments of 1s-16s, 1:18s-1:30s and 2:02s-2:05s in the original music ST3 are also song segments identified as mode 2, and they can also be input into the mode 2 input module 204 of the music mode detection neural network for iterative training of mode 2. Similarly, the segments identified as pattern 2 in other song samples can also be input into the pattern 2 input module 204 of the music pattern detection neural network to train pattern 2 for more iterations. Therefore, the music pattern detection neural network 200 trains the key music representation for music pattern 2 and provides the standard range combination of pattern 2 to the machine ( Figure 2 not shown).

[0054] According to the above description of the training of Mode 1 and Mode 2, it can be imagined that the segments identified as Mode 3 in the original music ST1, ST2 and ST3, and / or the segments identified as Mode 3 in other song samples can be input into the Mode 3 input module 206 of the music mode detection neural network 200, and the output 276 can be used as input to re-enter the music mode detection neural network 200 for back propagation to train Mode 3 for multiple iterations; the segments identified as Mode 4 in the original music ST1, ST2 and ST3 and / or other song samples can be input into the Mode 4 input module 208 of the music mode detection neural network 200, and the output 278 can be used as input to re-enter the music mode detection neural network 200 for back propagation to train Mode 4 for multiple iterations.

[0055] In one or more embodiments of the inventive subject matter, as the light and sound show designer inputs hundreds of songs that identify different music modes (from mode 1 to mode 4) in various time ranges into the neural network 200 for training, the machine learning program can obtain the corresponding thresholds of key music representations for each music mode (mode 1 to mode 4) based on the training of these hundreds of songs, that is, the combination mechanism of music mode measurement standards, which can cover most music cases and can "recognize" music modes in songs in a more intuitive way.

[0056] By loading the trained music pattern detection neural network onto the platform of the unit, such an artificial intelligence neural network can be used to detect the method of music patterns, thereby intelligently detecting the various music patterns and beats of the song to be played. In the description of the inventive subject matter here, the detection of four music patterns is used as an example, but it is conceivable that different music genres can also derive more music patterns, and the method of the inventive subject matter can also obtain more measurement standards to define more patterns of music intensity and / or excitement, thereby enriching the perceived music experience and pattern level definition of real audiences.

[0057] Afterwards, in Figure 1 In the steps of the box 106 shown, any song to be played can be input into the trained music mode detection neural network 200 for detection, so as to determine which of the multiple music modes each segment of the song belongs to. The music mode detection neural network 200 can detect the music mode of the song in real time based on a certain time interval. For example, the music mode detection neural network 200 can detect and update the music mode of the song every 1 second based on a frequency of 1 second time interval. A time interval or multiple consecutive time intervals in which the music mode detection neural network 200 outputs the same music mode can be recorded as a song segment of the song belonging to the music mode. It is conceivable that a song can have one or more song segments recorded as the same music mode.

[0058] In one or more embodiments of the inventive subject matter, the music pattern detection neural network 200 can be used to detect and record the music patterns of various segments of the song before playing the song, and then different light show styles can be displayed during the light show according to the changes in the music patterns.

[0059] In one or more embodiments of the inventive subject matter, the music mode detection neural network 200 can be used to detect and output the various music modes of the song segments it constitutes in real time while the song is playing. For example, the music mode detection neural network can detect the music mode of the song based on the time interval. For example, the music mode detection neural network can make a judgment on the music mode based on every 1 second of the song and output the detection result in real time, so that the style of the light show can be dynamically updated while the song is playing, and in this way, it is expected to provide a robust framework to achieve real-time light show design based on multiple music modes of the song.

[0060] In the design of the light show, the beat of the music can be obtained by extracting multiple peaks of loudness from the low-frequency and mid-frequency sounds. The strength of these beats can depend on the size of the corresponding peaks, that is, the intensity of the beats, and the high-intensity beats can be detected as the beats of the music. However, for the audience, a light show that can only flash / breathe with each beat is still not smart enough. For various party speaker categories, consumers may be looking for some kind of light show speaker with intelligent music mode detection, but it is not yet on the market.

[0061] In another aspect of the inventive subject matter, a music visualization device for a light show is also provided. This music visualization device can realize an intelligent light show performance based on artificial intelligence music pattern detection / beat detection. The music visualization device may include a control unit, which is configured to receive a music pattern detection result of a song segment to be played from a music pattern detection neural network. The control unit is also configured to design a corresponding light show style according to the music pattern of the song segment to be played. Moreover, the control unit can also be configured to control the lighting elements, for example, so that the lighting elements are controlled to emit a variety of light show styles such as different colors, brightness or flashing frequencies according to the music pattern of the song and its changes.

[0062] Figure 3A structural block diagram of a music visualization device 300 for a light show according to one or more embodiments of the inventive subject matter is shown. The music visualization device 300 may include a control unit 310. The control unit 310 may be configured to receive music mode detection results from a music mode detection neural network unit 320, and design various light show styles according to these detection results. For example, the music mode detection neural network unit 320 may be implemented as a module of the control unit 310. The control unit 310 may be configured to map the output of the music mode detection neural network unit 320 to a light element, thereby generating a light show with musical meaning. For example, the control unit 310 may map the detection results (modes 1 to 4) output by the music mode detection neural network unit 320 to various different light show styles, respectively or in combination. For example, a software application App may be embedded in the control unit 310 to design, modify and transform the light show styles and / or the light actions therein. The control unit 310 may be configured to control one or more light elements 330 to present these light show styles, thereby performing a light show performance. The control unit may be coupled to the one or more light elements via one or more connecting cables. In one or more examples, the control unit 310 can be electrically coupled to the one or more lighting elements 330 via a printed circuit board and control the lighting elements 330 to exhibit different lighting actions. In some examples, the music mode detection neural network unit 320 can be configured to implement various operations of the music mode detection neural network. In some examples, the lighting element 330 can be or include a light source, such as an LED light source. In some examples, the control unit 310 can be one or more processors soldered on a printed circuit board. The one or more processors can be any technically feasible hardware unit configured to process data and execute software applications, including but not limited to a central processing unit (CPU), a microcontroller unit (MCU), an application specific integrated circuit (ASIC), a digital signal processor (DSP) chip, etc.

[0063] The inventive subject matter also provides a non-transitory computer-readable medium 340 having instructions stored thereon, which, when executed by the one or more processors, causes the one or more processors to perform a music visualization method for a light show as provided by the inventive subject matter. In some examples, the one or more processors may be incorporated into the control unit 310 or may be disposed separately from the control unit 310.

[0064] The device for music visualization of light show provided by the inventive subject matter may be or include a speaker box, a portable speaker, a multimedia sound system, etc. equipped with a light element. A cool sound and light effect can be achieved by combining the light elements provided by it with the intelligent processing of an App, for example, in a control unit. These light elements may be arranged on the housing of the music visualization device and present various shapes and styles, such as strips, rings, and / or dots. These light elements may be or include light sources such as LEDs, whose colors, brightness, and switches are all controllable and variable. Different lighting effects may be designed according to different music modes, for example, different music modes may be mapped to dynamic transformations of at least one light show style. The music visualization device may produce lighting effects that match the intensity, intensity, emotional style, etc. of the music, allowing the light and shadow to dance with the music to create an audio-visual effect with immersive artistic appeal, thereby adding to the atmosphere of a family gathering.

[0065] Therefore, in Figure 1 As described in the step of box 108, the song to be played can be played through this music visualization device, so that a control unit can be used to dynamically display a variety of light show effects according to one or more music modes of the song determined in real time by the music mode detection neural network.

[0066] In one or more embodiments of the inventive subject matter, the music mode detection neural network is a dynamic neural network. For example, before a light show, the music mode detection neural network can be used to detect, output and record the music modes of each segment of the song, and then during the light show, the control unit dynamically controls the transformation of the corresponding various light show styles based on the music modes of each segment of the song. For example, a song is detected by the music mode detection neural network, and the time period of 0s-8s is recorded as music mode 1, the time period of 9s-29s is music mode 2, and the time period of 30s-60s is music mode 1, etc., then when performing the light show of the song, when the song is played to the 9th and 30th seconds, it is transformed into the light show style of the corresponding mode for display.

[0067] In one or more embodiments of the inventive subject matter, for example, while playing a song, the control unit can also control the lighting elements while the music mode detection neural network unit outputs the music mode detection result in real time to dynamically implement an intelligent light show performance according to the artificial intelligence music mode detection / beat detection. For example, the control unit can receive the music mode of the song detected by the music mode detection neural network unit in real time and synchronously update the light show style. For example, the control unit can receive the detection result of the music mode detection neural network once every 1 second based on the output of the music mode detection neural network and synchronously update (or not update) the light show style. For example, if a song is detected as music mode 1 in the first 1 second and music mode 3 in the second, the light show style corresponding to music mode 1 can be synchronously changed to the light show style corresponding to music mode 3 when the second second arrives; for another example, if a song is detected as music mode 3 in the first 1 second and still detected as music mode 3 in the second, the light show style can be changed in the second second, or it can not be changed.

[0068] In some examples, the control unit may also update the style of the light show asynchronously with the detection result of the received music mode detection neural network. For example, the control unit may set a maximum duration threshold for a particular music mode. For example, when the playing song continues the previous music mode for more than a certain duration, the control unit will automatically update or switch the light show style even if the continuously updated music mode detection result does not change. The duration may be set to, for example, a threshold of 15 seconds.

[0069] Figure 4A A front view of a device for music visualization of a light show according to one or more embodiments of the inventive subject matter is shown. The front view of the music visualization device presents that its front panel has a vertical rectangle with shorter upper and lower sides and longer left and right sides. Strip-shaped side light strips 402 are longitudinally arranged on the left and right sides of the rectangular front panel, respectively, and they overlap with the left and right sides of the front panel. A portion of an edge light strip 404 arranged along the upper and lower edges of the housing of the music visualization device is arranged at the upper and lower edges. In addition, a plurality of star-shaped light sources 406 scattered in a dotted manner are also arranged on the front panel of the music visualization device, and these star-shaped light sources 406 are embedded in the front panel. In addition, a strip-shaped flash light strip 408 is also horizontally arranged in a portion of the edge light strip 404 at the upper part of the front panel. In some examples, the flash light strip 408 can be provided with a plurality of LED light sources therein, so that the flash light strip 408 can irradiate strong light and form flashes.

[0070] In one or more embodiments of the inventive subject matter, the middle portion of the rectangular panel on the front of the music visualization device can be configured to have an 8-shaped light strip 410 composed of two ring structures. In some examples, the upper and lower rings of the 8-shaped light strip 410 can be respectively arranged to surround the circular outer edges of the upper and lower speakers arranged on the front panel of the music visualization device, so that the speaker speakers arranged therein can be illuminated while the 8-shaped light strip emits light. In some examples, the 8-shaped light strip 410 can be configured to use a dual spotlight lighting element, such as a halogen lamp or an LED lamp bead, and this unique lighting design that can illuminate the spotlight effect can enable the audience to experience an enhanced visual experience while performing a light show, while prompting the audience to identify the source of power in the sound.

[0071] Figure 4B Another front view of a music visualization device for a light show according to one or more embodiments of the inventive subject matter is shown. Figure 4A The 8-shaped light strip in the middle is different. Figure 4B The middle portion of the rectangular panel on the front of the music visualization device shown is configured so that the inner and outer edges of the figure 8 are arranged as light strips with contour lines thereof, referred to herein as figure 8 contour line light strips.

[0072] Depend on Figure 4B It can be seen that the bottom of the housing of the music visualization device can also emit light. It is conceivable that a downward-emitting light element, i.e., a projection light strip 414, is also arranged on the bottom panel of the device. In some examples, such a downward-emitting projection light strip 414 can project light downward onto, for example, a plane below (such as a desktop or floor). The shape of the projection light strip 414 can be, for example, a simple rectangle, as shown below Figure 5 In some other examples, the projection light strip 414 may also have other shapes and shapes. Correspondingly, the top panel of the music visualization device may also be correspondingly provided with a top panel light element (not shown), and an example of its arrangement may also be referred to in the following Figure 5 In some examples, the top panel light element can project light upward, for example, onto a plane above (such as a ceiling).

[0073] Figure 4C A perspective view of a music visualization device for a light show according to one or more embodiments of the inventive subject matter is shown. The perspective view shows a portion of the front panel and the right side panel. Figure 4ACorrespondingly, we can see the 8-shaped light strip 410 on the front and the side light strip 402 on the right. In addition, we can see that the edge light strip 404, in addition to being set on the upper and lower edges of the front panel, also continues to extend on the upper and lower edges of the side panel and the rear edge, forming a closed strip light strip.

[0074] Figure 4D A side view of a music visualization device for a light show according to one or more embodiments of the inventive subject matter is shown. Figure 4D Correspondingly, an arrangement of the other side not shown here can be envisaged, so that Figure 4D It can be more clearly seen and envisioned that the edge light strip 404 can be a closed strip light strip that continuously extends along the upper and lower edges of the rectangular front side, the upper and lower edges of the left and right side surfaces, and the rear edge of the music visualization device housing.

[0075] The light elements of various shapes described above may be or include light elements such as LEDs, whose colors, brightness, and switches are all controllable and changeable. Although the light strips described here are designed based on, for example, a speaker device with a vertical rectangular shell, various light strips with other arrangements may also be designed based on music visualization devices with other shapes without departing from the scope of the inventive subject matter.

[0076] Figure 5 FIG. 5 is a schematic diagram showing a mapping pattern 500 of a lighting element according to one or more embodiments of the present invention. The LED mapping pattern 500 is a mapping of various light strip patterns composed of the lighting elements described above to Figure 5 formed on the plane. FIG. 4A to FIG. 4D Correspondingly, Figure 5 5 shows various lighting elements mapped by lighting elements and / or light strips of various shapes, including, for example, side elements 502, edge elements 504, star point elements 506, flash elements 508, 8-shaped elements 510, 8-shaped outline elements 512, projection elements 514, and top panel elements 516. Among these lighting elements, the projection element 514 corresponds to the lighting element (e.g., Figure 4B The top panel element 516 corresponds to the light element disposed on the top panel.

[0077] Among these lighting elements, for example, a horizontal line lighting element may be further arranged between the upper and lower circular rings of the figure-8 element, which not only connects the upper and lower circular rings to form a figure-8, but also the upper circular ring, the horizontal line and the lower circular ring contained in the figure-8 element can be illuminated separately, thereby increasing the diversity of the transformation effect of the figure-8 element. In addition, the figure-8 contour line element is similar to the figure-8 element, and the circular rings arranged along the upper and lower inner edges of the figure-8 contour line element can be designed to surround the inner edges of the circular surfaces of the upper and lower speakers on the front panel of the music visualization device, wherein the closed outer contour line outside the two smaller circular rings and formed along the outer edge of the figure-8 element can be arranged in a manner such as Figure 5 The ellipse shown in the figure 8, so that the outer contour line, the upper ring and the lower ring contained in the figure 8 contour line element can also separately constitute different transformation effects of the figure 8 contour line element.

[0078] Next, the projection element 514 and the top panel element 516 respectively arranged on the bottom panel and the top panel of the music visualization device may have, for example, Figure 5 The top panel elements 516 can be arranged to correspond to, for example, various buttons or display areas on the top panel of the device; correspondingly, the projection elements 514 provided on the bottom panel can be arranged to, for example, dynamically project various patterns or elements onto the floor to increase the fun of the light show, or can be used for commercial purposes of the light show in some occasions.

[0079] Figure 6A-6B , Figure 7 , Figures 8A-8C , Figures 9A-9B , Figures 10A-10B , Figures 11A-11B as well as Figures 12A-12C Schematic diagrams of various lighting action designs for some lighting elements according to one or more embodiments of the present invention are shown respectively. Figure 3 As shown, the control unit can be configured to control one or more light elements arranged on the music visualization device according to the designed light show style, for example, controlling the color, brightness and / or switching of one or more LEDs to achieve changes in various light actions.

[0080] In one or more embodiments, the lighting element can be designed to implement a lighting motion such as a windshield wiper. Fig. 6A and Figure 6B As shown in the two frames shown successively, a portion of the upper ring 602 and a portion of the lower ring 604 of the 8-shaped element swing left and right in opposite directions, and can change directions at the same time when the beat arrives. Fig. 6AIn the first frame shown, the upper ring 602 first sweeps from left to right as indicated by arrow 606, and the lower ring 604 first sweeps from right to left as indicated by arrow 608. As the next beat arrives, as in Figure 6B The upper and lower circles shown in the figure change to those shown in the second frame at the same time, and the light that swept past returns again, that is, the upper circle 602' changes to sweeping from right to left as indicated by arrow 618, and at the same time the lower circle 604' changes to sweeping from left to right as indicated by arrow 616. The actions of these two frames are displayed repeatedly in this way, making the movement of the light look like a windshield wiper swinging back and forth on the windshield of a vehicle, creating a wiper-like swinging action effect.

[0081] In one or more embodiments, the light element can be designed to achieve a light action such as vertical and / or horizontal movement in the up, down, left, and right directions. Figure 7 As shown, the lights of the side elements 702 and 702' on both sides can be expanded or extinguished upward as indicated by arrow 704 and / or downward as indicated by arrow 706; for example, Figures 8A-8C In the three frames shown successively, first along the downward direction indicated by arrow 802, first in Fig. 8A The upper portion 812 of the light of the figure 8 element in the first frame shown appears from top to bottom, and then Figure 8B The middle part 814 of the light of the figure 8 element in the second frame is shown from top to bottom. Figure 8C In the third frame displayed, a lower part 816 of the light of the figure 8-shaped element is displayed from top to bottom; then it can be changed to the upward direction indicated by the arrow 804, first the lower part 816 of the light of the figure 8-shaped element appears from bottom to top, and then the middle part 814 and the upper part 812 are displayed successively from bottom to top, so that the figure 8-shaped element is displayed moving up and down in the longitudinal direction.

[0082] The light action of the longitudinal and / or lateral movement of the light element can also be designed to achieve, for example, an action of making the light flow like an electric current flowing through a wire, or an action of making the light streak across like a shooting star. Fig.9A and Fig. 9B The two frames that can be repeatedly displayed at intervals are shown in Fig.9A In the first frame, the lights of the upper and lower parts 904 and 914 of the edge element move in the directions indicated by the horizontal arrows 906 and 908, creating a motion effect like the lights flowing along the edge of the shell of the music visualization device. Then in the second frame, while the edge element is flowing in the left and right parts 904' and 914', the lights of the side elements 902 and 902' join in and move downwards as indicated by the vertical arrows 910 and 910', respectively, creating a motion effect like a shooting star.

[0083] Furthermore, the longitudinal and / or lateral movement of the light element can also be designed to achieve a light action such as closing or opening a door. Fig. 10A and Fig. 10B As shown respectively, Fig. 10A The combined lights including the side element 1002, the edge element 1004 and the figure-8 element 1010 appear from the left and right directions and spread out in the middle as indicated by the arrows 1006 and 1008, which can create the effect of a closed door. Fig. 10B As shown, the light combination including the side element 1002', the edge element 1004' and the figure-eight element 1010' appears from the upper and lower directions and spreads out in the middle as indicated by the arrows 1016 and 1018, which can create another gate closing effect. It can be imagined that such a pattern element combination is cut from the middle and gradually disappears in the upper and lower directions or in the left and right directions, that is, Fig. 10A and Fig. 10B If the movement directions indicated by the middle arrows are opposite, the effects of the door opening can be shown respectively.

[0084] In one or more embodiments, the lighting element can be designed to implement a lighting action such as a rotational motion. Fig.11A and Fig. 11B As shown in the two frames that can be displayed successively, Fig.11A In the first frame, a portion 1102 of the side element and a portion 1104 of the edge element rotate 360 ​​degrees in the clockwise direction indicated by arrow 1106, and the projection element 1114 rotates 360 degrees in the counterclockwise direction indicated by arrow 1118; as the next beat of the music arrives, it changes to Fig. 11B As shown in the second frame, a portion 1102' of the side element and a portion 1104' of the edge element are both rotated 360 degrees in the counterclockwise direction indicated by arrow 1108, while the projection element 1114 is also rotated 360 degrees in the counterclockwise direction indicated by arrow 1118'.

[0085] For example, Fig. 12A , Fig. 12B and Fig. 12C As shown in the three frames that can be displayed sequentially, Fig. 12A In the first frame shown, the side element 1202, the edge element 1204, the figure-8 element 1210, and the figure-8 outer contour 1212 are each formed into two diagonal parts and the light rotates around the center of the front panel of the music visualization device like a wheel hub. Fig. 12B In the second frame shown, the side element 1202', the edge element 1204', the figure-8 element 1210' and the figure-8 outer contour 1212' have rotated about 45 degrees counterclockwise at the same angular velocity. Fig. 12C In the third frame shown, the side element 1202", the edge element 1204", the figure-8 element 1210" and the figure-8 outer contour 1212" have simultaneously rotated half a circle, in this way creating an effect like a rotating wheel.

[0086] In addition, the light elements can be designed individually or in combination to form more diverse movements, such as wave-shaped movements, radial movements, etc. The various movement effects composed of lights are not limited to the examples listed herein, but also include other examples, which do not depart from the scope of the present invention.

[0087] It is understood that the various light show actions can be implemented by designing the light elements individually or in combination, including but not limited to the various examples described above. The design of these light elements within the framework can generally include: making the light elements change according to the detection information of the music mode, and / or making the light elements change synchronously or asynchronously with the light show beat.

[0088] Specifically, first, a simple cyclic light motion data can change linearly with the speed of the music beat, for example, it can be updated every 2 seconds according to the speed of the music beat. Next, as long as the change of the beat is detected, this simple cyclic light motion data will accelerate or decelerate. In addition, when a certain number of beats are detected (such as usually 1-4 beats), a single light element or a group of light elements can collide with each other (i.e., simultaneously) or switch (such as rotate) to present light changes. In one or more embodiments of the inventive subject matter, according to different isoluminous pattern designs, the cyclic motion of the light elements and their changes according to the music mode and rhythm can be arranged and combined in different proportions to form more and more complex light changes.

[0089] In one or more examples, when the music reaches very high intensity, for certain modes (such as reaching mode 4), the light show pattern can be set to have a fixed movement speed so it can keep looping quickly without having to sync with the beat. This flexible definition can help optimize the light show music visualization to a further level.

[0090] In one or more other examples, the display of light elements may have a hierarchical structure, for example, the lower the level of the music mode, the fewer light elements may be included in the light show. Moreover, in an action combining multiple light elements, various light element types may be synchronized with the beat of the music in the manner described above. Alternatively, the design and change of the light elements may also be designed to be asynchronous with the beat of the music.

[0091] In order to enrich the visual language of the light show, various light action styles are used in the inventive subject matter, where these different light show styles can be referred to as "different light show styles", and the output of the music mode detection neural network can be mapped to one or more of these light show styles. Each light show style can include multiple light actions. For example, during the same music mode playing time, according to the music mode detected by the music mode detection neural network, each light show style will be randomly played and changed between each different action, forming a variety of dynamic light patterns, and these light actions can be defined as belonging to this light show style.

[0092] In one or more embodiments of the inventive subject matter, one or more of these light elements can form at least six light motion styles according to different dynamic designs. These light motion styles include, for example, jumping, neon, cutting, switching, looping, and static. Each light motion style starts with its corresponding default initial color and can continuously change the color in a certain color change range. According to different music, each style has a combination of multiple light actions. One or more light elements arranged on the music visualization device can be controlled by the control unit to display various light show styles according to the music mode received by the control unit. For example, the combination and light action of one or more light elements can be displayed in a controlled manner. For example, the color, brightness and / or switch of one or more light actions can be displayed in a controlled manner to achieve the change of various light effects. In some examples, the light elements can be controlled by the control unit to display and change the light show motion style based on the time interval of receiving the music mode detection result. In some examples, each action style contains different combinations of light elements, and the duration of each combination can be set to, for example, 15 seconds at most. That is to say, even if a certain music mode has not changed to the next music mode after 15 seconds, the light action style of the light show will be switched to another combination of the mode.

[0093] The following is a summary of various combination examples of some exemplary light action patterns in a table, and the detection results (e.g., Mode 1 to Mode 4) output by the music mode detection neural network can be mapped to these light action patterns. The detection results (e.g., Mode 1 to Mode 4) output by the music mode detection neural network can be mapped to one or more light action combinations of these light action patterns. Each light action pattern can, for example, have an initial default color of the light, and these light colors can change with the transformation of the light action pattern. It is conceivable that the light action patterns and various transformations designed and adopted in the actual light show are not limited to this, and do not depart from the scope of the inventive subject matter.

[0094] For the jumping light motion style, for a song having, for example, four music modes 1-4, the four combinations C1-C4 of dynamic light changes included therein can be summarized as described in Table 1 below:

[0095]

[0096]

[0097]

[0098] Table 1. Lighting action combinations of jumping lighting motion styles

[0099] For the neon light motion style, for a song having, for example, four music modes 1-4, the three combinations C1-C3 of dynamic light changes included therein can be summarized as described in Table 2 below:

[0100]

[0101]

[0102] Table 2. Combinations of neon light motion styles

[0103] For the switching light motion style, for a song having, for example, four music modes 1-4, the four combinations C1-C4 of dynamic light changes included therein can be summarized as described in the following Table 3:

[0104]

[0105]

[0106] Table 3. Lighting action combinations of switching lighting motion styles

[0107] For the cut-type light motion style, for a song having, for example, four music modes 1-4, the three combinations C1-C3 of light dynamic transformations included therein can be summarized as described in Table 4 below:

[0108]

[0109]

[0110] Table 4. Lighting action combinations of cutting-type lighting motion styles

[0111] For the cyclic light motion style, for a song having, for example, four music modes 1-4, the three combinations C1-C3 of light dynamic changes included therein can be summarized as described in the following Table 5:

[0112]

[0113]

[0114] Table 5. Lighting action combinations for cyclical lighting motion styles

[0115] For the static light motion style, for all music modes, a combination C1 of dynamic light changes included therein may be as described in Table 6 below:

[0116]

[0117] Table 6. Lighting action combinations for static lighting motion styles

[0118] The device for music visualization of light shows provided by the inventive subject matter can generally be based on music changes, and can adjust the light pattern accordingly by sensing the external environment and / or the user's body posture to match the light changes. In a light show that matches the music changes and environmental characteristics, the device can use lights of various colors, intensities and shapes, and create various atmospheres and scenes through light changes, flashing, jumping, etc., to convey the harmonious unity of light and people, light and environment, and light and atmosphere.

[0119] Examples of one or more implementations of the inventive subject matter are described in the following clauses:

[0120] Clause 1. A method for visualizing music for a light show, the method comprising:

[0121] Constructing a music pattern detection neural network through a music pattern detection neural network unit;

[0122] Inputting a song to be played into the music pattern detection neural network for detection based on time intervals, so as to detect the song as one of a plurality of music patterns in each time interval thereof;

[0123] The control unit receives the detection result of the music mode in the song to be played from the music mode detection neural network unit and controls the lighting elements to correspondingly display at least one of a plurality of light show styles while playing the song.

[0124] Clause 2. A method as described in Clause 1, wherein the method further comprises training a music pattern detection neural network to obtain a combination of judgment criteria for key music representations of each of a plurality of music patterns.

[0125] Clause 3. A method as described in clauses 1 to 2, wherein the music pattern detection neural network is trained by using song samples whose segments have been individually defined as known music patterns, the known music pattern being one of a plurality of music patterns.

[0126] Clause 4. A method as described in any one of Clauses 1 to 3, wherein the key music characterization includes at least one of the following: low-frequency sound attack speed, low-frequency sound attack intensity, high-frequency sound attack speed, high-frequency sound attack intensity, bass level, instrument diversity, vocal speed, and vocal intensity.

[0127] Clause 5. A method as described in any one of Clauses 1 to 4, wherein the control unit dynamically updates at least one of the multiple light show styles displayed based on the detection result of the music pattern of the song received in real time from the music pattern detection neural network unit at each time interval while playing the song.

[0128] Clause 6. A method as described in any one of Clauses to Clause 5, wherein each of the plurality of light show patterns is designed according to one or more of a plurality of music patterns.

[0129] Clause 7. The method of any one of clauses 1 to 6, wherein each of the plurality of light show patterns comprises a combination of at least one light motion.

[0130] Clause 8. The method of any one of clauses 1 to 7, wherein at least one of the plurality of light show styles comprises at least one of the following: jumping, neon, cutting, switching, looping, and static.

[0131] Clause 9. The method of any one of clauses 1 to 8, wherein the combination of the at least one lighting motion changes according to the beat of a song.

[0132] Clause 10. The method of any one of clauses 1 to 3, wherein the combination of the at least one lighting action changes according to the duration of the music pattern of the song.

[0133] Clause 11. A music visualization device for a light show, the device comprising:

[0134] A music pattern detection neural network unit is configured to construct a music pattern detection neural network, which inputs a song to be played into the music pattern detection neural network to detect it based on time intervals and detects it as one of a plurality of music patterns in each time interval;

[0135] a control unit configured to receive a detection result of a music pattern in the song from the music pattern detection neural network unit;

[0136] The lighting element is configured to be dynamically controlled by the control unit to display at least one of a plurality of light show styles accordingly while playing various segments of the song.

[0137] Clause 12. An apparatus as described in Clause 11, wherein the music pattern detection neural network unit is further configured to identify each of the time intervals of the song as one of the multiple music patterns based on key music representations.

[0138] Clause 13. An apparatus as described in any one of Clauses 11 to 12, wherein the key music characterization includes at least one of the following: low frequency sound attack speed, low frequency sound attack intensity, high frequency sound attack speed, high frequency sound attack intensity, bass level, instrument diversity, vocal speed, and vocal intensity.

[0139] Clause 14. An apparatus as described in any one of Clauses 11 to 13, wherein the control unit dynamically updates at least one of the multiple light show styles displayed based on the detection result of the music pattern of the song received in real time from the music pattern detection neural network unit at each time interval while playing the song.

[0140] Clause 15. The device of any one of clauses 11 to 14, wherein the lighting element is configured to be mapped in combination into a plurality of lighting elements.

[0141] Clause 16. An apparatus as described in any one of Clauses 11 to 15, wherein each of the plurality of lighting elements comprises at least one of: a side element, an edge element, a star point element, a flash element, an 8-shaped element, an 8-shaped outline element, a projection element, and a top panel element.

[0142] Clause 17. The device of any one of clauses 11 to 16, wherein the plurality of lighting elements are designed to implement each of the plurality of lighting actions.

[0143] Clause 18. The device of any one of clauses 11 to 17, wherein at least one of the plurality of light show patterns is designed according to one or more of the plurality of music patterns.

[0144] Clause 19. The device of any one of clauses 11 to 18, wherein at least one of the plurality of light show patterns comprises a combination of at least one light motion.

[0145] Clause 20. The device of any one of clauses 11 to 19, wherein at least one of the plurality of light show styles comprises at least one of the following: jumping, neon, cutting, switching, looping, and static.

[0146] Clause 21. The device of any one of clauses 11 to 20, wherein the combination of the at least one lighting motion changes according to the beat of a song.

[0147] Clause 22. The device of any one of clauses 11 to 21, wherein the combination of the at least one lighting action changes according to the duration of the music pattern of each segment of the song.

[0148] Clause 23. A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to perform the method for music visualization for a light show as described in Clauses 1-10.

[0149] The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

[0150] In the above, reference is made to the embodiments presented in the present disclosure. However, the scope of the present disclosure is not limited to the specifically described embodiments. On the contrary, any combination of the aforementioned features and elements, whether or not related to different embodiments, is contemplated as implementing and practicing the contemplated embodiments.

[0151] In addition, although the embodiments disclosed herein may achieve advantages over other possible solutions or over the prior art, whether or not a given embodiment achieves a particular advantage does not limit the scope of the present disclosure. Therefore, the foregoing aspects, features, embodiments and advantages are merely illustrative and are not considered to be elements or limitations of the appended claims unless expressly recited in the claims.

[0152] While the foregoing is directed to embodiments of the present disclosure, other and further embodiments of the disclosure may be devised without departing from the basic scope thereof, and the scope of the disclosure is determined by the claims that follow.

Claims

1. A music visualization method for a light show, the method comprising: Constructing a music pattern detection neural network through a music pattern detection neural network unit; Inputting a song to be played into the music mode detection neural network for detection based on time intervals, so as to detect the song as one of a plurality of music modes in each time interval; The control unit receives the detection result of the music mode in the song from the music mode detection neural network unit and dynamically controls the lighting elements to correspondingly display at least one of a plurality of light show styles while playing the song.

2. The method of claim 1, wherein: The method also includes training a music pattern detection neural network to obtain a combination of judgment criteria for key music representations of each of a plurality of music patterns.

3. The method of claim 2, wherein: The music pattern detection neural network is trained by using song samples whose respective segments have been respectively and artificially defined as a known music pattern, which is one of the plurality of music patterns.

4. The method of claim 2, wherein: The key music characterization includes at least one of the following: low frequency sound attack speed, low frequency sound attack intensity, high frequency sound attack speed, high frequency sound attack intensity, bass level, instrument diversity, vocal speed, and vocal intensity.

5. The method of claim 2, wherein: The control unit dynamically updates at least one of the multiple light show styles displayed based on the music pattern of the song received in real time from the music pattern detection neural network unit at each time interval while playing the song.

6. The method of claim 1, wherein: At least one of the plurality of light show styles is designed according to one or more of the plurality of music modes.

7. The method of claim 6, wherein: At least one of the plurality of light show styles includes a combination of at least one light motion.

8. The method of claim 6, wherein: At least one of the plurality of light show styles includes at least one of the following: jumping, neon, cutting, switching, looping, and static.

9. The method of claim 7, wherein: The combination of the at least one lighting action changes according to the beat of the song.

10. The method of claim 7, wherein: The combination of the at least one lighting action changes according to the duration of the music pattern of the song.

11. A music visualization device for a light show, the device comprising: A music pattern detection neural network unit is configured to construct a music pattern detection neural network, wherein the music pattern detection neural network inputs a song to be played, detects the song based on time intervals, and detects the song as one of a plurality of music patterns in each time interval; a control unit configured to receive a detection result of the music pattern in the song from the music pattern detection neural network unit; A lighting element is configured to be dynamically controlled by the control unit to display at least one of a plurality of light show styles accordingly while playing the song.

12. The device of claim 11, wherein: The music pattern detection neural network unit is also configured to identify each time interval of the song as one of multiple music patterns based on key music representations.

13. The device of claim 11, wherein: The key music characterization includes at least one of the following: low frequency sound attack speed, low frequency sound attack intensity, high frequency sound attack speed, high frequency sound attack intensity, bass level, instrument diversity, vocal speed, and vocal intensity.

14. The device of claim 11, wherein: The control unit dynamically updates at least one of the plurality of light show styles displayed based on the music pattern of the song received in real time from the music pattern detection neural network at each time interval while playing the song.

15. The device of claim 11, wherein: The lighting elements are configured to be mapped in combination into a variety of lighting elements.

16. The device of claim 15, wherein: Each of the plurality of lighting elements includes at least one of: a side element, an edge element, a star point element, a flash element, an 8-shaped element, an 8-shaped outline element, a projection element, and a top panel element.

17. The device of claim 16, wherein: The various lighting elements are designed to implement each of the various lighting actions separately or in combination.

18. The device of claim 11, wherein: At least one of the plurality of light show styles is designed according to one or more of the plurality of music modes.

19. The device of claim 11, wherein: At least one of the plurality of light show styles includes a combination of at least one light motion.

20. The apparatus of claim 11, wherein at least one of the plurality of light show styles comprises at least one of: jumping, neon, cutting, switching, looping, and static.

21. The apparatus of claim 19, wherein: The combination of the at least one lighting action changes according to the beat of the various segments of the song.

22. The apparatus of claim 19, wherein: The combination of the at least one lighting action changes according to the duration of the music modes of the respective segments of the song.

23. A non-transitory computer readable medium having stored thereon instructions, which when executed by one or more processors cause the one or more processors to perform the music visualization method for a light show as described in claims 1-10.

Images