Brainwave audio and video encoding and playback system

Abstract

A brainwave audio and video encoding and playback system includes a head-mounted instrument for monitoring a subject's brainwave signals, the head-mounted instrument comprising a headband, a brainwave monitor, and a concentration and relaxation index calculator for calculating the subject's brainwave concentration index and relaxation index; a processing unit for receiving and processing the brainwave signals output by the head-mounted instrument; the processing unit including a melody conversion mechanism for converting the subject's brainwave signals during a period of time into corresponding musical melodies according to a specific algorithm; a color conversion mechanism for converting the subject's brainwave signals during a period of time into corresponding multiple colors according to a specific algorithm; a music playback mechanism for playing the musical melodies obtained by the melody conversion mechanism; and a screen display mechanism for displaying the various colors obtained by the color conversion mechanism.

Description

Technical Field

[0001] The present invention relates to the application of brain wave analysis, and more particularly to a brain wave audio and video encoding and playback system. Background Art

[0002] In the academic research of existing technologies, in-depth research has been conducted on the brain wave phenomena corresponding to various human brain activities (including relaxation, hearing, memory, attention, logical judgment, vision, and reaction). The corresponding brain wave values can be calculated based on different brain activities for analysis purposes.

[0003] Delta waves, Theta waves, High / Low Alpha waves, High / Low Beta waves, and High / Low Gamma waves in the left and right brains of the human body have different physical and physiological meanings, and also indicate different states of the subject. Therefore, by measuring these different brain waves and performing numerical calculations, the degree of corresponding characteristics of the subject can be determined. The relevant numerical calculation methods have been extensively studied in academia. Furthermore, the use of EEG devices to measure brain waves and then use algorithms in the chip to determine the degree of corresponding characteristics of the subject has also been deeply explored in academia.

[0004] With ever-increasing technological advancements, a crucial aspect of the "Metaverse" is how to mimic authentic human qualities so they can be integrated into virtual game worlds and create a more realistic environment. Using a non-invasive head-mounted EEG monitor, one can monitor changes in brainwave activity at any time. Human emotions are reflected in brainwaves, creating rhythmic fluctuations in these waves. The emotions reflected by these brainwaves also have a similar correlation to our perception of color. For example, when we are anxious, our brainwaves cause colors to appear dark and trembling, while when we are depressed, our brainwaves correspond to grayish colors.

[0005] Based on our understanding and expertise in this area, combined with years of experience in cutting-edge scientific research, the inventors aim to map these rhythmic changes in brainwaves to changes in melody and color in music, and present them through music and video. By broadcasting music and video, the brainwave message is conveyed, allowing those around us to resonate with the music.

[0006] A novel brainwave feature digitization coding system is proposed to address the above-mentioned shortcomings of the prior art. Summary of the Invention

[0007] The present invention aims to address the aforementioned problems in the prior art by proposing a brainwave audio-visual encoding and playback system. Based on years of research and understanding of brainwaves, the inventors have identified the relationship between brainwave fluctuations and the human body's perception of musical rhythms and color brightness. These fluctuations are then mapped to musical melodies and image colors. This has led to the creation of the aforementioned rules, which allow for the display of brainwave fluctuations through music playback and image display. By conveying brainwave information through music and image display, the system allows those around them to resonate with the music and image.

[0008] To achieve the above-mentioned objectives, the present invention proposes a brainwave audio and video encoding and playback system, comprising a head-mounted device for monitoring brainwave signals of a subject, the head-mounted device comprising a headband, a brainwave monitor located on the headband for monitoring brainwaves, a concentration and relaxation index calculator connected to the brainwave monitor for applying a specific algorithm to the brainwave monitoring data to obtain the subject's brainwave concentration index and relaxation index, and an electroencephalogram transceiver connected to the brainwave monitor and the concentration and relaxation index calculator for transmitting brainwave signals; a processing unit connected to the head-mounted device for receiving and processing a series of brainwave signals output by the head-mounted device; these brainwave signals include Delta waves, Theta waves, High / Low Alpha waves, High / Low Beta waves, and High / Low Beta waves of the left and right brains of the human body. Gamma waves, and concentration (Attention) index and relaxation (Meditation) index; the processing unit includes a processing end transceiver connected to the electroencephalogram transceiver of the head-mounted instrument, for receiving signals transmitted from the electroencephalogram transceiver; a melody conversion mechanism connected to the processing end transceiver, for converting the brain wave signals of the subject in a period of time into corresponding musical melodies according to a specific algorithm; a color conversion mechanism connected to the processing end transceiver, for converting the brain wave signals of the subject in a period of time into corresponding colors according to a specific algorithm; a music playing mechanism connected to the melody conversion mechanism, for playing the musical melody obtained by the melody conversion mechanism; and a screen display mechanism connected to the color conversion mechanism, for displaying various colors obtained by the color conversion mechanism.

[0009] Preferably, the melody conversion mechanism includes:

[0010] A brain wave change calculation unit calculates the intensity difference D between each of the two adjacent time points t-1 and t for each brain wave parameter X of the subject. t , t is greater than 0; wherein the brain wave parameter X is selected from At t, Me d, δ, θ, α - , α+ , β - , β + , γ - , γ + ; Among them, At t represents the concentration index, Med represents the relaxation index, δ represents the Delta wave, θ represents the Theta wave, α - Indicates Low Alpha wave, α + Indicates High Alpha wave, β - Indicates Low Beta wave, β + Indicates High Beta wave, γ - Represents Low Gamma wave, γ + Indicates High Gamma wave;

[0011] A coding unit is connected to the brain wave change calculation unit, and encodes the change of the intensity difference corresponding to each brain wave parameter X as the intensity difference of each brain wave parameter X in the time period T. n The corresponding binary value of the time period T n represents the nth time period, where n is greater than 0; the encoding unit establishes a coding table with these binary values, and the coding table uses each brain wave parameter X as a row, and the time period T n As a column; wherein each binary value in the coding table is represented as X(T n ) or T n (X), X(T n ) represents the row and time period T corresponding to the brain wave parameter X n The binary value at the intersection of the corresponding columns, T n (X) represents the time period T n The binary value at the intersection of the corresponding column and the row corresponding to the brain wave parameter X, that is, X(T n ) and T n (X) will correspond to the binary value of the same position in the code table;

[0012] A range conversion unit is connected to the encoding unit, and is configured to convert the time periods T in the encoding table into n The binary values of the concentration index and relaxation index are selected, the corresponding range mode is selected, and different conversion rules are applied in each range mode to convert the binary value of each brain wave parameter X in the coding table into the value of the time period T n corresponding musical notes and pitches, each musical note being converted from a binary value of at least one corresponding brainwave parameter; and

[0013] A melody creation unit is connected to the range conversion unit, and the time segments T converted by the range conversion unit are converted according to a specific algorithm. n The notes in the game are arranged in a specific order, and each time period T is established. nThe music melody is output to the music playing mechanism for playing.

[0014] Preferably, the encoding unit determines X(T n ) value is as follows: n With D n-1 All are greater than 0, or all are less than 0, or all are 0, or D n Greater than 0 and D n-1 0 or D n Less than 0 and D n-1 is 0, then X(T n ) is 0;

[0015] When D n With D n-1 One of them is greater than 0 and the other is less than 0, or D n is 0 and D n-1 Greater than 0, or D n is 0 and D n-1 is less than 0, then X(T n ) is 1.

[0016] Preferably, the range conversion unit is based on T n The value of (At t, Med) determines the time period T n The range mode, where T n (At t,Me d)=T n (At t)×2+T n (Me d); each range mode includes multiple note ranges, each note range includes at least one corresponding note, and each note is generated in a specific order; the pitch range of each note range is one octave, and the pitches of the corresponding notes in the multiple note ranges differ by an octave; wherein 0 to 7 are defined as eight notes in one octave; wherein the brain wave parameter sequence K is defined as "δ, θ, α - , α + , β - , β + , γ - , γ + ,δ,θ,α - , α + "; where the i-th element of sequence K is K i express.

[0017] Preferably, when T n (At t, Me d) = 0, it is the first range mode, and its note ranges are the first note range, the second note range, the third note range, and the fourth note range in ascending order of pitch;

[0018] The first note range is in the time period T n The notes are:

[0019] δ(T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ),as well as

[0020] θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 );

[0021] The second note range is in the time period T n The notes are:

[0022] (α - )(T n )×2 2 +(α - )(T n+1 )×2+(α - )(T n+2 ),as well as

[0023] (α + )(T n )×2 2 +(α + )(T n+1 )×2+(α + )(T n+2 );

[0024] The third note range is in the time period T n The notes are:

[0025] (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ),as well as

[0026] (β + )(T n )×2 2 +(β + )(T n+1 )×2+(β + )(T n+2 );

[0027] The fourth note range is in the time period T n The notes are:

[0028] (γ - )(T n)×2 2 +(γ - )(T n+1 )×2+(γ - )(T n+2 ),as well as

[0029] (γ + )(T n )×2 2 +(γ + )(T n+1 )×2+(γ + )(T n+2 ).

[0030] Preferably, when T n (At t, Me d) = 1, it is the second range mode, and its note ranges are the first note range, the second note range, and the third note range in ascending order of pitch;

[0031] The first note range is in the time period T n The notes are:

[0032] (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ),as well as

[0033] (Me d)(T n )×2 2 +(Me d)(T n+1 )×2+(Me d)(T n+2 );

[0034] The second note range is in the time period T n The notes are:

[0035] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 1 to 8;

[0036] The third note range is in the time period T n The notes are:

[0037] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(Ki )(T n+2 ), where i = 1 to 8;

[0038] The second note range and the third note range are converted into corresponding notes in sequence according to the value of i from small to large.

[0039] Preferably, when T n (At t, Me d) = 2, which is the third range mode. Its note ranges are the first note range, the second note range, the third note range, and the fourth note range in ascending order of pitch.

[0040] The first note range is in the time period T n The notes are:

[0041] (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ),as well as

[0042] (Me d)(T n )×2 2 +(Me d)(T n+1 )×2+(Me d)(T n+2 );

[0043] The second note range is in the time period T n The notes are:

[0044] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 1 to 8;

[0045] The third note range is in the time period T n The notes are:

[0046] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 1 to 4;

[0047] The fourth note range is in the time period T n The notes are:

[0048] (Ki )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 5 to 8;

[0049] The second note range, the third note range and the fourth note range are converted into corresponding notes in sequence according to the value of i from small to large.

[0050] Preferably, when T n (At t, Me d) = 3, which is the fourth range mode. Its note ranges are the first note range, the second note range, the third note range, and the fourth note range in ascending order of pitch.

[0051] The first note range is in the time period T n The notes are:

[0052] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 1 to 4;

[0053] The second note range is in the time period T n The notes are:

[0054] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 5 to 8;

[0055] The third note range is in the time period T n The notes are:

[0056] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 1 to 4;

[0057] The fourth note range is in the time period T n The notes are:

[0058] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 5 to 8;

[0059] The above-mentioned note ranges are converted into corresponding notes in order from small to large according to the value of i.

[0060] Preferably, the range conversion unit further includes a beat calculation unit for calculating the corresponding beat of each note according to the conversion rule of each note.

[0061] Preferably, 0 is defined to represent a full beat, 1 to represent a 1 / 2 beat, 2 to represent a 1 / 4 beat, and 3 to represent a 1 / 8 beat;

[0062] The beat calculation unit calculates the beat in the following way:

[0063] Among them, (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ) of the note, whose beat is (Me d)(T n )×2+(Med)(T n+1 );

[0064] Among them, (Med)(T n )×2 2 +(Med)(T n+1 )×2+(Med)(T n+2 ) of the note, whose beat is (At t)(T n )×2+(At t)(T n+1 );

[0065] Among them, (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ) of the note, whose beat is (K i+3 )(T n )×2+(K i+4 )(T n ), where i = 1 to 8;

[0066] Among them, δ(T n )×22 +δ(T n+1 )×2+δ(T n+2 ) of the note, whose beat is θ(T n )×2+θ(T n+1 );

[0067] Among them, θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ) of the note with the conversion rule, and its beat is δ(T n )×2+δ(T n+1 );

[0068] Among them, (α - )(T n )×2 2 +(α - )(T n+1 )×2+(α - )(T n+2 ) of the note, whose beat is (α + )(T n )×2+(α + )(T n+1 );

[0069] Among them, (α + )(T n )×2 2 +(α + )(T n+1 )×2+(α + )(T n+2 ) of the note, whose beat is (α - )(T n )×2+(α - )(T n+1 );

[0070] Among them, (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ) of the note, whose beat is (β + )(T n )×2+(β + )(T n+1 );

[0071] Among them, (β + )(T n )×22 +(β + )(T n+1 )×2+(β + )(T n+2 ) of the note, whose beat is (β - )(T n )×2+(β - )(T n+1 );

[0072] Among them, (γ - )(T n )×2 2 +(γ - )(T n+1 )×2+(γ - )(T n+2 ) of the note, whose beat is (γ + )(T n )×2+(γ + )(T n+1 );

[0073] Among them, (γ + )(T n )×2 2 +(γ + )(T n+1 )×2+(γ + )(T n+2 ) of the note, whose beat is (γ - )(T n )×2+(γ - )(T n+1 ).

[0074] Preferably, the melody creation unit is based on T n+1 The value of (At t, Med) determines the time period T n The resulting order of the notes, where T n+1 (At t,Me d)=T n+1 (At t)×2+T n+1 (Me d);

[0075] When T n+1 (At t, Me d) = 0, then the time period T n The corresponding note ranges are arranged from low to high according to their pitch range; for all notes in each note range:

[0076] If each note in the note range is converted from a single brainwave parameter X, wherein the brainwave parameter X is selected from δ, θ, α - , α + , β- , β + , γ - , γ + , then these notes are calculated according to their corresponding brain wave parameters δ, θ, α - , α + , β - , β + , γ - , γ + Arrange in order;

[0077] If the notes in the note range are not converted by the single brainwave parameter X, then these notes are arranged from the first note to the last note in the order in which they were generated;

[0078] When T n+1 (At t, Me d) = 1, then the time period T n The first note of each corresponding note range is arranged at the first time point, the second note of each note range is arranged at the second time point, and the Mth note of each note range is arranged at the Mth time point in the same manner, where M is greater than 0; when the time period T n The number of notes in each corresponding note range is different. When the note range with the smaller number of notes is exhausted, the notes will be reordered starting from the first note. The music playback mechanism will play all the corresponding notes at the same time at each time point to achieve the purpose of mixing.

[0079] When T n+1 (At t, Me d) = 2, then first set the time period T n The corresponding note ranges are arranged once according to their pitch ranges from low to high, and the notes in each note range are arranged in order from the first note to the last note in the order in which they were produced; then the corresponding note ranges are arranged once again according to their pitch ranges from high to low, and the notes in each note range are arranged in reverse order from the last note to the first note in the order in which they were produced; and the arrangement is repeated in the same manner as above;

[0080] When T n+1 (At t, Me d) = 3, then the time period T n The corresponding note ranges are arranged from high to low according to their pitch range; for all notes in each note range:

[0081] If each note in the note range is converted from a single brainwave parameter X, wherein the brainwave parameter X is selected from γ + , γ - , β + , β - , α+ , α - , θ, δ, then these notes are adjusted according to their corresponding brain wave parameters γ + , γ - , β + , β - , α + , α - , θ, δ are arranged in order;

[0082] If the notes in the note range are not converted by the single brainwave parameter X, then the notes are arranged in reverse order from the last note to the first note according to their generation order.

[0083] Preferably, the Delta wave corresponds to white, the Theta wave corresponds to red, the Low Alpha wave corresponds to orange, the High Alpha wave corresponds to yellow, the Low Beta wave corresponds to green, the High Beta wave corresponds to blue, the Low Gamma wave corresponds to indigo, and the High Gamma wave corresponds to purple; when the music playing mechanism plays music, the corresponding color is transmitted to the screen display mechanism for display according to the brain wave band corresponding to each note.

[0084] Preferably, the processing unit also includes a volume and color concentration selection mechanism, which is connected to the music playing mechanism and the screen display mechanism, and is used to divide the values of each brain wave parameter at each time point into multiple categories according to its amplitude, and each category corresponds to a different volume and color concentration, so as to control the volume of the music playing mechanism and the color concentration displayed by the screen display mechanism.

[0085] Preferably, the music playing mechanism further comprises an instrument selection unit, which receives the type of instrument specified by the subject and uses the timbre of the instrument to play the music melody; when there are multiple subjects, the melodies played by different instruments are combined into a composite music melody.

[0086] The features and advantages of the present invention may be further understood from the following description, which should be read with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0087] Figure 1 A block diagram showing the main components of the present invention;

[0088] Figure 2 A schematic diagram showing a head-mounted device of the present invention;

[0089] Figure 3 A block diagram showing the system architecture of the present invention;

[0090] Figure 4Displaying a table of intensity differences calculated from various brain wave parameters in the present invention;

[0091] Figure 5 Display the coding table calculated by the coding unit of the present invention;

[0092] Figure 6A Displaying a note conversion result table of the first musical range of the present invention;

[0093] Figure 6B Display the note conversion result table of the first range of the present invention, followed by Figure 6A content;

[0094] Figure 7A Displaying a note conversion result table of the second musical range of the present invention;

[0095] Figure 7B Display the note conversion result table of the second range of the present invention, followed by Figure 7A content;

[0096] Figure 7C Display the note conversion result table of the second range of the present invention, followed by Figure 7B content;

[0097] Figure 7D Display the note conversion result table of the second range of the present invention, followed by Figure 7C content;

[0098] Figure 7E Display the note conversion result table of the second range of the present invention, followed by Figure 7D content;

[0099] Figure 8A Display the note conversion result table of the third range of the present invention;

[0100] Figure 8B Display the note conversion result table of the third range of the present invention, followed by Figure 8A content;

[0101] Figure 8C Display the note conversion result table of the third range of the present invention, followed by Figure 8B content;

[0102] Figure 8D Display the note conversion result table of the third range of the present invention, followed by Figure 8C content;

[0103] Figure 8E Display the note conversion result table of the third range of the present invention, followed by Figure 8D content;

[0104] Figure 9A Display the note conversion result table of the fourth range of the present invention;

[0105] Figure 9B Display the note conversion result table of the fourth range of the present invention, followed by Figure 9A content;

[0106] Figure 9C Display the note conversion result table of the fourth range of the present invention, followed by Figure 9B content;

[0107] Figure 10A Display the beat conversion result table of the present invention;

[0108] Figure 10B Display the beat conversion result table of the present invention, followed by Figure 10A content;

[0109] Figure 10C Display the beat conversion result table of the present invention, followed by Figure 10B content;

[0110] Figure 10D Display the beat conversion result table of the present invention, followed by Figure 10C content;

[0111] Figure 10E Display the beat conversion result table of the present invention, followed by Figure 10D content;

[0112] Figure 10F Display the beat conversion result table of the present invention, followed by Figure 10E content.

[0113] Description of Reference Numerals

[0114] 10 Head-mounted devices

[0115] 11 Headband

[0116] 12 Brainwave Monitor

[0117] 14. EEG transceiver

[0118] 15 Relaxation Index Calculator

[0119] 20 processing units

[0120] 21 Processing end transceiver

[0121] 30 melody conversion mechanism

[0122] 31 Brainwave Change Calculation Unit

[0123] 32 code units

[0124] 33 Range Conversion Unit

[0125] 35 Melody Building Unit

[0126] 40 Music Playing Agency

[0127] 41 Instrument Selection Unit

[0128] 50 color conversion mechanism

[0129] 60 screen display mechanism

[0130] 70 volume and color concentration selection mechanism

[0131] 331 beat calculation unit. DETAILED DESCRIPTION

[0132] The structural composition of the present invention, as well as the effects and advantages it can produce, is now described in detail below with reference to the accompanying drawings, taking a preferred embodiment of the present invention as an example.

[0133] Please refer to Figures 1 to 3 As shown, the brain wave audio and video encoding and playback system of the present invention includes the following components:

[0134] A head-mounted device 10 is used to monitor the brain wave signals of the subject. When in use, the head-mounted device 10 is mounted on the subject's head. Figure 1 and Figure 2 As shown, the head-mounted device 10 includes a headband 11, an electroencephalogram (EB) monitor 12 located on the headband 11 for monitoring EB, a concentration and relaxation index calculator 15 connected to the EB monitor 12 for applying a specific algorithm (this is prior art and the details are omitted here) to the EB monitoring data to obtain the subject's concentration index and relaxation index, and an EB transceiver 14 connected to the EB monitor 12 and the concentration and relaxation index calculator 15 for transmitting EB signals.

[0135] A processing unit 20 is connected to the head-mounted device 10 to receive and process a series of brainwave signals output by the head-mounted device 10. These brainwave signals include Delta waves, Theta waves, High / Low Alpha waves, High / Low Beta waves, and High / Low Gamma waves of the left and right brains of the human body, as well as the concentration index and relaxation index. Figure 1 and Figure 3 As shown, the processing unit 20 includes:

[0136] A processing end transceiver 21 is connected to the electroencephalogram transceiver 14 of the head-mounted device 10 for receiving signals transmitted from the electroencephalogram transceiver 14 .

[0137] A melody conversion mechanism 30 is connected to the processing transceiver 21 and is used to convert the subject's brainwave signals during a period of time into a corresponding musical melody based on a specific algorithm. This method is primarily based on changes in the Attention and Relaxation indices, as well as changes in the left and right brain's Delta waves, Theta waves, High / Low Alpha waves, High / Low Beta waves, and High / Low Gamma waves.

[0138] A color conversion mechanism 50 is connected to the processing end transceiver 21 and is used to convert the brain wave signals of the subject in a period of time into corresponding colors according to a specific algorithm.

[0139] A music playing mechanism 40 is connected to the melody conversion mechanism 30 and is used to play the music melody obtained by the melody conversion mechanism 30 .

[0140] A screen display mechanism 60 is connected to the color conversion mechanism and is used to display the various colors obtained by the color conversion mechanism 50 .

[0141] The processing unit 20 can be installed in various electronic information devices, such as computers, mobile phones, tablets, etc.

[0142] The melody conversion mechanism 30 includes:

[0143] A brain wave variation calculation unit 31 calculates the intensity difference D between each of the two adjacent time points t-1 and t for each brain wave parameter X of the subject. t , t is greater than 0. The brain wave parameter X is selected from At t, Me d, δ, θ, α - , α + , β - , β + , γ - , γ + . Among them, At t represents the concentration index, Med represents the relaxation index, δ represents the Delta wave, θ represents the Theta wave, α - Indicates Low Alpha wave, α + Indicates High Alpha wave, β - Indicates Low Beta wave, β + Indicates High Beta wave, γ - Represents Low Gamma wave, γ+ Indicates High Gamma wave. The calculated value is as follows Figure 4 As shown, the calculation results of D1 to D8 corresponding to each brain wave parameter X are displayed.

[0144] A coding unit 32 is connected to the brain wave change calculation unit 31, and encodes the change of the intensity difference corresponding to each brain wave parameter X into the intensity difference of each brain wave parameter X in the time period T. n The corresponding binary value of the time period T n The encoding unit 32 creates a coding table with these binary values. The coding table uses each brain wave parameter X as a row, and the time period T n As a column. Wherein each binary value in the coding table is represented as X(T n ) or T n (X), X(T n ) represents the row and time period T corresponding to the brain wave parameter X n The binary value at the intersection of the corresponding columns, T n (X) represents the time period T n The binary value at the intersection of the corresponding column and the row corresponding to the brain wave parameter X, that is, X(T n ) and T n (X) will correspond to the binary value of the same position in the encoding table.

[0145] Which determines X(T n ) value is as follows: n With D n-1 All are greater than 0, or all are less than 0, or all are 0, or D n Greater than 0 and D n-1 0 or D n Less than 0 and D n-1 is 0, then X(T n ) is 0;

[0146] When D n With D n-1 One of them is greater than 0 and the other is less than 0, or D n is 0 and D n-1 Greater than 0, or D n is 0 and D n-1 is less than 0, then X(T n ) is 1.

[0147] The encoding table of the encoding unit 32 is as follows Figure 5 As shown, the encoding results of each brain wave parameter X in time periods T1 to T7 are displayed.

[0148] A range conversion unit 33 is connected to the encoding unit 32 and converts the time period T in the encoding table into a range of 1000. nThe binary values of the concentration index and relaxation index are selected, the corresponding range mode is selected, and different conversion rules are applied in each range mode to convert the binary value of each brain wave parameter X in the coding table into the value of the time period T n The corresponding notes and pitches, each note is obtained by converting the binary value of at least one corresponding brain wave parameter.

[0149] The method is based on T n The value of (At t, Me d) determines the time period T n The range mode, where T n (At t, Med) = T n (At t)×2+T n (Med). Each range mode includes multiple note ranges, each note range includes at least one corresponding note, and the notes are produced sequentially in a specific order. The pitch range of each note range is one octave, and the pitches of the corresponding notes in the multiple note ranges differ by an octave. 0 to 7 are defined as the eight notes in an octave.

[0150] The conversion method of each range mode is as follows:

[0151] When T n (At t, Me d)=0, it is the first range mode, and its note ranges are the first note range, the second note range, the third note range and the fourth note range in descending order according to pitch.

[0152] The first note range is in the time period T n The notes are:

[0153] δ(T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ),as well as

[0154] θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 );

[0155] The second note range is in the time period T n The notes are:

[0156] (α - )(T n )×2 2 +(α - )(T n+1 )×2+(α - )(T n+2 ),as well as

[0157] (α + )(T n )×2 2 +(α + )(T n+1 )×2+(α + )(T n+2 );

[0158] The third note range is in the time period T n The notes are:

[0159] (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ),as well as

[0160] (β + )(T n )×2 2 +(β + )(T n+1 )×2+(β + )(T n+2 );

[0161] The fourth note range is in the time period T n The notes are:

[0162] (γ - )(T n )×2 2 +(γ - )(T n+1 )×2+(γ - )(T n+2 ),as well as

[0163] (γ + )(T n )×2 2 +(γ + )(T n+1 )×2+(γ + )(T n+2 ).

[0164] The conversion result of the first range mode is as follows Figures 6A to 6B As shown, the time periods T1, T2, T3, T4 and T n The conversion result table.

[0165] When T n(At t, Me d) = 1, it is the second range mode, and its note range is the first note range, the second note range and the third note range in order from small to large according to the pitch. The brain wave parameter sequence K is defined as "δ, θ, α - , α + , β - , β + , γ - , γ + ,δ,θ,α - , α + ", where the i-th element of sequence K is K i Indicates, such as K4 represents α + , K8 represents γ + .

[0166] The first note range is in the time period T n The notes M n They are:

[0167] (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ),as well as

[0168] (Me d)(T n )×2 2 +(Me d)(T n+1 )×2+(Me d)(T n+2 );

[0169] The second note range is in the time period T n The notes are:

[0170] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 1 to 8.

[0171] The third note range is in the time period T n The notes are:

[0172] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 1 to 8.

[0173] The second and third note ranges are converted into corresponding notes in order from small to large according to the value of i.

[0174] The conversion result of the second range mode is as follows 7A to 7E As shown, the time periods T1, T2, T3 and T n The conversion result table.

[0175] When T n (At t, Me d) = 2, it is the third range mode, and its note range is the first note range, the second note range, the third note range and the fourth note range in descending order according to the pitch. The brainwave parameter sequence K is defined as "δ, θ, α - , α + , β - , β + , γ - , γ + ,δ,θ,α - , α + ", where the i-th element of sequence K is K i Indicates, such as K4 represents α + , K8 represents γ + .

[0176] The first note range is in the time period T n The notes are:

[0177] (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ),as well as

[0178] (Me d)(T n )×2 2 +(Me d)(T n+1 )×2+(Me d)(T n+2 );

[0179] The second note range is in the time period T n The notes are:

[0180] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i = 1 to 8.

[0181] The third note range is in the time period T nThe notes are:

[0182] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 1 to 4.

[0183] The fourth note range is in the time period T n The notes are:

[0184] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i=5~8.

[0185] The second, third and fourth note ranges are converted into corresponding notes in order according to the value of i from small to large.

[0186] The conversion result of the third range mode is as follows Figures 8A to 8E As shown, the time periods T1, T2, T3 and T n The conversion result table.

[0187] When T n (At t, Me d) = 3, it is the fourth range mode, and its note ranges are the first note range, the second note range, the third note range and the fourth note range in order from small to large according to the pitch. The brainwave parameter sequence K is defined as "δ, θ, α - , α + , β - , β + , γ - , γ + ,δ,θ,α - , α + ", where the i-th element of sequence K is K i Indicates, such as K4 represents α + , K8 represents γ + .

[0188] The first note range is in the time period T n The notes are:

[0189] (K i )(T n )×2 2 +(K i+1 )(T n)×2+(K i+2 )(T n ), where i = 1 to 4.

[0190] The second note range is in the time period T n The notes are:

[0191] (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), where i=5~8.

[0192] The third note range is in the time period T n The notes are:

[0193] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i = 1 to 4.

[0194] The fourth note range is in the time period T n The notes are:

[0195] (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), where i=5~8.

[0196] The above-mentioned note ranges are converted into corresponding notes in order from small to large according to the value of i.

[0197] The conversion result of the fourth range mode is as follows Figures 9A to 9C As shown, the time periods T1, T2, T3 and T n The conversion result table.

[0198] The range conversion unit 33 further includes a beat calculation unit 331 for calculating the corresponding beat of each note according to the conversion rule of each note.

[0199] The definition is that 0 represents a full beat, 1 represents a 1 / 2 beat, 2 represents a 1 / 4 beat, and 3 represents a 1 / 8 beat.

[0200] The beat calculation unit 331 calculates the beat in the following way:

[0201] Among them, (At t)(T n )×2 2 +(At t)(T n+1 )×2+(At t)(T n+2 ) of the note, whose beat is (Me d)(T n )×2+(Med)(T n+1 ).

[0202] Among them, (Med)(T n )×2 2 +(Med)(T n+1 )×2+(Med)(T n+2 ) of the note, whose beat is (At t)(T n )×2+(At t)(T n+1 ).

[0203] Among them, (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ) of the note, whose beat is (K i+3 )(T n )×2+(K i+4 )(T n ), where i = 1 to 8.

[0204] Among them, δ(T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ) of the note, whose beat is θ(T n )×2+θ(T n+1 ).

[0205] Among them, θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ) of the note with the conversion rule, and its beat is δ(T n )×2+δ(T n+1 ).

[0206] Among them, (α - )(T n )×2 2 +(α - )(T n+1 )×2+(α- )(T n+2 ) of the note, whose beat is (α + )(T n )×2+(α + )(T n+1 ).

[0207] Among them, (α + )(T n )×2 2 +(α + )(T n+1 )×2+(α + )(T n+2 ) of the note, whose beat is (α - )(T n )×2+(α - )(T n+1 ).

[0208] Among them, (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ) of the note, whose beat is (β + )(T n )×2+(β + )(T n+1 ).

[0209] Among them, (β + )(T n )×2 2 +(β + )(T n+1 )×2+(β + )(T n+2 ) of the note, whose beat is (β - )(T n )×2+(β - )(T n+1 ).

[0210] Among them, (γ - )(T n )×2 2 +(γ - )(T n+1 )×2+(γ - )(T n+2 ) of the note, whose beat is (γ + )(T n )×2+(γ + )(Tn+1 ).

[0211] Among them, (γ + )(T n )×2 2 +(γ + )(T n+1 )×2+(γ + )(T n+2 ) of the note, whose beat is (γ - )(T n )×2+(γ - )(T n+1 ).

[0212] The conversion result of the beat calculation unit 331 is as follows 10A to 10F As shown, the time periods T1, T2 and T n The conversion result table.

[0213] A melody creation unit 35 is connected to the range conversion unit 33, and converts each time segment T converted by the range conversion unit 33 according to a specific algorithm. n The notes in the game are arranged in a specific order, and each time period T is established. n The music melody is output to the music playing mechanism 40 for playing.

[0214] The method is based on T n+1 The value of (At t, Me d) determines the time period T n The resulting order of the notes, where T n+1 (At t,Me d)=T n+1 (At t)×2+T n+1 (Me d).

[0215] When T n+1 (At t, Me d) = 0, then the time period T n The corresponding note ranges are arranged from low to high according to their pitch range; for all notes in each note range:

[0216] If each note in the note range is converted from a single brainwave parameter X, wherein the brainwave parameter X is selected from δ, θ, α - , α + , β - , β + , γ - , γ + , such as the first note range of the first range mode δ(T n )×2 2 +δ(T n+1 )×2+δ(Tn+2 ) and θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ), then these notes are divided into two groups according to their corresponding brain wave parameters δ, θ, α - , α + , β - , β + , γ - , γ + Arranged in order.

[0217] If the notes in the note range are not converted from the single brainwave parameter X, then these notes are arranged from the first note to the last note in the order in which they are generated. For example, the notes in the second note range of the second range mode are (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), arranged in the order of i=1~8.

[0218] When T n+1 (At t, Me d) = 1, then the time period T n The first note of each corresponding note range is arranged at the first time point, the second note of each note range is arranged at the second time point, and the Mth note of each note range is arranged at the Mth time point in the same manner, where M is greater than 0. n If the number of notes in each corresponding note range is different, when the notes in the note range with fewer notes are exhausted, the notes will be reordered starting from the first note. The music playing mechanism 40 will play all the corresponding notes at the same time at each time point to achieve the purpose of mixing.

[0219] When T n+1 (At t, Me d) = 2, then first set the time period T n The corresponding note ranges are sorted once according to their pitch ranges from low to high, and the notes within each note range are arranged in the order they were produced, from the first note to the last note. Then, the note ranges are sorted once again according to their pitch ranges from high to low, and the notes within each note range are arranged in the reverse order of their production, from the last note to the first note. This process is repeated repeatedly.

[0220] When T n+1 (At t, Me d) = 3, then the time period Tn The corresponding note ranges are arranged from high to low according to their pitch range; for all notes in each note range:

[0221] If each note in the note range is converted from a single brainwave parameter X, wherein the brainwave parameter Z is selected from γ + , γ - , β + , β - , α + , α - ,θ,δ, such as the first note range of the first range mode δ (T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ) and θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ), then these notes are calculated according to their corresponding brain wave parameters γ + , γ - , β + , β - , α + , α - , θ, δ in order.

[0222] If the notes in the note range are not converted from the single brainwave parameter X, then the notes are arranged in reverse order from the last note to the first note according to their generation order. For example, the notes in the second note range of the second range mode are (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), and arranged in reverse order from i=8 to 1.

[0223] The color conversion mechanism 50 maps each brainwave band to a different color: Delta waves to white, Theta waves to red, Low Alpha waves to orange, High Alpha waves to yellow, Low Beta waves to green, High Beta waves to blue, Low Gamma waves to indigo, and High Gamma waves to violet. When the music playback mechanism 40 plays music, the corresponding color is transmitted to the screen display mechanism 60 for display based on the brainwave band corresponding to each note.

[0224] The processing unit 20 also includes a volume and color concentration selection mechanism 70, which is connected to the music playing mechanism 40 and the screen display mechanism 60, and is used to classify the values of each brain wave parameter at each time point into multiple categories according to its amplitude. Each category corresponds to a different volume and color concentration to control the volume of the music playing mechanism 40 and the color concentration displayed by the screen display mechanism 60.

[0225] The music playing mechanism 40 also includes an instrument selection unit 41 that receives the instrument type specified by the test subject and uses the timbre of the instrument to play a musical melody. Therefore, when there are multiple test subjects, melodies played by different instruments can be combined into a composite musical melody.

[0226] The music playing mechanism 40 can play the melody of the melody conversion mechanism 30 in MIDI format.

[0227] In this invention, based on years of research and understanding of brainwaves, the inventors have identified the relationship between brainwave fluctuations, the human body's perception of musical rhythms, and the brightness and darkness of colors. They have mapped brainwave fluctuations to musical melodies and image colors, thus creating the aforementioned rules. This allows for the display of brainwave fluctuations through music playback and image display. By conveying brainwave information through music playback and image display, surrounding people can resonate with the music and image.

[0228] In summary, the present invention's user-friendly and thoughtful design meets practical needs. Its specific improvements address existing deficiencies, offering significant breakthroughs and advantages over existing technologies, truly enhancing efficacy and achieving this in a manner not easily achieved. While this invention has not been previously disclosed or published in domestic or international literature or on the market, it complies with patent law regulations.

[0229] The above detailed description is a specific description of a feasible embodiment of the present invention, but this embodiment is not intended to limit the patent scope of the present invention. Any equivalent implementation or modification that does not depart from the technical spirit of the present invention should be included in the patent scope of the present invention.

Claims

1. A brainwave audio and video encoding and playback system, characterized in that: include A head-mounted device for monitoring a subject's brainwave signals, the head-mounted device comprising a headband, an electroencephalogram (EBW) monitor located on the headband for monitoring EBW, a concentration and relaxation index calculator connected to the EBW monitor for applying a specific algorithm to the EBW monitoring data to obtain the subject's concentration and relaxation indices, and an EBW transceiver connected to the EBW monitor and the concentration and relaxation index calculator for transmitting EBW signals. a processing unit connected to the head-mounted device, receiving and processing a series of brainwave signals output by the head-mounted device; the brainwave signals include Delta waves, Theta waves, High Alpha waves, Low Alpha waves, High Beta waves, Low Beta waves, High Gamma waves, Low Gamma waves of the left and right brains of the human body, as well as the Attention Index and the Meditation Index; The processing unit includes: a processing end transceiver connected to the electroencephalogram transceiver of the head-mounted device, for receiving signals transmitted from the electroencephalogram transceiver; A melody conversion mechanism is connected to the processing end transceiver and is used to convert the brain wave signals of the subject in a period of time into a corresponding musical melody according to a specific algorithm; A color conversion mechanism is connected to the processing end transceiver and is used to convert the brain wave signal of the subject in a period of time into a corresponding color according to a specific algorithm; a music playing mechanism connected to the melody conversion mechanism, for playing the music melody obtained by the melody conversion mechanism; and A screen display mechanism is connected to the color conversion mechanism and is used to display various colors obtained by the color conversion mechanism; The melody conversion mechanism includes: A brain wave change calculation unit calculates the intensity difference D between each of the two adjacent time points t-1 and t for each brain wave parameter X of the subject. t , t is greater than 0; wherein the brain wave parameter X is selected from Att, Med, δ, θ, α - , α + , β - , β + , γ - , γ + ; Among them, Att represents the concentration index, Med represents the relaxation index, δ represents the Delta wave, θ represents the Theta wave, α - Indicates LowAlpha wave, α + Indicates High Alpha wave, β - Indicates Low Beta wave, β + represents High Beta wave, γ - Represents Low Gamma wave, γ + Indicates High Gamma wave; A coding unit is connected to the brain wave change calculation unit, and encodes the change of the intensity difference corresponding to each brain wave parameter X as the intensity difference of each brain wave parameter X in the time period T. n The corresponding binary value of the time period T n represents the nth time period, where n is greater than 0; the encoding unit establishes a coding table with these binary values, and the coding table uses each brain wave parameter X as a row, and the time period T n As a column; wherein each binary value in the coding table is represented as X(T n ) or T n (X), X(T n ) represents the row and time period T corresponding to the brain wave parameter X n The binary value at the intersection of the corresponding columns, T n (X) represents the time period T n The binary value at the intersection of the corresponding column and the row corresponding to the brain wave parameter X, that is, X(T n ) and T n (X) will correspond to the binary value of the same position in the code table; A range conversion unit is connected to the encoding unit, and is configured to convert the time periods T in the encoding table into n The binary values of the concentration index and relaxation index are selected, the corresponding range mode is selected, and different conversion rules are applied in each range mode to convert the binary value of each brain wave parameter X in the coding table into the value of the time period T n corresponding musical notes and pitches, each musical note being converted from a binary value of at least one corresponding brainwave parameter; and A melody creation unit is connected to the range conversion unit, and the time segments T converted by the range conversion unit are converted according to a specific algorithm. n The notes in the game are arranged in a specific order, and each time period T is established. n The music melody is output to the music playing mechanism for playing.

2. The brainwave audio and video encoding and playback system according to claim 1, wherein: The coding unit determines X(T n ) value is the difference D between the two intensities corresponding to the brain wave parameter X t With D t+1 , where t = n, when D t With D t+1 All are greater than 0, or all are less than 0, or all are 0, or D t Greater than 0 and D t+1 0 or D t Less than 0 and D t+1 is 0, then X(T n ) is 0; When D t With D t+1 One of them is greater than 0 and the other is less than 0, or D t is 0 and D t+1 Greater than 0, or D t is 0 and D t+1 is less than 0, then X(T n ) is 1.

3. The brainwave audio and video encoding and playback system according to claim 1, wherein: The range conversion unit is based on T n The value of (Att, Med) determines the time period T n The range mode, where T n (Att, Med) = T n (Att)×2+T n (Med); each range mode includes multiple note ranges, each note range includes at least one corresponding note, and each note is generated in a specific order; the pitch range of each note range is one octave, and the pitches of the corresponding notes in the multiple note ranges differ by an octave; wherein 0 to 7 are defined as eight notes in one octave; wherein the brain wave parameter sequence K is defined as "δ, θ, α - , α + , β - , β + , γ - , γ + ,δ,θ,α - , α + "; where the i-th element of sequence K is K i express.

4. The brainwave audio and video encoding and playback system according to claim 3, wherein: When T n (Att, Med) = 0, it is the first range mode, and its note ranges are the first note range, the second note range, the third note range, and the fourth note range in descending order of pitch; The first note range is in the time period T n The notes are: δ(T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ), and θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ); The second note range is in the time period T n The notes are: (a - )(T n )×2 2 +(a - )(T n+1 )×2+(a - )(T n+2 ), as well as (a + )(T n )×2 2 +(a + )(T n+1 )×2+(a + )(T n+2 ); The third note range is in the time period T n The notes are: (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ), and (b + )(T n )×2 2 +(β + )(T n+1 )×2+(β + )(T n+2 ); The fourth note range is in the time period T n The notes are: (c - )(T n )×2 2 +(c - )(T n+1 )×2+(γ - )(T n+2 ), as well as (c + )(T n )×2 2 +(c + )(T n+1 )×2+(γ + )(T n+2 )。 5. The brainwave audio and video encoding and playback system according to claim 3, wherein: When T n (Att, Med) = 1, it is the second range mode, and its note ranges are the first note range, the second note range, and the third note range in ascending order of pitch; The first note range is in the time period T n The notes are: (To)(T n )×2 2 +(At)(T n+1 )×2+(At)(T n+2 ), as well as (With)(T) n )×2 2 +(With)(T n+1 )×2+(With)(T n+2 ); The second note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), among others=1~8; The third note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), among others=1~8; The second note range and the third note range are converted into corresponding notes in sequence according to the value of i from small to large.

6. The brainwave audio and video encoding and playback system according to claim 3, characterized in that: When T n (Att, Med) = 2, indicating the third range mode, where the note ranges are, from smallest to largest, the first note range, the second note range, the third note range, and the fourth note range. The first note range is in the time period T n The notes are: (To)(T n )×2 2 +(At)(T n+1 )×2+(At)(T n+2 ), as well as (With)(T) n )×2 2 +(With)(T n+1 )×2+(With)(T n+2 ); The second note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), among others=1~8; The third note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), among others=1~4; The fourth note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), among others=5~8; The second note range, the third note range and the fourth note range are converted into corresponding notes in sequence according to the value of i from small to large.

7. The brainwave audio and video encoding and playback system according to claim 3, wherein: When T n (Att, Med) = 3, which is the fourth range mode. Its note ranges are the first note range, the second note range, the third note range, and the fourth note range in ascending order of pitch. The first note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), among others=1~4; The second note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ), among others=5~8; The third note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), among others=1~4; The fourth note range is in the time period T n The notes are: (K i )(T n )×2 2 +(K i )(T n+1 )×2+(K i )(T n+2 ), among others=5~8; The above-mentioned note ranges are converted into corresponding notes in order from small to large according to the value of i.

8. The brainwave audio and video encoding and playback system according to claim 4, 5, 6 or 7, characterized in that: The range conversion unit also includes a beat calculation unit, which calculates the corresponding beat of each note according to the conversion rule of each note.

9. The brainwave audio and video encoding and playback system according to claim 8, wherein: Define 0 to represent full beat, 1 to represent 1 / 2 beat, 2 to represent 1 / 4 beat, and 3 to represent 1 / 8 beat; The beat calculation unit calculates the beat in the following way: Among them, (Att)(T n )×2 2 +(Att)(T n+1 )×2+(Att)(T n+2 ) of the note, whose beat is (Med)(T n )×2+(Med)(T n+1 ); Among them, (Med)(T n )×2 2 +(Med)(T n+1 )×2+(Med)(T n+2 ) of the note, whose beat is (Att)(T n )×2+(Att)(T n+1 ); Among them, (K i )(T n )×2 2 +(K i+1 )(T n )×2+(K i+2 )(T n ) of the note, whose beat is (K i+3 )(T n )×2+(K i+4 )(T n ), where i = 1 to 8; Among them, δ(T n )×2 2 +δ(T n+1 )×2+δ(T n+2 ) of the note, whose beat is θ(T n )×2+θ(T n+1 ); Among them, θ(T n )×2 2 +θ(T n+1 )×2+θ(T n+2 ) of the note with the conversion rule, and its beat is δ(T n )×2+δ(T n+1 ); Among them, (α - )(T n )×2 2 +(α - )(T n+1 )×2+(α - )(T n+2 ) of the note, whose beat is (α + )(T n )×2+(α + )(T n+1 ); Among them, (α + )(T n )×2 2 +(α + )(T n+1 )×2+(α + )(T n+2 ) of the note, whose beat is (α - )(T n )×2+(α - )(T n+1 ); Among them, (β - )(T n )×2 2 +(β - )(T n+1 )×2+(β - )(T n+2 ) of the note, whose beat is (β + )(T n )×2+(β + )(T n+1 ); Among them, (β + )(T n )×2 2 +(β + )(T n+1 )×2+(β + )(T n+2 ) of the note, whose beat is (β - )(T n )×2+(β - )(T n+1 ); Among them, (γ - )(T n )×2 2 +(γ - )(T n+1 )×2+(γ - )(T n+2 ) of the note, whose beat is (γ + )(T n )×2+(γ + )(T n+1 ); Among them, (γ + )(T n )×2 2 +(γ + )(T n+1 )×2+(γ + )(T n+2 ) of the note, whose beat is (γ - )(T n )×2+(γ - )(T n+1 ).

10. The brainwave audio and video encoding and playback system according to claim 1, wherein: The color conversion mechanism maps each brainwave band to a different color, with Delta waves corresponding to white, Theta waves to red, Low Alpha waves to orange, High Alpha waves to yellow, Low Beta waves to green, High Beta waves to blue, Low Gamma waves to indigo, and High Gamma waves to purple. When the music playback mechanism plays music, the corresponding color is transmitted to the screen display mechanism for display based on the brainwave band corresponding to each note.

11. The brainwave audio and video encoding and playback system according to claim 1, wherein: The processing unit also includes a volume and color concentration selection mechanism, which is connected to the music playback mechanism and the screen display mechanism, and is used to classify the values of each brain wave parameter at each time point into multiple categories according to its amplitude. Each category corresponds to a different volume and color concentration to control the volume of the music playback mechanism and the color concentration displayed by the screen display mechanism.

12. The brainwave audio and video encoding and playback system according to claim 1, wherein: The music playing mechanism also includes an instrument selection unit that receives the type of instrument specified by the subject and uses the timbre of the instrument to play the music melody; when there are multiple subjects, the melodies played by different instruments are combined into a composite music melody.

Images