Music response control method, smart glasses and computer-readable storage medium

Abstract

The present invention discloses a music response control method, smart glasses, and a computer-readable storage medium. The music response control method is applied to the smart glasses, which include a glasses frame, a microphone, and a display screen, with the display screen being arranged on the surface of the glasses frame. The method comprises: dynamically picking up audio information in a current sound field via the microphone; converting the dynamically picked up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information; and dynamically displaying the rhythmic pattern on the display screen. The present invention can meet people's needs for visual response to music through glasses, thereby improving the effect of music interaction.

Description

Technical Field

[0001] The present invention relates to the technical field of head-mounted display devices, and in particular to a music response control method, smart glasses, and a computer-readable storage medium. Background Art

[0002] At concerts, dances, or nightclubs, users often want to sing along, wave, or clap their hands to the beat when they hear music. However, in such scenarios, there are still some inconveniences. For example, the form of responding to the rhythm of the music is limited. The audience can only wave their glow sticks or flashlights, but the flashlights do not flash to the rhythm of the music. Without clear rhythm prompts, the user's music interaction effect may not be in the right rhythm, which may have the opposite effect. In short, the existing music response form is relatively monotonous and boring, and is not closely connected to the live music, resulting in poor music interaction effect.

[0003] With the development of my country's economy, the improvement of living standards, and the change of concepts, people now wear glasses not only to correct their vision, but also to meet the needs of interacting with various music scenes. How to use glasses to meet people's response needs in music vision and improve the effect of music interaction has become a technical problem that needs to be solved urgently. Summary of the Invention

[0004] The main purpose of the present invention is to provide a music response control method, smart glasses and computer-readable storage medium, aiming to solve the technical problem of how to meet people's response needs in music vision through glasses and improve the music interaction effect.

[0005] To achieve the above-mentioned object, the present invention provides a music response control method, which is applied to smart glasses. The smart glasses include a glasses frame, a microphone, and a display screen, wherein the display screen is arranged on the surface of the glasses frame. The method comprises:

[0006] Dynamically picking up audio information in the current sound field through the microphone;

[0007] Converting the dynamically picked-up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information;

[0008] The rhythmic graph is dynamically displayed on the display screen.

[0009] Optionally, the display screen is an ink screen, the glasses frame includes a frame, and two temples extending outward from both ends of the frame, and the ink screen is laid on the outer surfaces of the temples.

[0010] Optionally, before the step of dynamically displaying the rhythmic graph on the display screen, the method further comprises:

[0011] Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style;

[0012] Determining a rendering element of the target music style mapping from a preset mapping relationship table, wherein the rendering element includes at least one of a background rendering color, a background rendering pattern, and a background rendering special effect of the rhythmic pattern;

[0013] Rendering the rhythmic atlas according to the mapped rendering elements;

[0014] The step of dynamically displaying the rhythmic graph on the display screen includes:

[0015] The rendered rhythmic atlas is dynamically displayed through the display screen.

[0016] Optionally, before the step of dynamically displaying the rhythmic graph on the display screen, the method includes:

[0017] Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style;

[0018] A rhythmic element associated with the target music style is determined from a preset association relationship table, wherein the rhythmic element rhythmically follows the audio rhythm of the audio information to form the contour line.

[0019] Optionally, the step of identifying the music style type corresponding to the audio information includes:

[0020] The audio information is input into a pre-trained music recognition neural network model to identify the music style type corresponding to the audio information.

[0021] Optionally, the smart glasses include a speaker, and the step of dynamically picking up audio information in the current sound field through the microphone includes:

[0022] When a first preset triggering operation is detected that triggers entering the listening mode, the microphone detects the audio played by the speaker to obtain near-field audio, and uses the near-field audio as the audio information in the current sound field;

[0023] When a second preset triggering operation that triggers entering the party mode is detected, the microphone detects the audio propagated in the environment where the smart glasses are located to obtain far-field audio, and the far-field audio is used as the audio information in the current sound field.

[0024] Optionally, the microphone includes a near-field microphone and a far-field microphone, the near-field microphone is arranged at a position relatively close to the speaker, and the far-field microphone is arranged at a position relatively far away from the speaker, wherein the near-field audio is detected by the near-field microphone, and the far-field audio is detected by the far-field microphone.

[0025] Optionally, before the step of dynamically picking up audio information in the current sound field by the microphone, the method further includes:

[0026] Detecting a trigger to perform a third preset trigger operation of a music response;

[0027] If the third preset trigger operation is detected, the step of dynamically picking up audio information in the current sound field through the microphone is executed.

[0028] In addition, to achieve the above-mentioned purpose, the present invention also provides a pair of smart glasses, which include a memory, a processor, and a music response program stored in the memory and runnable on the processor. When the music response program is executed by the processor, the steps of the music response control method as described above are implemented.

[0029] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a music response program is stored. When the music response program is executed by a processor, the steps of the music response control method as described above are implemented.

[0030] Smart glasses are increasingly becoming an indispensable necessity in people's lives. Since their invention, glasses have been used only as a tool to help people correct their vision. Now, smart glasses are gradually replacing mobile phone screens and becoming the portable display for humans in the future.

[0031] The present application provides a music response control method, which is applied to smart glasses. The smart glasses include a glasses frame, a microphone, and a display screen, wherein the display screen is arranged on the glasses frame. The music response control method includes: dynamically picking up audio information in the current sound field through the microphone, and converting the dynamically picked up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information, and then dynamically displaying the rhythmic pattern on the display screen. This provides a method for the smart glasses to acoustically interact with the surrounding environment. The display screen arranged on the glasses frame enables music visualization interaction, visually displays music, and achieves an audio-visual integration, thereby achieving the technical effect of enhancing the audience's visual sensory experience when listening to music and the playability of the glasses system. At the same time, the music response to the music scene will be more novel and diverse, making the audience more closely connected with the live music. The music rhythm is converted into a visual display, providing a new interactive experience method for smart glasses in the music environment, effectively meeting the music interaction needs of the music scene, and thus solving the technical problem of how to meet people's visual response needs for music through glasses and improve the effect of music interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for describing the embodiments. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without inventive work.

[0033] Figure 1 This is a flowchart of the first embodiment of the music response control method of the present application;

[0034] Figure 2 This is a flowchart of the second embodiment of the music response control method of the present application;

[0035] Figure 3 This is a schematic diagram of a scenario in which the smart glasses respond to music when entering the listening mode in an embodiment of the present application;

[0036] Figure 4 This is a schematic diagram of a scenario in which the smart glasses respond to music when entering party mode in an embodiment of the present application;

[0037] Figure 5 Schematic diagram of the music response of smart glasses in an embodiment of the present application;

[0038] Figure 6This is a flowchart of the music response of the smart glasses to two sound pickup modes in an embodiment of the present application;

[0039] Figure 7 It is a structural diagram of the smart glasses involving the hardware operating environment of the embodiment of the present application.

[0040] The purpose of this application, its features, and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and the accompanying text are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of this application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0041] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0042] It should be noted that, in this document, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0043] It should be understood that although the terms "first," "second," "third," etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the term "if," as used herein, may be interpreted as "upon," "when," or "in response to a determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising" and "including" indicate the presence of the recited features, steps, operations, elements, components, items, types, and / or groups, but do not preclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, types, and / or groups. The terms "or," "and / or," "including at least one of the following," etc., as used herein, may be interpreted as inclusive, meaning any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”; and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0044] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless clearly stated herein, the execution of these steps is not strictly limited in order, and they can be performed in other orders. Moreover, at least a portion of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0045] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.

[0046] It should be noted that in this article, step codes such as S100 and S200 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial restriction on the order. When implementing the step, those skilled in the art may execute S200 first and then S100, etc., but these should all be within the scope of protection of this application.

[0047] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0048] In this embodiment, the smart glasses of the present application can be, for example, mixed reality (MR) glasses, augmented reality (AR) glasses, virtual reality (VR) glasses, extended reality (XR) glasses, or some combination thereof.

[0049] Existing music-responsive forms are relatively monotonous and lack a close connection with live music, resulting in poor musical interaction. However, with my country's economic development, improved living standards, and changing perceptions, people now wear glasses not only for vision correction but also to interact with various musical scenes. Therefore, how to use glasses to meet people's visual response needs for music and improve the quality of musical interaction has become a pressing technical challenge.

[0050] Based on this, the present invention provides a music response control method, please refer to Figure 1 In a first embodiment of the music response control method, the music response control method is applied to smart glasses, the smart glasses comprising a glasses frame, a microphone, and a display screen, the display screen being arranged on a surface of the glasses frame, the method comprising:

[0051] Step S100, dynamically picking up audio information in the current sound field through the microphone;

[0052] In this embodiment, the display screen may be a flexible OLED (Organic Light-Emitting Diode) display screen, an ink screen, an LED (Light Emitting Diode) display screen, a liquid crystal display screen, etc., and this embodiment does not make any specific limitation to this.

[0053] In this embodiment, the current sound field can be understood as the sound field in which the smart glasses are located. The audio information in the current sound field can specifically include near-field audio and far-field audio. Among them, near-field audio refers to the audio played by the speakers of the smart glasses themselves, for example, in a quiet environment, the user listens to the music information played by the smart glasses themselves. Far-field audio refers to the audio generated by other sound sources in the environment where the smart glasses are located (audio not played by the speakers of the smart glasses themselves), such as music information transmitted in the environment of concerts, dances, and nightclubs.

[0054] In this embodiment, the audio information may be songs, dance music, light music, symphony and other audio, which is not specifically limited in this embodiment.

[0055] It is understandable that, since the audio information in the current sound field changes dynamically over time, the audio information in the current sound field should also be picked up dynamically (or periodically and continuously).

[0056] Step S200, converting the dynamically picked-up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information;

[0057] In this embodiment, the rhythmic graph includes contour lines that follow the audio rhythm of the current audio information. It is easy to understand that since the audio information in the current sound field often changes dynamically over time, the rhythmic graph also changes dynamically. To help understand the rhythmic graph of the embodiment of the present application, please refer to Figure 3 , Figure 3 This is a schematic diagram of a scenario in which near-field audio responds to music (or a schematic diagram of a scenario in which smart glasses enter listening mode) in an embodiment of the present application. An ink screen is placed on the outer surface of the temple of the glasses frame, and the ink screen is displaying a rhythmic pattern that changes with the beat or pitch. The speakers of the smart glasses themselves are playing music.

[0058] By analyzing the music played by the smart glasses themselves (i.e. near-field audio), it is converted into a visual rhythmic waveform (i.e. rhythmic graph), which is then displayed on the temples by the ink screen, sharing the user's music experience with people around them. Specifically, when responding to the near-field audio, Figure 3 The upper part of the figure is a schematic diagram of smart glasses in one perspective. Figure 3 The middle section of the diagram is a schematic diagram of the rhythmic spectrum. Figure 3 The next figure in the figure is a schematic diagram of the smart glasses from another perspective.

[0059] Step S300: Dynamically display the rhythmic graph via the display screen.

[0060] To facilitate understanding, this embodiment uses a music scenario as an example. In this music scenario, a user wears smart glasses at a concert. The sound of a singer or an instrument is transmitted to the concert venue through a loudspeaker. The microphone of the smart glasses then picks up the live music information (i.e., audio information) transmitted in the current sound field (the concert venue), and then converts the picked-up live music information into a corresponding rhythmic graph. The rhythmic graph is then dynamically displayed on the display screen. As a result, in the concert scenario, the smart glasses worn by the user can uniquely respond to the rhythm of the live music by displaying the rhythmic graph corresponding to the live music on the glasses' exterior. Fans can be more immersed in the music and interact with the singer, resulting in better interaction and musical response. Because the rhythmic graph actually has clear rhythmic prompt information, the audience can wave their glow sticks or flashlights to flash along with the rhythm of the music displayed on the glasses' exterior. Because the rhythmic graph includes contour lines that rhythmically follow the audio rhythm of the live music, the musical interaction effect is effectively improved. In other words, the music response at a concert will be more innovative and diverse, allowing the audience to connect more closely with the live music. By connecting the real-time feedback of the smart glasses with the live music, a more rhythmic and interactive immersive experience will be created, enhancing the interactive music experience at the concert. This solves the technical problem of how to use glasses to meet people's visual response needs for music and improve the interactive music experience. It should be noted that in this embodiment, the music scene is a concert, but this music scene can also be replaced by a dance scene or a nightclub scene, etc. This embodiment does not specifically limit this.

[0061] In another music scenario, a user wears smart glasses at a piano performance. The sound of the piano played by the pianist is transmitted at the piano performance scene. The microphone of the smart glasses then picks up the live music information (i.e., audio information) transmitted in the current sound field (piano performance scene), and then converts the picked-up live music information into a corresponding rhythmic graph, wherein the rhythmic graph includes contour lines that rhythmically follow the audio rhythm of the live music. The rhythmic graph is then dynamically displayed on the display screen. In this way, in the scene of the piano performance scene, the smart glasses worn by the user can uniquely respond to the rhythm of the music at the piano performance scene by displaying the rhythmic graph corresponding to the music at the piano performance scene on the appearance of the glasses, making the live music visual and the audience more immersed in the music. The appearance decoration of the smart glasses can resonate and interact with the audience, and the interactive effect and music response effect are better. This embodiment provides a method for smart glasses to interact acoustically with the surrounding environment. The display screen laid on the glasses frame of the smart glasses realizes sound visualization interaction and music visualization, realizing audio-visual integration, thereby achieving the technical effect of enhancing the audience's visual sensory experience when listening to music and the playability of the system. In other words, the forms of music response at the concert will be more novel and diverse, making the audience more closely connected with the live music, effectively improving the music interaction effect at the piano performance, and thus solving the technical problem of how to use glasses to meet people's visual response needs in music and improve the music interaction effect.

[0062] Smart glasses are increasingly becoming an indispensable necessity in people's lives. Since their invention, glasses have been used only as a tool to help people correct their vision. Now, smart glasses are gradually replacing mobile phone screens and becoming the portable display for humans in the future.

[0063] The present invention provides a music response control method for smart glasses, which include a glasses frame, a microphone, and a display screen, wherein the display screen is disposed on the glasses frame. The music response control method includes: dynamically picking up audio information in a current sound field through the microphone, and converting the dynamically picked up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information, and then dynamically displaying the rhythmic pattern on the display screen. This provides a method for the smart glasses to acoustically interact with the surrounding environment. The display screen disposed on the glasses frame enables music visualization interaction, visually presenting the music, and achieving an audio-visual integration, thereby achieving the technical effect of enhancing the listener's visual sensory experience when listening to music and the playability of the glasses system. At the same time, the music response to the music scene will be more novel and diverse, allowing the listener to connect more closely with the live music. The music rhythm is converted into a visual display, providing a new interactive experience for smart glasses in a music environment, effectively meeting the demand for music interaction at the music scene, and thus solving the technical problem of how to meet people's demand for visual response to music through glasses and improve the effect of music interaction.

[0064] In one practicable embodiment, the display screen is an ink screen, the glasses frame includes a frame, and two temples extending outward from both ends of the frame, and the ink screen is laid on the outer surfaces of the temples.

[0065] Those skilled in the art will appreciate that the spectacle frame includes a frame and two temples extending outwardly from both ends of the frame, and of course may also include optical lenses mounted on the frame.

[0066] In this embodiment, the outer surface of the temple refers to the surface of the temple away from the wearer's skin. Correspondingly, the inner surface of the temple refers to the surface of the temple close to the wearer's skin.

[0067] Those skilled in the art will know that, since the center of the frame needs to be hollowed out to install the lens, its surface area is small (considering aesthetics and the comfort of the nose wings, the structure of the frame needs to be designed to be relatively slender), and the outline shape of the frame is mostly curved, while the outline shape of the temples can be set to be flat and wide. Therefore, the position of the temples is more conducive to the installation of the ink screen relative to the position of the frame, reducing the difficulty and cost of installing the ink screen on the glasses frame.

[0068] In addition, as for the temples, when users wear glasses, they can often only see the outer surface of the temples. As the inner side of the temples is adjacent to the wearer's skin, it is a blind spot of vision. The outer surface of the temples plays a key role in the decorative appearance of the temples. Therefore, laying the ink screen on the outer surface of the temples is convenient for meeting people's visual response needs in music, improving the music interaction effect, and reducing the hardware cost of smart glasses.

[0069] In this embodiment, since conventional display screens such as LED (Light Emitting Diode) display screens and liquid crystal display screens are not convenient to be laid on a structural surface including a curved surface, ink screens and flexible OLED screens are easier to attach to the surface of the glasses frame than these conventional display screens, and the difficulty of laying them on the surface of the glasses frame is low.

[0070] It should also be noted that replacing the e-ink display in the embodiment of the present application with a flexible OLED (Organic Light Emitting Display) screen and employing the method steps S100 to S300 of the present application can also achieve the goal of converting musical rhythms into visual displays, satisfying the demand for musical interaction at live concerts. This solves the technical problem of how to use glasses to meet people's visual responsiveness to music and enhance the quality of musical interaction. However, compared to e-ink displays, flexible OLED screens are more expensive. Furthermore, e-ink displays only consume power when switching images. After replacement, they can display content for extended periods. Since this long-term display consumes no power at all, e-ink displays offer low power consumption and high practicality for eyewear decoration. In contrast, flexible OLED displays consume power continuously as long as they are displaying images, resulting in high power consumption for e-ink displays. Therefore, compared to flexible OLED displays, the embodiment of the present application, by placing an e-ink display on the eyeglass frame, can reduce the hardware cost of smart glasses, reduce power consumption, and improve their battery life.

[0071] In a possible implementation, before the step of dynamically displaying the rhythmic graph on the display screen, the method further includes:

[0072] Step A10, identifying the music style type corresponding to the audio information, and using the music style type corresponding to the audio information as the target music style;

[0073] It should be noted that music style types can be categorized by genre or mood. Specifically, genre classification can categorize music styles into pop, rock, metal, jazz, hip-hop, folk, light music, and classical. Musical mood classification can categorize music styles into passionate, harmonious, joyful, and sad.

[0074] In this embodiment, the musical emotion currently expressed in the audio information can be identified based on the audio features of the audio information (e.g., interval features or musical notes). Specifically, the current emotional type of the audio information can be identified based on the interval features of the audio information, where the emotional type is related to the proportion of major thirds and / or minor thirds in the interval; and / or the current emotional type of the audio information can be identified based on the musical notes in the audio information, where each note corresponds to an emotional increment, and the current emotional type of the audio information is related to the sum of the emotional increments of the notes in the played portion of the music. In this embodiment, major thirds in music convey a sense of vitality and vigor, while minor thirds convey a sense of melancholy and sorrow. If the melody of a musical clip contains many instances of minor thirds, it can be assumed that the musical clip expresses an emotion of "unacceptable" or "sadness." Major thirds, on the other hand, represent "harmony" or "joy." By utilizing these interval features of audio information, the system can identify the emotional type expressed in live music. Alternatively, a corresponding meaning value may be assigned to each singing note, for example, each note corresponds to an emotion increment, and the emotion enhancement may be a positive value, a negative value or 0, and the current emotion type of the music is related to the superposition value of the emotion increments of the notes in the played portion of the music. Specifically, a numerical interval may be assigned to each emotion type in advance, and when the superposition value falls within a certain numerical interval, it is determined that the emotion type of the current audio information (i.e., the current music) is the emotion type corresponding to the numerical interval. The emotion intensity may be related to at least one of the following musical features: pitch, amplitude, tone, frequency, speed, and beat. Generally speaking, when the current pitch of the music is higher, the amplitude is larger, the tone is higher, the frequency is faster, the speed is faster, and / or the beat is faster, the intensity of the music emotion is higher. For example, when the emotion category of the music emotion of the current audio information is exciting, the faster the beat of the current audio information is, the higher the exciting emotion of the current audio information is.

[0075] Those skilled in the art will appreciate that smart glasses can identify music styles categorized by genre, such as pop, rock, metal, jazz, hip-hop, folk, light music, or classical music, based on the audio features of the audio information. The audio features may include one or more of pitch, amplitude, pitch, frequency, speed, audio rhythm (the relationship between the lengths of organized notes), and audio beat (the pattern of repeated occurrence of strong and weak beats of the same duration). Of course, recently proposed audio features may also be included, such as energy, zero-crossing rate, spectral moment, spectral flow, bandwidth, band period, and noise frame rate, which are not specifically limited in this embodiment.

[0076] Step A20: determining a rendering element of the target music style mapping from a preset mapping relationship table, wherein the rendering element includes at least one of a background rendering color, a background rendering pattern, and a background rendering special effect of the rhythmic pattern;

[0077] In this embodiment, the preset mapping relationship table stores a plurality of music style types and rendering elements mapped to various music style types. Therefore, the rendering elements mapped to the target music style can be obtained by querying the preset mapping relationship table. It should be noted that the rendering elements include at least one of the background rendering color, background rendering pattern, and background rendering special effects of the rhythmic spectrum. Among them, the background rendering special effects can be dynamic special effects or static special effects. For example, the background rendering special effects can include special effects videos, special effects animations, or special effects maps (the background rendering special effects of different music styles are different). This embodiment does not specifically limit this.

[0078] To facilitate understanding, an example is given for illustration. In a music recognition scenario, when the smart glasses recognize that the music style type corresponding to the audio information belongs to a music style with an exciting music mood, the background rendering color is red, the background rendering pattern is a flame-like pattern, and the background rendering special effect is a dynamic special effect of a burning flame. When the smart glasses recognize that the music style type corresponding to the audio information belongs to a music style with a pleasant music mood, the background rendering color is green, the background rendering pattern is a dandelion, fallen leaves or petals, and the background rendering special effect is a dynamic special effect of dandelions, fallen leaves or petals drifting in the wind. This embodiment can associate the music mood of the audio information with the playback effect of the rhythmic atlas in real time, and present the music mood of the music to the audience in a real-time visual manner, greatly enhancing the audience's visual sensory experience when listening to music.

[0079] In another music recognition scenario, when the smart glasses recognize that the music style type corresponding to the audio information belongs to the rock music style, the background rendering color is red, the background rendering pattern is a percussion instrument, and the background rendering special effect is a dynamic special effect of percussion instruments hitting. When the smart glasses recognize that the music style type corresponding to the audio information belongs to the light music style, the background rendering color is green, the background rendering pattern is a blue and white porcelain pattern, and the background rendering special effect is a dynamic special effect of rotating blue and white porcelain to show the patterns depicted on the bottle body. This embodiment can associate the music style of the audio information with the playback effect of the rhythmic atlas in real time, and present the background rendering elements corresponding to the music style to the audience in a real-time visual manner, greatly enhancing the audience's visual sensory experience when listening to music. It should be noted that the specific embodiment of the rendering elements shown above is only helpful for understanding the embodiments of the present application and does not constitute a limitation on the rendering elements of the present application.

[0080] Step A30, rendering the rhythmic atlas according to the mapped rendering elements;

[0081] The step of dynamically displaying the rhythmic graph on the display screen includes:

[0082] Step A40: dynamically display the rendered rhythmic graph via the display screen.

[0083] This embodiment identifies the type of music style corresponding to the audio information, takes the type of music style corresponding to the audio information as the target music style, and then determines the rendering elements mapped to the target music style from a preset mapping relationship table, wherein the rendering elements include at least one of the background rendering color, background rendering pattern and background rendering special effects of the rhythmic spectrum, and renders the dynamic spectrum according to the mapped rendering elements, and then dynamically displays the rendered rhythmic spectrum through the display screen, so that the music response form at the concert site will be more novel and diverse, and the music will be visualized more realistically to achieve the combination of audio and video. By superimposing the special effects information corresponding to the music style of the audio information on the music rhythm waveform, the user's audio-visual experience is improved, and the fashion sense or technological sense of the rhythmic spectrum is also improved, meeting the user's need to reflect personality and pursue fashion in the appearance of glasses.

[0084] In one practicable manner, before the step of dynamically displaying the rhythmic graph on the display screen, the method includes:

[0085] Step B10, identifying the music style type corresponding to the audio information, and using the music style type corresponding to the audio information as the target music style;

[0086] Step B20: determining rhythmic elements associated with the target music style from a preset association relationship table, wherein the rhythmic elements rhythmically follow the audio rhythm of the audio information to form the contour line.

[0087] In this embodiment, the preset association table stores multiple musical style types and the rhythmic elements mapped to each musical style type. Therefore, the rhythmic element associated with the target musical style can be obtained by querying the preset association table. It should be noted that the rhythmic element rhythmically follows the audio rhythm of the audio information to form the contour line. The appearance of the rhythmic element can be in the shape of a musical note, a bubble, a heart, a flower, or a five-pointed star, etc., which is not specifically limited in this embodiment.

[0088] This embodiment identifies the type of music style corresponding to the audio information, takes the type of music style corresponding to the audio information as the target music style, and determines the rhythmic elements associated with the target music style from a preset association table, wherein the rhythmic elements follow the audio rhythm of the audio information to form a contour line, thereby making the music response form at the concert more novel and diverse, and visually displaying the music more realistically, realizing the combination of audio and video, and further enhancing the audience's visual sensory experience when listening to music and the technical effect of the playability of the smart glasses system.

[0089] In a possible implementation, the step of identifying the music style type corresponding to the audio information includes:

[0090] In step C10, the audio information is input into a pre-trained music recognition neural network model to identify the music style type corresponding to the audio information.

[0091] In this embodiment, a large amount of different audio information can be collected, and then the music style types corresponding to these audio information are manually identified. Then, each audio information and its associated music style type are labeled and bound to obtain multiple training samples. The music recognition neural network model is trained with each training sample until the music recognition neural network model has an accuracy rate greater than a preset threshold for recognizing the music style type of the audio information, and the music recognition neural network model is confirmed to have converged (i.e., it is confirmed that the music recognition neural network model has been trained).

[0092] This embodiment inputs audio information into a pre-trained music recognition neural network model to identify the music style type corresponding to the audio information, thereby efficiently and accurately identifying the music style type of the audio information.

[0093] Please refer to Figure 2 Based on the above embodiment, in a second embodiment of the music response control method, the smart glasses include a speaker, and the step of dynamically picking up audio information in the current sound field through the microphone includes:

[0094] Step S110, when a first preset triggering operation for triggering entry into the listening mode is detected, detecting the audio played by the speaker through a microphone to obtain near-field audio, and using the near-field audio as audio information in the current sound field;

[0095] Step S120: When a second preset triggering operation for triggering entry into the party mode is detected, the microphone is used to detect the audio propagated in the environment in which the smart glasses are located to obtain far-field audio, and the far-field audio is used as the audio information in the current sound field.

[0096] In this embodiment, the first and second preset triggering operations can be pressing specific buttons (e.g., physical buttons or touchscreen buttons) on the smart glasses, or can be preset voiceprint recognition triggering operations, or can be preset gesture recognition triggering operations. Specifically, when the first or second preset triggering operation is a voiceprint recognition triggering operation, it can be, for example, collecting user voice information via the smart glasses' microphone. For example, when the collected voice information includes the key voiceprint information for "listening mode," the first preset triggering operation for triggering entry into listening mode is detected. When the collected voice information includes the key voiceprint information for "party mode," the second preset triggering operation for triggering entry into party mode is detected. Specifically, when the first or second preset triggering operation is a gesture recognition triggering operation, it can be, for example, collecting a user gesture via the smart glasses' camera. When the collected gesture matches a preset first target gesture, the first preset triggering operation for triggering entry into listening mode is detected. When the collected gesture matches a preset second target gesture, the second preset triggering operation for triggering entry into party mode is detected. The first and second target gestures are different.

[0097] In this embodiment, the current sound field can be understood as the sound field in which the smart glasses are located. The audio information in the current sound field can specifically include near-field audio and far-field audio. Among them, near-field audio refers to the audio played by the speakers of the smart glasses themselves, for example, in a quiet environment, the user listens to the music played by the smart glasses themselves. Far-field audio refers to the audio generated by other sound sources in the environment where the smart glasses are located (audio not played by the speakers of the smart glasses themselves), such as music information transmitted in the environment of concerts, dances, and nightclubs.

[0098] Exemplarily, the microphone includes a near-field microphone and a far-field microphone, the near-field microphone is arranged at a position relatively close to the speaker, and the far-field microphone is arranged at a position relatively far away from the speaker, wherein the near-field audio is detected by the near-field microphone, and the far-field audio is detected by the far-field microphone.

[0099] The sound pickup modes of the smart glasses of this embodiment include a listening mode and a party mode. Specifically, when a first preset trigger operation is detected to trigger the listening mode, the microphone detects the audio played by the speaker to obtain near-field audio, and the near-field audio is used as the audio information in the current sound field. When a second preset trigger operation is detected to trigger the party mode, the microphone detects the audio propagating in the environment where the smart glasses are located to obtain far-field audio, and the far-field audio is used as the audio information in the current sound field. This allows the user to enter different sound pickup modes according to their intentions, matching the user with the best sound pickup method to suit the music visualization needs of the smart glasses in different music scenarios. This effectively meets people's musical visual response needs in different music scenarios, further improving the music interaction effect.

[0100] To help understand the technical concept or technical principle of this application, a specific embodiment is listed below:

[0101] In this specific embodiment, please refer to Figure 3 , Figure 3 This is a schematic diagram of a scenario in which the smart glasses, in an embodiment of the present application, respond to music when in listening mode. An e-ink screen (a display screen) is placed on the outer surface of the temple of the glasses frame, displaying a rhythmic pattern that changes with the beat or pitch. The smart glasses' own speakers are playing music. The music played by the smart glasses (i.e., near-field audio) is analyzed and converted into a visual rhythmic waveform (i.e., a rhythmic pattern), which is then displayed on the temple by the e-ink screen, sharing the user's musical experience with those around them.

[0102] In addition, please refer to Figure 4 , Figure 4 This is a schematic diagram of a scenario in which the smart glasses respond to music when entering party mode in an embodiment of the present application. Figure 4 In the smart glasses, the embedded microphone can analyze the music rhythm of the user's venue through AI (Artificial Intelligence) algorithm and transform it into a display on the ink screen laid on the glasses frame, increasing the sense of music immersion and enhancing the entertainment atmosphere. For example, the audio transmitted in the live environment of concerts, dances or nightclubs (i.e. far-field audio) can be detected by the microphone, and the far-field pickup is generally within 5 meters.

[0103] Please refer to Figure 5 , Figure 5This is a schematic diagram of the music response of the smart glasses in an embodiment of the present application. The smart glasses pick up sound through a micro-microphone 1 and provide two modes: listening mode (near-field pickup) and party mode (far-field pickup). AI intelligently analyzes the music and, as the tempo of the current audio changes, outlines the rhythm of the music, generating a dynamically changing rhythmic pattern, which is then displayed on the ink screen 2 placed on the temples.

[0104] For further information, please refer to Figure 6 , Figure 6 This is a flowchart of the music response of the smart glasses for two sound pickup modes in an embodiment of the present application. Figure 6 In the "Listening Mode" mode, the built-in AI algorithm in the smart glasses realizes acoustic visualization, detects the music content currently being listened to by the user, and converts the rhythm of the music content into a dynamically changing rhythmic pattern (the rhythmic pattern changes with the pitch of the music). The rhythmic pattern is then displayed on the temples via the ink screen, sharing the user's musical experience with those around them. When the smart glasses are turned on and enter "Party Mode", the built-in micro microphone in the smart glasses picks up the music playing in the space where the user is currently located. The built-in AI algorithm in the smart glasses converts the music rhythm into a visual rhythmic wave pattern (i.e., a rhythmic pattern) and displays it on the ink screen on the temples. This connects the real-time feedback of the smart glasses with the live music, creating a more rhythmic and interactive presence effect.

[0105] In this embodiment, the smart glasses use a built-in micro-microphone to detect the music the user is currently listening to or the music playing in their surroundings. Using an AI algorithm, the music's rhythm is converted into a dynamic rhythmic pattern (which changes with the pitch of the note) and displayed on an e-ink screen mounted on the frame. It's worth noting that since the e-ink screen only consumes power when switching images, it can remain on for extended periods without consuming any power after switching, thus extending battery life.

[0106] It should be noted that the above specific embodiments are only helpful for understanding the present application and do not constitute a limitation on the scope of protection of the present application. More simple transformations based on the technical concepts or technical principles of the present application are all within the scope of protection of the present application.

[0107] In a possible implementation, before the step of dynamically picking up audio information in the current sound field by the microphone, the method further includes:

[0108] Step D10, detecting and triggering a third preset triggering operation for performing a music response;

[0109] Step D20: If the third preset trigger operation is detected, executing: the step of dynamically picking up audio information in the current sound field through the microphone.

[0110] In this embodiment, correspondingly, the third preset trigger operation can be a pressing operation on a specific button (such as a physical button or a touch screen button) on the smart glasses, or a preset voiceprint recognition trigger operation, or a preset gesture recognition trigger operation.

[0111] This embodiment triggers a third preset trigger operation for music response through detection; if the third preset trigger operation is detected, the subsequent steps are executed: dynamically picking up the audio information in the current sound field through the microphone, thereby avoiding blindly turning on the microphone to collect audio information in the current sound field when the user does not need to perform a visual response to music, and converting the dynamically picked up audio information into a rhythmic graph corresponding to the audio information.

[0112] In one possible embodiment, the glasses frame includes a frame and two temples extending outward from both ends of the frame, the display screen includes a first display screen and a second display screen, the third preset trigger operation includes a first music response trigger operation and a second music response trigger operation, the first display screen is laid on the outer surface of the temple, and the second display screen is laid on the outer surface of the frame, and the method further includes:

[0113] Step E10: If the first music response triggering operation is detected, dynamically picking up audio information in the current sound field via the microphone; converting the dynamically picked up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information; and dynamically displaying the rhythmic pattern on the first display screen;

[0114] Step E20: If the second music response trigger operation is detected, the audio information in the current sound field is dynamically picked up by the microphone; the dynamically picked up audio information is converted into a rhythmic graph corresponding to the audio information, wherein the rhythmic graph includes a contour line that rhythmically follows the audio rhythm of the audio information; and the rhythmic graph is dynamically displayed through the second display screen.

[0115] In this embodiment, the outer surface of the frame refers to the surface of the frame away from the wearer's skin. Correspondingly, the inner surface of the frame refers to the surface of the frame close to the wearer's skin. It is easy to understand that when wearing glasses, users can often only see the outer surface of the frame. The inner side of the frame is adjacent to the wearer's skin and is a blind spot. Therefore, it is the outer surface of the frame that plays a key role in the decorative appearance of the frame. Therefore, placing the display screen on the outer surface of the frame can meet the user's personalized needs for music visualization while reducing the hardware cost of the smart glasses.

[0116] It should be noted that the first music response triggering operation is different from the second music response triggering operation.

[0117] This embodiment dynamically displays the rhythmic pattern on the display screen laid on the outer surface of the temple when a first music response trigger operation is detected, and dynamically displays the rhythmic pattern on the display screen laid on the outer surface of the frame when a second music response trigger operation is detected. This can achieve accurate music visualization display on the appearance of a specific part of the smart glasses according to the actual needs of the user, making the music response form more diverse and novel, thereby meeting people's response needs in music vision and improving the music interaction effect.

[0118] Furthermore, the third preset trigger operation further includes a third music response trigger operation, and the method further includes:

[0119] Step F10: If the third music response triggering operation is detected, the audio information in the current sound field is dynamically picked up by the microphone; the dynamically picked up audio information is converted into a rhythmic graph corresponding to the audio information, wherein the rhythmic graph includes a contour line that rhythmically follows the audio rhythm of the audio information; and the rhythmic graph is dynamically displayed on both the first display screen and the second display screen.

[0120] In this embodiment, the third music response triggering operation is also different from the first music response triggering operation and the second music response triggering operation.

[0121] This embodiment dynamically displays the appearance patterns currently displayed on the first display screen and the second display screen as rhythmic patterns when a third music response trigger operation is detected. Therefore, when the user wishes to display the entire appearance of the smart glasses as the target appearance pattern, the third music response trigger operation can be used to dynamically display the appearance of all parts of the smart glasses (the temples and the frame), thereby further meeting people's visual response needs for music and improving the music interaction effect.

[0122] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural transformation made by using the contents of the present description and drawings under the inventive concept of the present invention, or directly / indirectly applied in other related technical fields, is included in the patent protection scope of the present invention.

[0123] like Figure 7 As shown, Figure 7 This is a schematic diagram of the structure of the smart glasses involved in the hardware operating environment of the embodiment of the present application.

[0124] like Figure 7 As shown, the smart glasses may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display and an input unit such as a keyboard. Optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory, such as a disk storage device. The memory 1005 may also be a storage device independent of the processor 1001.

[0125] Optionally, smart glasses may also include RF (Radio Frequency) circuits, sensors, audio circuits, WiFi modules, and the like. Sensors include vibration sensors. Of course, smart glasses may also be equipped with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, which are not detailed here.

[0126] Those skilled in the art will understand that Figure 7 The terminal structure shown in the figure does not constitute a limitation to the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0127] like Figure 7 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a music response program.

[0128] exist Figure 7In the terminal shown, the network interface 1004 is primarily used to connect to a backend server and perform data communications with the backend server; the user interface 1003 is primarily used to connect to a client (user end) and perform data communications with the client; and the processor 1001 can be used to call a music response program stored in the memory 1005 and perform the following operations:

[0129] Dynamically picking up audio information in the current sound field through the microphone;

[0130] Converting the dynamically picked-up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information;

[0131] The rhythmic graph is dynamically displayed on the display screen.

[0132] In some embodiments, the display screen is an ink screen, the glasses frame includes a frame, and two temples extending outward from both ends of the frame, and the ink screen is laid on the outer surface of the temples.

[0133] In some embodiments, the processor 1001 may call a music response program stored in the memory 1005 and further perform the following operations:

[0134] Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style;

[0135] Determining a rendering element of the target music style mapping from a preset mapping relationship table, wherein the rendering element includes at least one of a background rendering color, a background rendering pattern, and a background rendering special effect of the rhythmic pattern;

[0136] Rendering the rhythmic atlas according to the mapped rendering elements;

[0137] The step of dynamically displaying the rhythmic graph on the display screen includes:

[0138] The rendered rhythmic atlas is dynamically displayed through the display screen.

[0139] In some embodiments, the processor 1001 may call a music response program stored in the memory 1005 and further perform the following operations:

[0140] Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style;

[0141] A rhythmic element associated with the target music style is determined from a preset association relationship table, wherein the rhythmic element rhythmically follows the audio rhythm of the audio information to form the contour line.

[0142] In some embodiments, the processor 1001 may call a music response program stored in the memory 1005 and further perform the following operations:

[0143] The audio information is input into a pre-trained music recognition neural network model to identify the music style type corresponding to the audio information.

[0144] In some embodiments, the processor 1001 may call a music response program stored in the memory 1005 and further perform the following operations:

[0145] When a first preset triggering operation is detected that triggers entering the listening mode, the microphone detects the audio played by the speaker to obtain near-field audio, and uses the near-field audio as the audio information in the current sound field;

[0146] When a second preset triggering operation that triggers entering the party mode is detected, the microphone detects the audio propagated in the environment where the smart glasses are located to obtain far-field audio, and the far-field audio is used as the audio information in the current sound field.

[0147] In some embodiments, the microphone includes a near-field microphone and a far-field microphone, the near-field microphone is located relatively close to the speaker, and the far-field microphone is located relatively far away from the speaker, wherein the near-field audio is detected by the near-field microphone, and the far-field audio is detected by the far-field microphone.

[0148] In some embodiments, the processor 1001 may call a music response program stored in the memory 1005 and further perform the following operations:

[0149] Detecting a trigger to perform a third preset trigger operation of a music response;

[0150] If the third preset trigger operation is detected, the step of dynamically picking up audio information in the current sound field through the microphone is executed.

[0151] In addition, the present invention also provides smart glasses, which include: a memory, a processor, and a music response program stored in the memory and runnable on the processor. When the music response program is executed by the processor, the steps of the music response control method described above are implemented.

[0152] The present invention also provides a computer-readable storage medium, on which a music response program is stored. When the music response program is executed by a processor, the steps of the music response control method described above are implemented.

[0153] The specific implementation of the computer-readable storage medium of the present invention is basically the same as the various embodiments of the above-mentioned music response control method, and will not be repeated here.

[0154] It is understood that the above scenarios are merely examples and do not limit the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, those skilled in the art will appreciate that with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application will also be applicable to similar technical problems.

[0155] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0156] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0157] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0158] In this application, the same or similar terminology, technical solutions and / or application scenario descriptions are generally only described in detail the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, for the same or similar terminology, technical solutions and / or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

[0159] In this application, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0160] The various technical features of the technical solution of this application can be combined arbitrarily. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0161] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the existing technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the method of each embodiment of the present application.

[0162] The above embodiments can be implemented in whole or in part through software, hardware, firmware, or any combination thereof. When implemented using software, they can be implemented in whole or in part in the form of a computer program product. A computer program product comprises one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., optical, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer, or a data storage device such as a server or data center that integrates one or more available media. Available media can include magnetic media (e.g., floppy disks, storage disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0163] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0164] In the present invention, unless otherwise specified or limited, the terms "connection" and "fixation" should be understood in a broad sense. For example, "fixation" can mean fixed connection, detachable connection, or integration; mechanical connection or electrical connection; direct connection or indirect connection through an intermediate medium; internal communication between two elements or interaction between two elements, unless otherwise specified. Those skilled in the art will be able to understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0165] In addition, the technical solutions between the various embodiments of the present invention can be combined with each other, but it must be based on the fact that ordinary technicians in this field can implement it. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0166] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A music response control method, characterized in that: The music response control method is applied to smart glasses, which include a glasses frame, a microphone, and a display screen, wherein the display screen is laid on the surface of the glasses frame. The method includes: Dynamically picking up audio information in the current sound field through the microphone; Converting the dynamically picked-up audio information into a rhythmic pattern corresponding to the audio information, wherein the rhythmic pattern includes contour lines that rhythmically follow the audio rhythm of the audio information; Dynamically displaying the rhythmic graph via the display screen; Before the step of dynamically displaying the rhythmic graph on the display screen, the method includes: Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style, wherein the music style type supports classification according to music mood; Determining a rhythmic element associated with the target music style from a preset association relationship table, wherein the rhythmic element rhythmically follows the audio rhythm of the audio information to form the contour line; Among them, the step of identifying the music style type corresponding to the audio information includes: identifying the current emotion type of the audio information based on the notes of the audio information, wherein each note corresponds to an emotion increment, and the current emotion type of the audio information is related to the superposition value of the emotion increments of the notes of the played part of the music.

2. The music response control method according to claim 1, wherein: The display screen is an ink screen, the glasses frame includes a frame and two temples extending outward from both ends of the frame, and the ink screen is laid on the outer surfaces of the temples.

3. The music response control method according to claim 1, wherein: Before the step of dynamically displaying the rhythmic graph on the display screen, the method further includes: Identifying a music style type corresponding to the audio information, and using the music style type corresponding to the audio information as a target music style; Determining a rendering element of the target music style mapping from a preset mapping relationship table, wherein the rendering element includes at least one of a background rendering color, a background rendering pattern, and a background rendering special effect of the rhythmic pattern; Rendering the rhythmic atlas according to the mapped rendering elements; The step of dynamically displaying the rhythmic graph on the display screen includes: The rendered rhythmic atlas is dynamically displayed through the display screen.

4. The music response control method according to claim 3, wherein: The step of identifying the music style type corresponding to the audio information includes: The audio information is input into a pre-trained music recognition neural network model to identify the music style type corresponding to the audio information.

5. The music response control method according to claim 1, wherein: The smart glasses include a speaker, and the step of dynamically picking up audio information in the current sound field through the microphone includes: When a first preset triggering operation is detected that triggers entering the listening mode, the microphone detects the audio played by the speaker to obtain near-field audio, and uses the near-field audio as the audio information in the current sound field; When a second preset triggering operation that triggers entering the party mode is detected, the microphone detects the audio propagated in the environment where the smart glasses are located to obtain far-field audio, and the far-field audio is used as the audio information in the current sound field.

6. The music response control method according to claim 5, wherein: The microphone includes a near-field microphone and a far-field microphone, the near-field microphone is arranged at a position relatively close to the speaker, and the far-field microphone is arranged at a position relatively far away from the speaker, wherein the near-field audio is detected by the near-field microphone, and the far-field audio is detected by the far-field microphone.

7. The music response control method according to claim 1, wherein: Before the step of dynamically picking up audio information in the current sound field by the microphone, the method further includes: Detecting a trigger to perform a third preset trigger operation of a music response; If the third preset trigger operation is detected, the step of dynamically picking up audio information in the current sound field through the microphone is executed.

8. A pair of smart glasses, characterized in that: The smart glasses include: a memory, a processor, and a music response program stored in the memory and executable on the processor. When the music response program is executed by the processor, the steps of the music response control method according to any one of claims 1 to 7 are implemented.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a music response program, which, when executed by a processor, implements the steps of the music response control method according to any one of claims 1 to 7.

Images