A multi-speaker intelligent management and control system

Abstract

The invention discloses a multi-speaker intelligent management and control system, which relates to the technical field of multi-speaker control, and comprises a data acquisition unit, a database, an audio marking module, an audio mixing module, an audio recognition module, and an audio distribution module; the data acquisition unit is used to obtain data and save it in the database; the multi-speaker intelligent management and control system, by setting the data acquisition unit, the database, the audio marking module, the audio mixing module, and the audio recognition module, can collect and mix the sounds of human voices, various musical instruments, and sound effects, and then train an algorithm model based on these data, so that the human voices, various musical instrument sounds, and sound effect sounds in music songs can be separated and extracted through the algorithm model, and are transmitted to the speakers connected to the corresponding channels according to different sound emission positions, thereby improving the accuracy of simulating the sound emission positions of human voices and various musical instruments through the multiple speakers, so that the multiple speakers have a higher degree of on-site restoration when playing music.

Description

Technical Field

[0001] The present invention relates to the technical field of multi-speaker control, and in particular to a multi-speaker intelligent management and control system. Background Art

[0002] With the advancement of science and technology, people's requirements for quality of life are getting higher and higher. In terms of audio and video, they usually require multi-channel stereo to enrich people's auditory experience.

[0003] For example, the prior art with the publication number CN115278510A discloses a method, device and medium for wireless super multi-channel holographic audio with an Internet of Things card. The method is executed by a PC remote audio management platform, including: sending an account login request to a cloud-based Internet of Things audio data service platform, receiving an INTERNET account login response fed back by the cloud-based Internet of Things audio data service platform, entering the cloud-based Internet of Things audio data service platform, issuing various instructions and viewing the active speakers of the Internet of Things card; uploading the prepared multiple audio files by number to the music file management negative of the cloud-based Internet of Things audio data service platform, and then dragging the corresponding numbered audio files into the corresponding channel IP address one by one to distribute them to each active speaker of the Internet of Things card. This prior art can provide a super multi-channel audio solution for wireless remote control of up to 3,000 channels of the Internet of Things, and time-synchronized playback, and combined with solar panels, it can achieve a truly comprehensive wireless, simple system super multi-channel audio solution.

[0004] However, if general audio is to be transmitted to multiple speakers for multi-channel playback, the audio itself needs to support multi-channel playback mode. This requires using multiple pickups to pick up and record audio from different directions when recording audio, so that the sound and time of the sound emitted by each sound source to each pickup are different. This not only increases the cost and conditions of audio recording, but is also not suitable for multi-channel playback of mono audio. Summary of the invention

[0005] The purpose of the present invention is to provide a multi-speaker intelligent management and control system to solve the above-mentioned deficiencies in the prior art.

[0006] In order to achieve the above-mentioned object, the present invention provides the following technical solutions: a multi-audio intelligent management and control system, including a data acquisition unit, a database, an audio marking module, an audio mixing module, an audio recognition module, and an audio distribution module;

[0007] The data acquisition unit is used to acquire data and save it in the database. The data acquisition unit includes an audio data acquisition module. The audio data acquisition module is used to acquire audio data and save it in the database. The audio data includes instrument audio data of various instruments, human voice audio data, and sound effect audio data. The single instrument audio data only includes the playing sound of one instrument, and the human voice audio data only includes human voice. The sound effect refers to various non-instrument sounds and human voice effect sounds such as car horn sounds, vehicle emergency brake sounds, cannon sounds, bullet loading sounds, etc.

[0008] The audio tag module is used to set an audio type label and associate the audio type label with the corresponding audio data in the database, that is, to associate the audio data in the database with the corresponding audio type label; and by setting a plurality of audio groups in the database in one-to-one correspondence with each audio type label, the audio data can be automatically associated with the corresponding audio type label by saving the audio data in the corresponding audio group, which is more convenient for the association and management of the audio data;

[0009] The audio mixing module is used to select multiple audio data associated with various audio type tags, and merge the selected audio data into one music audio data. Merging multiple audios into one audio is common knowledge in the prior art and is directly applied without modification. Therefore, it is not specifically described in this technical solution, and it will not cause trouble to this technical solution based on the field. For example, it can be performed using audio editing software; for example, piano accompaniment, drum accompaniment, violin accompaniment, other sound effects and human voice singing are merged in the order of arrangement to obtain a music song with accompaniment;

[0010] The audio recognition module is used to train a machine learning model based on the music audio data, the audio data and the audio category label to obtain an audio separation model, which is used to identify various audio data in the music audio data according to the input music audio data, associate the audio data with the corresponding audio category label, and then separate the identified various audio data;

[0011] The audio classification module is used to set multiple channel output ports, and the audio data associated with each audio type label is associated with each channel output port. One audio data is associated with at least one channel output port, that is, each type of audio data can be associated with one audio data output port, or can be associated with two or more channel output ports;

[0012] The audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the corresponding speakers, which play the audio data. The speakers can be arranged in 2.0, 5.1, or 7.1 channel arrangements according to the number of speakers, and the speakers corresponding to each channel are connected to the corresponding channel output ports.

[0013] Furthermore, the audio marking module is provided with a plurality of sound effect type labels and other sound effect labels, which are used to associate with sound effect audio data corresponding to different sound effects respectively. For example, when the classified sound effect data is set as a car horn sound or a vehicle sudden braking sound, if the sound corresponding to the collected audio data is a car horn sound, the audio data is associated with the sound effect type label corresponding to the car horn sound; if the sound corresponding to the collected audio data is a bullet loading sound, which does not belong to a car horn sound or a vehicle sudden braking sound, the audio data is associated with the sound effect type labels corresponding to other sound effect sounds.

[0014] Furthermore, the sound effect audio data includes a plurality of classified sound effect data and other sound effect data, wherein each classified sound effect data corresponds to a sound effect type label. If the sound effect corresponding to the set sound effect type label does not contain the sound in the sound effect audio data, then the sound effect audio data is associated with other sound effect data and other sound effect labels.

[0015] Furthermore, the data acquisition unit also includes a scene data acquisition module, which is used to collect various combinations of human voice audio data and multiple musical instrument audio data, the corresponding sound positions of each musical instrument and human voice, and collect the best listening positions under the combination to obtain scene data. For example, a song contains human voice singing, piano accompaniment, and drum accompaniment. The scene data acquisition module is used to collect the sound position of human voice singing, that is, the position where the singer stands when singing, the sound position of piano accompaniment, that is, the position where the piano is placed during accompaniment, and the sound position of drum accompaniment, that is, the position where the drum is placed during accompaniment when human voice singing, piano accompaniment, and drum accompaniment exist at the same time, and only a set of the most commonly used positions are collected for each combination.

[0016] Furthermore, the system also includes a scene recognition module, which is used to obtain the audio data separated by the audio separation model and the corresponding audio type label, and retrieve the corresponding scene data based on the obtained audio type label.

[0017] Furthermore, the system also includes a position-channel relationship corresponding module, which is used to calculate the relative position of each sound position and the best listening position based on the sound position of each musical instrument and human voice in the scene data, and the corresponding best listening position, the relative position including the angle and distance. For example, taking the best listening position as the pole, the direction facing the listener at the best listening position is the positive direction, i.e. 0 degrees, and the distance and angle of each sound position relative to the pole are calculated and marked.

[0018] Furthermore, the channel relationship corresponding module is also used to match the relative position with each channel based on the relative position and the placement position of the speakers corresponding to each channel of each stereo, for example, matching the relative position with the channel corresponding to the speaker closest to it, wherein each stereo may include 2.0 channels, 5.1 channels, 7.1 channels, etc., and the placement position of the speakers corresponding to each channel of these stereos is common knowledge under the prior art and is directly applied here without modification, so it is not specifically described in this technical solution, and based on the field, it will not cause trouble to this technical solution.

[0019] Furthermore, the audio distribution module is used to correspond the channel output ports to the channels, and the audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the channel output port corresponding to the channel that matches the relative position of the sound emission position of the audio data and the optimal listening position, and then the channel output port transmits the audio data to the speakers connected to the channel data port.

[0020] 1. Compared with the prior art, the multi-audio intelligent management and control system provided by the present invention, by setting a data acquisition unit, a database, an audio tagging module, an audio mixing module, and an audio recognition module, can collect the sounds of human voice, various musical instruments, and sound effects, mix them, and then train an algorithm model based on these data, so that the human voice, various musical instrument sounds, and sound effect sounds in music songs can be separated and extracted through the algorithm model.

[0021] 2. Compared with the prior art, the multi-speaker intelligent management and control system provided by the present invention, by setting a data acquisition unit, a database, an audio marking module, an audio mixing module, an audio recognition module, an audio allocation module, and a position-channel relationship corresponding module, can transmit the separated and extracted human voices, various musical instrument sounds, and sound effect sounds to the speakers connected to the corresponding channels according to the different sound positions, thereby improving the accuracy of simulating the human voice and the sound position of each musical instrument through multiple speakers, so that the multiple speakers have a higher degree of on-site restoration when playing music.

[0022] 3. Compared with the prior art, the multi-speaker intelligent management and control system provided by the present invention can identify and match the corresponding scene according to the combination of separated and extracted human voices, various musical instrument sounds and sound effects by setting a scene data acquisition module and a scene recognition module, and obtain the sound positions of human voices and various musical instrument sounds based on the matched scene, so as to facilitate the transmission of human voices and various musical instrument sounds to the corresponding channels according to the sound positions, and play the speakers connected to the corresponding channels. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0024] Figure 1 The overall structure block diagram of the system provided by the embodiment of the present invention;

[0025] Figure 2 This is a structural block diagram of a data acquisition unit provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings.

[0027] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0028] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, "multiple" means two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0029] Example embodiments will be described more fully below with reference to the accompanying drawings, but the example embodiments may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. On the contrary, the purpose of providing these embodiments is to make the present disclosure thorough and complete and to enable those skilled in the art to fully understand the scope of the present disclosure.

[0030] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.

[0031] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0032] The terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. As used herein, the singular forms "a", "an" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise. It will also be understood that when the terms "comprising" and / or "made of" are used in this specification, the presence of the features, wholes, steps, operations, elements and / or components is specified, but the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof is not excluded.

[0033] The embodiments described herein may be described with reference to plan views and / or cross-sectional views by means of idealized schematic diagrams of the present disclosure. Therefore, the example illustrations may be modified according to manufacturing techniques and / or tolerances. Therefore, the embodiments are not limited to the embodiments shown in the accompanying drawings, but include modifications of the configurations formed based on the manufacturing process. Therefore, the regions illustrated in the accompanying drawings have schematic properties, and the shapes of the regions shown in the figures illustrate the specific shapes of the regions of the elements, but are not intended to be limiting.

[0034] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined as such herein.

[0035] See also Figure 1-Figure 2 , a multi-speaker intelligent management and control system, including a data acquisition unit, a database, an audio marking module, an audio mixing module, an audio recognition module, and an audio distribution module.

[0036] The data acquisition unit is used to acquire data and save it into a database. The data acquisition unit includes an audio data acquisition module. The audio data acquisition module is used to acquire audio data and save it into a database. The audio data includes instrument audio data of various musical instruments, vocal audio data, and sound effect audio data. Among them, a single instrument audio data only contains the playing sound of one instrument, and the vocal audio data only contains the human voice. The sound effect refers to various non-instrument sounds and the effect sound of the human voice, such as the sound of a car horn, the sound of a vehicle braking suddenly, the sound of a cannon, the sound of a bullet being loaded, etc.

[0037] The audio tagging module is used to set audio category tags and associate the audio category tags with the corresponding audio data in the database, that is, to associate the audio data in the database with the corresponding audio category tags; it is also possible to set multiple audio groups in the database in one-to-one correspondence with each audio category tag, so that the audio data can be saved in the corresponding audio group and automatically associated with the corresponding audio category tag, which is more convenient for the association and management of audio data; wherein, the audio tagging module is provided with a plurality of sound effect category tags and other sound effect tags, which are used to associate with the sound effect audio data corresponding to different sound effects respectively, for example, the classified sound effect data set is car horn When the sound of a whistle or a vehicle brakes suddenly, if the sound corresponding to the collected audio data is a car whistle sound, the audio data is associated with the sound effect type label corresponding to the car whistle sound; if the sound corresponding to the collected audio data is a bullet loading sound, the audio data is associated with the sound effect type label corresponding to other sound effect sounds; the sound effect audio data includes a variety of classified sound effect data and other sound effect data, each of which corresponds to a sound effect type label. If the sound effect corresponding to the set sound effect type label does not have the sound in the sound effect audio data, the sound effect audio data is other sound effect data and is associated with other sound effect labels.

[0038] The audio mixing module is used to select multiple audio data associated with various audio type tags, and merge the selected audio data into one music audio data. Merging multiple audios into one audio is common knowledge in the prior art and is directly applied here without any changes. Therefore, it is not described in detail in this technical solution, and it will not cause any trouble to this technical solution based on the field. For example, it can be performed using audio editing software; for example, piano accompaniment, drum accompaniment, violin accompaniment, other sound effects and vocal singing are merged in the order of arrangement to obtain a music song with accompaniment.

[0039] The audio recognition module is used to train a machine learning model based on music audio data, audio data and audio category labels to obtain an audio separation model, which is used to identify various audio data in the music audio data based on the input music audio data, associate the audio data with the corresponding audio category labels, and then separate the various identified audio data.

[0040] The data collection unit also includes a scene data collection module, which is used to collect various combinations of vocal audio data and multiple musical instrument audio data, the corresponding sound positions of each musical instrument and vocal, and collect the best listening positions in the combination to obtain scene data. For example, a song contains vocal singing, piano accompaniment, and drum accompaniment. The scene data collection module is used to collect the sound position of the vocal singing, that is, the position where the singer stands when singing, the sound position of the piano accompaniment, that is, the position where the piano is placed during the accompaniment, and the sound position of the drum accompaniment, that is, the position where the drum is placed during the accompaniment when vocal singing, piano accompaniment, and drum accompaniment exist at the same time, and only a set of the most commonly used positions are collected for each combination.

[0041] The audio classification module is used to set multiple channel output ports, and associate the audio data associated with each audio type label with each channel output port. One audio data is associated with at least one channel output port, that is, each type of audio data can be associated with one audio data output port, or with two or more channel output ports.

[0042] The system also includes a scene recognition module and a position-channel relationship correspondence module;

[0043] The scene recognition module is used to obtain the audio data separated by the audio separation model and the corresponding audio type label, and retrieve the corresponding scene data based on the obtained audio type label.

[0044] The position-channel relationship correspondence module is used to calculate the relative position of each sound position and the optimal listening position based on the sound position of each musical instrument and human voice in the scene data, and the corresponding optimal listening position. The relative position includes angle and distance. For example, the optimal listening position is taken as the pole, and the direction facing the listener at the optimal listening position is the positive direction, i.e., 0 degrees. The distance and angle of each sound position relative to the pole are calculated and marked. The channel relationship correspondence module is also used to match the relative position with each channel based on the relative position and the placement position of the sound corresponding to each channel of each stereo. For example, the relative position is matched with the channel corresponding to the sound closest to it, wherein each stereo may include 2.0 channels, 5.1 channels, 7.1 channels, etc., and the placement position of the sound corresponding to each channel of these stereos is common knowledge under the prior art, and is directly applied here without modification, so it is not specifically described in this technical solution, and will not cause trouble to this technical solution based on the field.

[0045] The audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the corresponding speakers, which play the audio data. The speakers can be placed in 2.0, 5.1, and 7.1 channel arrangements according to the number of speakers, and the speakers corresponding to each channel are connected to the corresponding channel output ports. In one embodiment, the audio distribution module matches the channel output ports with the channels, and the audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the channel output port corresponding to the channel that matches the relative position of the sound position of the audio data and the best listening position, and then the channel output port transmits the audio data to the speakers connected to the channel data port.

[0046] The above description is only by way of illustration of certain exemplary embodiments of the present invention. It is undoubted that those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the above drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. A multi-speaker intelligent management and control system, characterized by: It includes a data acquisition unit, a database, an audio tagging module, an audio mixing module, an audio recognition module and an audio distribution module; The data acquisition unit is used to acquire data and save it in the database. The data acquisition unit includes an audio data acquisition module. The audio data acquisition module is used to acquire audio data and save it in the database. The audio data includes instrument audio data of various musical instruments, human voice audio data and sound effect audio data; The audio tag module is used to set an audio category label and associate the audio category label with the corresponding audio data in the database; The audio mixing module is used to select a plurality of audio data associated with various audio category tags, and merge the selected audio data into one music audio data; The audio recognition module is used to train a machine learning model based on the music audio data, the audio data and the audio category label to obtain an audio separation model, which is used to identify various audio data in the music audio data according to the input music audio data, associate the audio data with the corresponding audio category label, and then separate the identified various audio data; The audio distribution module is used to set a plurality of channel output ports, and associate the audio data associated with each audio type label with each channel output port, and one audio data is associated with at least one channel output port; The audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the corresponding speakers; The data collection unit further includes a scene data collection module, which is used to collect various combinations of human voice audio data and multiple musical instrument audio data, as well as the sounding positions of the corresponding musical instruments and human voices, and collect the best listening positions under the combination to obtain scene data; The system further includes a scene recognition module, the scene recognition module being used to obtain the audio data separated by the audio separation model and the corresponding audio type label, and retrieve the corresponding scene data based on the obtained audio type label; The system further comprises a position-channel relationship corresponding module, which is used to calculate the relative position of each sound emission position and the best listening position based on the scene data; The channel relationship corresponding module is also used to match the relative position with each channel based on the relative position and the placement position of the speakers corresponding to each channel of each stereo.

2. A multi-speaker intelligent management and control system according to claim 1, characterized in that: The audio distribution module is used to match the channel output ports with the channels, and the audio distribution module is used to distribute and transmit the audio data associated with each channel output port to the channel output port corresponding to the channel matching the relative position, and then the channel output port transmits the audio data to the speakers connected to the channel output port.

Images