Sound equipment control method based on human body position detection and sound equipment

Abstract

The invention relates to a sound equipment control method based on human body position detection and sound equipment, and position detection equipment of the sound equipment serves as human body position detection hardware and is configured to detect the position of a target human body in real time to obtain detection information. And the processor equipment stores the association model of any one embodiment, and is configured to perform similarity calculation on the detection information and the position information according to the association model, and call an associated logic time sequence to control the power amplifier equipment. Through the pre-calibrated sound equipment control logic, the logic time sequence is called according to the similarity calculation of the detection information and the position information, so that the control effect of the power amplifier equipment is closer to an ideal control effect.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent audio, and in particular to an audio control method and an audio system based on human body position detection. Background Art

[0002] Audio is the abbreviation of audio system, which refers to a set of equipment that can restore and play audio signals. It provides high-quality sound experience by receiving, amplifying and reproducing sound signals. Audio system usually includes components such as microphones, decoders, power amplifiers and speakers, which work together to convert audio signals into audible sounds.

[0003] At present, with the development of intelligent hardware technology, the technical form and control logic of traditional audio have also undergone a lot of improvements. For example, intelligent volume control replaces the traditional manual volume operation control method, that is, a more intelligent audio control solution. In this type of intelligent audio control solution, the use of human position information as the basis of control variables is currently widely used, which can realize the automation of audio control and the improvement of human-computer interaction. At present, the audio control solution based on human position detection, the hardware system mainly includes human positioning equipment, audio control circuit and audio equipment. The human positioning equipment detects the position information of the target human body and converts it into the variable input of the audio control circuit in real time. The audio control circuit outputs a control signal to adjust the state of the audio equipment.

[0004] However, the current audio control solutions based on human position detection mainly perform real-time control based on the real-time changes in the human position, resulting in abrupt changes in the control sequence, which is poorly matched with the actual needs of audio control and only matches single control needs. When faced with complex audio control needs, especially audio control scenarios based on complex human-computer interaction needs, the current audio control solutions based on human position detection have poor implementation effects. Summary of the invention

[0005] In view of the above analysis, the embodiments of the present invention aim to provide a sound control method and sound based on human position detection, so as to solve the problem that the current sound control scheme based on human position detection has poor implementation effect when the sound control scenario is based on complex human-computer interaction requirements in the existing technology implementation results.

[0006] The present application provides a method for controlling sound based on human position detection, including:

[0007] Collecting location sample data, and calibrating the sound control logic according to the location sample data, and establishing a sound control model; wherein the location sample data includes location information, the sound control logic includes a logic sequence, and the sound control model is a correlation model of the location information and the logic sequence;

[0008] Detect the position of the target body in real time and obtain detection information;

[0009] The detection information and the position information are similarly calculated according to the association model, and the associated logic sequence is called to control the power amplifier device.

[0010] The audio control method based on human position detection in the embodiment of the present application collects position sample data, calibrates the audio control logic according to the position sample data, and establishes an audio control model; wherein the audio control model is an association model of position information and logic timing. The position of the target human body is detected in real time to obtain detection information; the detection information and the position information are similarly calculated according to the association model, and the associated logic timing is called to control the power amplifier device. Through the pre-calibrated audio control logic, the logic timing is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect.

[0011] As one of the optional embodiments, the position sample data includes continuous position information of a first time period; the sound control logic includes continuous logic timing of a second time period;

[0012] Among them, location information and logical timing are structured data.

[0013] As one of the optional embodiments, the process of building the association model includes the following steps:

[0014] Split the location information to obtain information blocks;

[0015] Multiple logic sequences are embedded into information blocks in a vector embedding manner to obtain an association model in the form of a vector library.

[0016] As one of the optional embodiments, the process of calculating the similarity between the detection information and the position information according to the association model and calling the associated logic sequence to control the power amplifier device includes the steps of:

[0017] Calculate the cosine similarity between each detection information and the position information;

[0018] According to the supervised vector scheme, the cosine similarity is optimized to determine the location information that best matches the detection information.

[0019] As one of the optional embodiments, the process of calculating the cosine similarity between each detection information and the position information is as follows:

[0020]

[0021] Among them, A is the vector representation of detection information, B is the vector representation of position information, θ is the angle between A and B, ||A|| and ||B|| are the norms of vector A, ||B|| is the norm of vector B, and similarity represents cosine similarity.

[0022] As one of the optional embodiments, the process of optimizing the cosine similarity according to the supervised vector scheme and determining the location information that best matches the detection information includes the steps of:

[0023] The CoSENT scheme is adopted to calculate the cosine similarity so that the association model focuses on improving the matching similarity score and reducing the mismatching similarity score, thereby obtaining the location information that best matches the detection information.

[0024] As one of the optional embodiments, the process of calculating the similarity between the detection information and the position information according to the association model and calling the associated logic sequence to control the power amplifier device also includes the steps of:

[0025] Constraining cosine similarity via a scoring scheme.

[0026] As one of the optional embodiments, the scoring scheme is as follows:

[0027]

[0028] Where D stands for information block, Q stands for query, and q i represents the structural unit in the query, f(q i ,D) is the number of structured units contained in the information block D; k 1 is an adjustable parameter, where k 1 =1.2-2.0, b is 0.0-1.0, len(D) is the length of the position information, and avg_len is the average length of each information block;

[0029] Among them, α·similarity+β·BM25 is less than the set value, and α+β=1; similarity represents cosine similarity.

[0030] The embodiment of the present application also provides an audio control device based on human body position detection, comprising:

[0031] A model building module is used to collect position sample data, calibrate the sound control logic according to the position sample data, and build a sound control model; wherein the position sample data includes position information, the sound control logic includes a logic sequence, and the sound control model is a correlation model of the position information and the logic sequence;

[0032] The information acquisition module is used to detect the position of the target human body in real time and obtain detection information;

[0033] The control execution module is used to calculate the similarity between the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device.

[0034] The audio control device based on human position detection in the embodiment of the present application collects position sample data, calibrates the audio control logic according to the position sample data, and establishes an audio control model; wherein the audio control model is an association model of position information and logic timing. The position of the target human body is detected in real time to obtain detection information; the detection information and the position information are similarly calculated according to the association model, and the associated logic timing is called to control the power amplifier device. Through the pre-calibrated audio control logic, the logic timing is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect.

[0035] The present application also provides a sound system, including:

[0036] Amplifier equipment;

[0037] A position detection device is configured to detect the position of a target human body in real time and obtain detection information;

[0038] The processor device stores the association model of any of the above embodiments and is configured to perform similarity calculation on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device.

[0039] The audio device of the embodiment of the present application, as human body position detection hardware, is configured to detect the position of the target human body in real time and obtain detection information. The processor device stores the association model of any of the above embodiments, and is configured to perform similarity calculations on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device. Through the pre-calibrated audio control logic, the logic sequence is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A flow chart of a highway accident handling and tracking method based on video monitoring provided by the present invention;

[0041] Figure 2 A flow chart of a highway accident handling and tracking method based on video monitoring according to a preferred embodiment of the present invention;

[0042] Figure 3 A module structure diagram of a highway accident handling and tracking device based on video monitoring according to an embodiment of the present invention;

[0043] Figure 4 A schematic block diagram of a data control device provided by the present invention;

[0044] Figure 5 A schematic diagram of a non-transitory computer-readable storage medium provided by the present invention;

[0045] Figure 6 A schematic diagram of an acoustic structure of a disclosed embodiment. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme of the embodiments of the present application will be clearly and completely described below in conjunction with the drawings of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the described embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] Unless otherwise defined, the technical terms or scientific terms used in this application should be understood by people with ordinary skills in the field to which this application belongs. "First", "second" and similar words used in this application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0048] In order to keep the following description of the embodiments of the present application clear and concise, the present application omits detailed descriptions of some known functions and known components.

[0049] The embodiment of the present application provides a sound control method based on human body position detection.

[0050] Figure 1 FIG. 1 is a flow chart of a sound control method based on human position detection according to a disclosed embodiment. Figure 1 As shown, a sound control method based on human position detection according to a disclosed embodiment includes steps S100 to S102:

[0051] S100, collecting location sample data, and calibrating the sound control logic according to the location sample data to establish a sound control model; wherein the location sample data includes location information, the sound control logic includes a logic sequence, and the sound control model is an association model of the location information and the logic sequence;

[0052] S101, detecting the position of the target human body in real time and obtaining detection information;

[0053] S102, performing similarity calculation on the detection information and the position information according to the association model, and calling the associated logic sequence to control the power amplifier device.

[0054] In the disclosed embodiment, the position sample data is used as training data, and its collection scenario and hardware are consistent with the application scenario of the audio. The hardware for collecting the position sample data is a position detection device, and the use of the position detection device is performed according to the landing plan of the audio. By testing the changes in different positions of the human body, the required audio control logic is calibrated to achieve the corresponding control effect of the position sample data.

[0055] As one of the preferred embodiments, the position sample data includes continuous position information of a first period; the sound control logic includes continuous logic timing of a second period;

[0056] Among them, location information and logical timing are structured data.

[0057] The position information of the first time period, that is, the change of the human body position is collected continuously and exists in a time period, and the position information of the first time period is obtained. The audio control logic is a logical timing of continuous and existing time periods. For example, the first time period is 5s, and the second time period is 3s. In the application of audio, the position detection device detects the human body position for 5s continuously according to the calibration, and the obtained detection information can be converted into a continuous 3s control of the power amplifier device at the back end. The scheme of the present application is different from the traditional one that immediately generates a change in control logic when the human body position changes. It is more optimized in actual experience and avoids the bad experience caused by the abrupt control change. At the same time, according to the calibration of the first time period and the second time period, the formed audio control model can enrich the control means according to different needs and improve the flexibility of audio control based on human body position detection. Preferably, the first time period is greater than the second time period.

[0058] Among them, in the embodiment of the present application, the location information and the logical sequence are converted into structured data, which is convenient for establishing the association between the location information and the logical sequence, forming the basis of the association model. Preferably, text data is selected as the structured data, which is convenient for the subsequent call of the relevant language model to build the association model. At the same time, in the actual implementation plan, the application of the language model is more convenient and has advantages in hardware and software costs.

[0059] Based on this, Figure 2A flowchart of a method for building a correlation model based on an embodiment of the present invention is shown in FIG. Figure 2 As shown, the process of building the association model includes step S200 and step S201:

[0060] S200, splitting the location information to obtain information blocks;

[0061] S201, embed multiple logical time sequences into information blocks in a vector embedding manner to obtain an association model in the form of a vector library.

[0062] Figure 3 Build a schematic diagram for the association model, such as Figure 3 As shown, in order to solve the difference between the first time period and the second time period, the position information is split to obtain information blocks, and the logical timing is embedded in the information blocks in a vector embedding manner to form an association model in the form of a vector library. The disclosed embodiment innovatively introduces multiple parallel vector embedding methods to avoid the influence of a single logical timing embedding on the information block (position to vectorized encoding). At the same time, in the application of the association model, a scheme such as cosine similarity is selected to compare the detection information with the position information, and the position information is determined by the comparison, and the corresponding logical timing is called.

[0063] Preferably, reference Figure 3 ,After the detection information is collected, it is also vectorized in the same way as the ,location information. After it is converted into structured data, the ,association model is imported to calculate the similarity with the ,location information, and the matching logical sequence is called according to the ,most similar location information. Figure 4 FIG. 1 is a flow chart of a sound control method based on human position detection according to a preferred embodiment. Figure 4 As shown, in step S102, similarity calculation is performed on the detection information and the position information according to the association model, and the process of calling the associated logic sequence to control the power amplifier device includes step S1020 and step S1021:

[0064] S1020, calculating the cosine similarity between each detection information and the position information;

[0065] S1021, optimizing the cosine similarity according to the supervised vector scheme to determine the position information that best matches the detection information.

[0066] The process of calculating the cosine similarity between each detection information and the position information is as follows:

[0067]

[0068] Among them, A is the vector representation of detection information, B is the vector representation of position information, θ is the angle between A and B, ||A|| and ||B|| are the norms of vector A, ||B|| is the norm of vector B, and similarity represents cosine similarity.

[0069] In the association model, there are multiple position information, and the detection information is subjected to cosine similarity calculation with each position information, and the most similar position information is determined according to the cosine similarity, and the logic sequence corresponding to the most similar position information is called to perform audio control.

[0070] Preferably, in step S1021, the process of optimizing the cosine similarity according to the supervised vector scheme to determine the location information that best matches the detection information includes the steps of:

[0071] The CoSENT scheme is adopted to calculate the cosine similarity so that the association model focuses on improving the matching similarity score and reducing the mismatching similarity score, thereby obtaining the location information that best matches the detection information.

[0072] Using supervised vector solutions such as CoSENT, the accuracy of similarity tasks is improved by optimizing cosine similarity. According to actual tests of the sound control solution, the training process of CoSENT is more consistent with the prediction task because it directly optimizes cosine similarity instead of indirectly affecting similarity through classification tasks. Since the task of detecting information and location information in this application is more direct, the CoSENT solution is more effective. The CoSENT solution is as follows:

[0073]

[0074] Among them, Ω pos ,Ω neg is the set of all positive and negative sample pairs, that is, the set of correctly matched vector samples and the set of unmatched vector samples. λ is a hyperparameter, usually set to 20. The purpose of the loss function is to make the cosine similarity of any match greater than the cosine similarity of the unmatched in a batch, and through the calculation of cosine similarity, the association model is allowed to focus on improving the similarity score of the match and ensure that the similarity score of the unmatched is reduced.

[0075] At the same time, the CoSENT solution was selected to further improve the convenience of the implementation of the processor equipment. In actual deployment, the large language model was used to build and use the association model, and the application effect and cost of the solution were very good.

[0076] Preferably, in the embodiments of the present disclosure, Figure 4 As shown, the process of calculating the similarity between the detection information and the position information according to the association model in step S102 and calling the associated logic sequence to control the power amplifier device also includes step S1022:

[0077] S1022, constraining cosine similarity via a scoring scheme.

[0078] The grading scheme is as follows:

[0079]

[0080] Where D stands for information block, Q stands for query, and q i represents the structural unit in the query, f(q i ,D) is the number of structured units contained in the information block D; k 1 is an adjustable parameter, where k 1 =1.2-2.0, b is 0.0-1.0, len(D) is the length of the position information, and avg_len is the average length of each information block;

[0081]

[0082] From the IDF formula we can see that f(q i ,D) is larger, the larger the denominator is, the smaller the numerator is, that is, the smaller the IDF value is. Where N represents the number of similar information blocks in the information block D, that is, how many information blocks are there in total to calculate the cosine similarity with the detection information, and 0.5 is the smoothing factor, that is, the hyperparameter, used to prevent q i The situation where the denominator is 0 does not occur.

[0083] Among them, α·similarity+βBM25 is less than the set value, and α+β=1; similarity represents cosine similarity.

[0084] After the logic sequence of the call is determined, the related logic sequence can be used to control the power amplifier equipment, such as adjusting the parameters and switches of the audio.

[0085] The sound control method based on human position detection of the disclosed embodiment collects position sample data, calibrates the sound control logic according to the position sample data, and establishes a sound control model; wherein the sound control model is an association model of position information and logic timing. The position of the target human body is detected in real time to obtain detection information; the detection information and the position information are similarly calculated according to the association model, and the associated logic timing is called to control the power amplifier device. Through the pre-calibrated sound control logic, the logic timing is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect.

[0086] Any embodiment of the present disclosure also provides an audio control device based on human body position detection.

[0087] Figure 5 FIG. 1 is a block diagram of a sound control device based on human position detection according to a disclosed embodiment. Figure 5 As shown, including:

[0088] The model building module 100 is used to collect position sample data, calibrate the sound control logic according to the position sample data, and build the sound control model; wherein the position sample data includes position information, the sound control logic includes logic timing, and the sound control model is an association model of the position information and the logic timing;

[0089] The information acquisition module 101 is used to detect the position of the target human body in real time and obtain detection information;

[0090] The control execution module 102 is used to perform similarity calculation on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device.

[0091] The sound control device based on human position detection of the disclosed embodiment collects position sample data, calibrates the sound control logic according to the position sample data, and establishes a sound control model; wherein the sound control model is an association model of position information and logic timing. The position of the target human body is detected in real time to obtain detection information; the detection information and the position information are similarly calculated according to the association model, and the associated logic timing is called to control the power amplifier device. Through the pre-calibrated sound control logic, the logic timing is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect.

[0092] Any embodiment of the present disclosure also provides a speaker.

[0093] Figure 6 FIG. 1 is a schematic diagram of an acoustic structure of a disclosed embodiment. Figure 6 As shown, including:

[0094] Amplifier device 200;

[0095] The position detection device 201 is configured to detect the position of the target human body in real time and obtain detection information;

[0096] The position detection device 201 may use a distance measuring device, such as an infrared distance meter, etc., and the obtained detection information is structured and converted in the processor device 202 .

[0097] The processor device 202 stores the association model of any of the above embodiments, and is configured to perform similarity calculation on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device 200.

[0098] The audio device of the embodiment of the present application, as human body position detection hardware, is configured to detect the position of the target human body in real time and obtain detection information. The processor device stores the association model of any of the above embodiments, and is configured to perform similarity calculations on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device. Through the pre-calibrated audio control logic, the logic sequence is called according to the similarity calculation of the detection information and the position information, so that the control of the power amplifier device is closer to the ideal control effect.

[0099] There are a few points to note about this application:

[0100] (1) The drawings of the embodiments of the present application only relate to the structures related to the embodiments of the present application, and other structures may refer to the general design.

[0101] (2) For the sake of clarity, the thickness and size of layers or structures are exaggerated in the drawings used to describe the embodiments of the present invention. It is understood that when an element such as a layer, film, region, or substrate is referred to as being "on" or "under" another element, the element may be "directly" "on" or "under" the other element, or there may be intervening elements.

[0102] (3) In the absence of conflict, the embodiments of the present application and the features in the embodiments may be combined with each other to obtain new embodiments. The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. The protection scope of the present application shall be based on the protection scope of the claims.

[0103] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0104] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the patent application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent application shall be subject to the attached claims.

Claims

1. A sound control method based on human body position detection, characterized in that: Includes steps: Collecting position sample data, and calibrating the sound control logic according to the position sample data, and establishing a sound control model; wherein the position sample data includes position information, the sound control logic includes a logic sequence, and the sound control model is an association model of the position information and the logic sequence; Detect the position of the target body in real time and obtain detection information; The detection information and the location information are similarly calculated according to the association model, and the associated logic sequence is called to control the power amplifier device.

2. The sound control method based on human body position detection according to claim 1, characterized in that: The position sample data includes continuous position information of a first period; the sound control logic includes continuous logic timing of a second period; The location information and the logic sequence are structured data.

3. The sound control method based on human body position detection according to claim 2, characterized in that: The process of building the association model includes the following steps: Split the location information to obtain information blocks; A plurality of logic time sequences are embedded into the information block in a vector embedding manner to obtain an association model in a vector library form.

4. The sound control method based on human body position detection according to claim 3, characterized in that: The process of calculating the similarity between the detection information and the position information according to the association model and calling the associated logic sequence to control the power amplifier device includes the steps of: Calculate the cosine similarity between each detection information and the position information; The cosine similarity is optimized according to a supervised vector scheme to determine the position information that best matches the detection information.

5. The sound control method based on human body position detection according to claim 4, characterized in that: The process of calculating the cosine similarity between each detection information and the position information is as follows: Among them, A is the vector representation of detection information, B is the vector representation of position information, θ is the angle between A and B, ||A|| and ||B|| are the norms of vector A, ||B|| is the norm of vector B, and similarity represents cosine similarity.

6. The sound control method based on human body position detection according to claim 4, characterized in that: The process of optimizing the cosine similarity according to the supervised vector scheme to determine the location information that best matches the detection information comprises the steps of: The CoSENT scheme is adopted to calculate the cosine similarity so that the association model focuses on improving the matching similarity score and reducing the mismatching similarity score, thereby obtaining the location information that best matches the detection information.

7. The sound control method based on human body position detection according to claim 4, characterized in that: The process of calculating the similarity between the detection information and the position information according to the association model and calling the associated logic sequence to control the power amplifier device also includes the steps of: The cosine similarity is constrained by a scoring scheme.

8. The sound control method based on human body position detection according to claim 7, characterized in that: The scoring scheme is as follows: Where D stands for information block, Q stands for query, and q i represents the structural unit in the query, f(q i , D) is the number of structured units contained in the information block D; k1 is an adjustable parameter, where k1 = 1.2-2.0, b is 0.0-1.0, len(D) is the length of the position information, and avg_len is the average length of each information block; Among them, α·similarity+β·BM25 is less than the set value, and α+β=1; similarity represents cosine similarity.

9. An audio control device based on human body position detection, characterized in that: include: A model building module, used to collect position sample data, calibrate the sound control logic according to the position sample data, and build a sound control model; wherein the position sample data includes position information, the sound control logic includes a logic sequence, and the sound control model is an association model of the position information and the logic sequence; The information acquisition module is used to detect the position of the target human body in real time and obtain detection information; The control execution module is used to perform similarity calculation on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device.

10. A sound system, characterized in that: include: Amplifier equipment; A position detection device is configured to detect the position of a target human body in real time and obtain detection information; A processor device stores the association model as described in any one of claims 1 to 8, and is configured to perform similarity calculation on the detection information and the position information according to the association model, and call the associated logic sequence to control the power amplifier device.

Images