Air conditioner control method based on acoustic positioning, air conditioner system and storage medium

Abstract

The invention provides an air conditioner control method based on acoustic positioning, an air conditioner system and a storage medium, and the method comprises the steps that when an air conditioner awakening voice instruction of a target user is received, a first microphone determination mode is entered; after the first microphone determination mode is entered, the time difference value of the sound transmitted to the air conditioner, the first intelligent terminal and the second intelligent terminal is obtained; plane distances among the air conditioner, the first intelligent terminal and the second intelligent terminal are obtained; calculating coordinates of the target user according to the plane distance; determining distances from the air conditioner, the first intelligent terminal and the second intelligent terminal to the target user according to the coordinates of the target user; and taking a microphone corresponding to one of the air conditioner, the first intelligent terminal and the second intelligent terminal closest to the target user as a sound receiving device. By means of the air conditioner control method based on acoustic positioning, the accuracy of voice reception of the user can be effectively improved.

Description

Technical Field

[0001] This invention relates to the field of air conditioning technology, specifically to an air conditioning control method based on acoustic positioning, an air conditioning system using the acoustic positioning-based air conditioning control method, and a computer-readable storage medium using the acoustic positioning-based air conditioning control method. Background Technology

[0002] Artificial intelligence has developed rapidly in recent years, and high-performance terminal devices with voice capabilities have entered our lives in large numbers, such as voice boxes, voice air conditioners, and voice TVs. The accuracy of the sound reception of these devices is related to the distance between the user and the device, and there are also interference sources during the voice reception process. To address this, engineers have proposed various design solutions for user-device interaction experiences.

[0003] Taking smart voice-activated air conditioners as an example, in order to achieve higher accuracy in sound pickup, technicians generally need to consider factors such as air supply, air sweeping angle, and fan speed, and design an array containing two or more microphones to improve sound pickup accuracy. However, the microphone positions inside the air conditioner are fixed and cannot be flexibly adjusted, which increases the design cost of the voice-activated air conditioner. Moreover, this method fails to effectively utilize the collaborative work between various terminal devices, increases the number of microphones inside the air conditioner, and reduces the user experience.

[0004] In one existing sound pickup method, at least three voice receiving components located on different smart home devices detect voice signals from the same sound source, determine the time difference between at least two pairs of voice signals, determine the sound source's location based on the time difference and the location information of the voice receiving components, and determine the target pickup angle corresponding to the target voice receiving component based on the sound source's location information and the target voice receiving component's location information. When the target voice receiving component is at the target pickup angle, at least two microphones of the target voice receiving component are equidistant from the sound source. The target voice receiving component is rotated according to the target pickup angle so that it can pick up the sound source based on the target pickup angle. In this way, when the user is not speaking directly to the voice receiving component, the target voice receiving component can rotate to make each microphone in the target voice receiving component equidistant from the sound source, which can avoid the problem of large noise in the enhanced voice signal and improve the accuracy of speech recognition. However, this sound pickup method does not consider the relative position of the microphone and the user, as well as interference from factors such as wind noise and audio-visual equipment, which leads to a decrease in sound quality and has an inherent weakness in picking up human voice commands.

[0005] Therefore, a more optimized method for controlling the initial power-on frequency needs to be considered. Summary of the Invention

[0006] The first objective of this invention is to provide an air conditioning control method based on acoustic positioning that can effectively improve the accuracy of user voice reception.

[0007] The second objective of this invention is to provide an air conditioning system that can effectively improve the accuracy of user voice reception.

[0008] A third objective of this invention is to provide a computer-readable storage medium that can effectively improve the accuracy of user voice reception.

[0009] To achieve the aforementioned first objective, the air conditioning control method based on acoustic positioning provided by the present invention includes: upon receiving an air conditioning wake-up voice command from a target user, entering a first microphone determination mode; after entering the first microphone determination mode, acquiring the time difference between sound propagation to the air conditioner, the first smart terminal, and the second smart terminal; acquiring the planar distance between the air conditioner, the first smart terminal, and the second smart terminal; calculating the coordinates of the target user based on the planar distance; determining the distance between the air conditioner, the first smart terminal, and the second smart terminal and the target user based on the target user's coordinates; and using the microphone of the air conditioner, the first smart terminal, and the second smart terminal that is closest to the target user as the sound receiving device.

[0010] As can be seen from the above scheme, in the air conditioning control method based on acoustic positioning of the present invention, when the air conditioning wake-up voice command of the target user is received, the time difference between the sound propagation to the air conditioner, the first smart terminal, and the second smart terminal is obtained, and the planar distance between the air conditioner, the first smart terminal, and the second smart terminal is calculated. Based on the installation orientation and distance of each smart terminal, the sound receiving distance is detected and calculated to obtain the distance between the user and each smart terminal, and the smart terminal with the closest distance is selected. This intelligent and reasonable selection of the smart terminal for sound reception improves the accuracy of sound reception interaction between various devices.

[0011] In a further proposed solution, the steps for calculating the target user's coordinates based on planar distance include: establishing a coordinate system with the air conditioner as the origin, the line connecting the air conditioner and the first smart terminal forming the X-axis, and their perpendicular intersection forming the Y-axis; confirming the planar layout of the air conditioner, the first smart terminal, and the second smart terminal; and obtaining the corresponding set of equations based on the planar layout to calculate the target user's coordinates.

[0012] Therefore, when calculating the coordinates of the target user based on planar distance, the coordinates of the target user can be calculated using the corresponding set of equations based on the planar layout of the air conditioner, the first smart terminal, and the second smart terminal, thereby improving the accuracy and efficiency of the calculation.

[0013] In a further embodiment, the steps for confirming the planar layout of the air conditioner, the first smart terminal, and the second smart terminal include: obtaining the first connection line between the air conditioner and the first smart terminal, and obtaining the second connection line between the air conditioner and the second smart terminal; when the angle between the first connection line and the second connection line is greater than a preset angle value, confirming that the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset triangular planar layout; when the angle between the first connection line and the second connection line is less than or equal to the preset angle value, confirming that the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset straight-line planar layout.

[0014] Therefore, the planar layout of the air conditioner, the first smart terminal, and the second smart terminal can be determined by using the angle between the first and second connecting lines, so that the planar layout can be rationally obtained according to the actual environment.

[0015] In a further solution, the step of calculating the target user's coordinates based on the corresponding set of equations obtained from the planar layout includes: when the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset triangular planar layout, the target user's coordinates are calculated according to the following first set of equations: ; Where X and Y are the coordinates of the target user, The distance between the air conditioner and the first smart terminal. The speed of sound in air at room temperature. The time difference between the sound reaching the air conditioner and the first smart terminal. This is the time difference between the sound reaching the air conditioner and the second smart terminal. , The coordinates of the second smart terminal; , , The distance between the air conditioner and the second smart terminal. This refers to the distance between the first smart terminal and the second smart terminal.

[0016] In a further solution, the step of calculating the target user's coordinates based on the corresponding set of equations obtained from the planar layout also includes: when the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset linear planar layout, the target user's coordinates are calculated based on the following second set of equations: ; . In a further proposed solution, the distance between the air conditioner and the target user... Obtained from the following formula: The distance between the first smart terminal and the target user Obtained from the following formula: The distance between the second smart terminal and the target user Obtained from the following formula: .

[0017] In a further embodiment, the physical space where the air conditioner is located is divided into an air supply zone and a non-air supply zone, and a viewing area is determined. The viewing area is located in the air supply zone and / or the non-air supply zone, the air conditioner is located in the air supply zone, the first smart terminal is located in the viewing area, and the second smart terminal is located in the non-air supply zone. Before entering the first microphone determination mode, the method further includes: obtaining the film and television noise index of the viewing area; and confirming that the film and television noise index is less than or equal to a preset threshold.

[0018] Therefore, since the noise in the viewing area can affect the microphone's sound pickup, it is necessary to confirm that the noise index of the film and television is less than or equal to the preset threshold. At this time, the noise in the viewing area has a smaller impact on the microphone, and the first microphone determination mode can be entered.

[0019] In a further embodiment, after obtaining the film noise index of the viewing area, the method further includes: if the film noise index is greater than a preset threshold, then confirming the location of the target user; when the target user is in the air supply area, entering the second microphone determination mode; after entering the second microphone determination mode, determining whether the target user is in the viewing area; if so, using the microphone closest to the target user on the first smart terminal and the second smart terminal, and the microphone corresponding to the air conditioner, as the main receiving device, and the other corresponding microphone on the first smart terminal and the second smart terminal as the reference receiving device; if the target user is not in the viewing area, then using the microphone corresponding to the air conditioner as the main receiving device, and using the microphone closest to the target user on the first smart terminal and the second smart terminal as the reference receiving device.

[0020] Therefore, when the noise level of the movie theater exceeds the preset threshold, the noise in the viewing area significantly affects the microphone's sound pickup. In this case, it is necessary to select the appropriate microphone based on the user's location to improve detection accuracy. If the target user is in the air supply area, the user is already in the wind noise interference zone. Further determination is needed to determine if the user is in the viewing area. If the user is in the viewing area, meaning their location is affected by two interference zones, the microphone closest to the target user on both the first and second smart terminals, along with the microphone on the air conditioner, should be used as the primary sound pickup device. The other microphone on both terminals should be used as a reference sound pickup device to reduce interference. If the user is not in the viewing area, their location is affected by only one interference zone. In this case, the air conditioner's microphone should be used as the primary sound pickup device, while the microphone closest to the target user on both the first and second smart terminals should be used as the reference sound pickup device to save energy.

[0021] A further solution, after confirming the target user's location, includes: when the target user is in a non-air-supply area, entering a third microphone determination mode; after entering the third microphone determination mode, determining whether the target user is in the viewing area; if so, using the microphones of the air conditioner and the first smart terminal closest to the target user, and the microphone of the second smart terminal as the main recording device, and the other microphone of the air conditioner and the first smart terminal as the reference recording device; if the target user is not in the viewing area, using the microphone of the second smart terminal as the main recording device, and using the microphone of the air conditioner and the first smart terminal closest to the target user as the reference recording device.

[0022] Therefore, if the target user is in a non-air supply zone, meaning the user is far from the noise interference zone, then we further determine if the user is in the viewing area. If the user is in viewing area D2, meaning the user's location is affected by one and only one interference zone, then the microphones corresponding to the air conditioner and the first smart terminal closest to the target user, as well as the microphone corresponding to the second smart terminal, are used as the main recording devices. The other microphone from the air conditioner and the first smart terminal is used as the reference recording device to improve voice recognition accuracy. If the user is not in the viewing area, meaning the user's location is not affected by any interference zone, then the microphone corresponding to the second smart terminal is used as the main recording device, and the microphones corresponding to the air conditioner and the first smart terminal closest to the target user are used as the reference recording device to save energy.

[0023] In a further proposed solution, before obtaining the film noise index of the viewing area, the solution also includes: obtaining the location range of the air supply area, the non-air supply area, and the viewing area.

[0024] Therefore, by obtaining the location range of the air supply area, non-air supply area, and viewing area, it is easier to confirm the location of users later.

[0025] To achieve the second objective of the present invention, the present invention provides an air conditioning system including a processor and a memory, the memory storing a computer program, which, when executed by the processor, implements the steps of the above-described acoustic positioning-based air conditioning control method.

[0026] To achieve the third objective of the present invention, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a controller, implements the steps of the above-described acoustic positioning-based air conditioning control method. Attached Figure Description

[0027] Figure 1 This is a structural block diagram of an air conditioning system that applies the acoustic positioning-based air conditioning control method of this invention.

[0028] Figure 2 This is a schematic diagram of the partitioning of the air conditioner, the first smart terminal, and the second smart terminal in a preset triangular planar layout in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0029] Figure 3 This is a schematic diagram of the partitioning when the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset straight-line planar layout in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0030] Figure 4 This is a flowchart of an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0031] Figure 5 This is a flowchart of the process after entering the first microphone determination mode in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0032] Figure 6 This is a flowchart of the step of calculating the coordinates of the target user based on planar distance in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0033] Figure 7 This is a flowchart of the process after entering the second microphone determination mode in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0034] Figure 8 This is a flowchart of the process after entering the third microphone determination mode in an embodiment of the air conditioning control method based on acoustic positioning of the present invention.

[0035] The present invention will be further described below with reference to the accompanying drawings and embodiments. Detailed Implementation

[0036] Various exemplary embodiments of the invention will now be described in detail with reference to the accompanying drawings. The descriptions of the exemplary embodiments are merely illustrative and are in no way intended to limit the invention or its application or use. The invention can be embodied in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the invention thorough and complete, and to fully express the scope of the invention to those skilled in the art. It should be noted that, unless otherwise specifically stated, the relative arrangement of components and steps, the composition of materials, numerical expressions, and values ​​set forth in these embodiments should be interpreted as merely exemplary and not as limiting.

[0037] The terms "first," "second," and similar words used in this invention do not indicate any order, quantity, or importance, but are merely used to distinguish different parts. Words such as "including" or "comprising" mean that the element preceding the word encompasses the element listed after it, without excluding the possibility of encompassing other elements. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0038] In this invention, when a specific device is described as being located between a first device and a second device, an intermediary device may or may not be present between the specific device and the first or second device. When a specific device is described as being connected to other devices, the specific device may be directly connected to the other devices without an intermediary device, or it may be not directly connected to the other devices but have an intermediary device.

[0039] All terms used in this invention (including technical or scientific terms) have the same meaning as understood by one of ordinary skill in the art, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or highly formalized meaning, unless expressly defined herein.

[0040] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0041] Example of an air conditioning control method based on acoustic localization: The acoustic positioning-based air conditioning control method of the present invention is an application program used in an air conditioning system to select and use microphones within the system. In this embodiment, see... Figure 1 The air conditioning system includes an air conditioner 1, a first smart terminal 2, and a second smart terminal 3. The air conditioner 1, the first smart terminal 2, and the second smart terminal 3 are interconnected. Each of these components is equipped with a microphone (not shown), which can transmit the voice signals collected by the microphones to the air conditioner for processing. The device types of the first smart terminal 2 and the second smart terminal 3 can be configured according to user needs; for example, the first smart terminal 2 could be a smart TV, and the second smart terminal 3 could be a voice box.

[0042] See Figure 2 and Figure 3In this embodiment, the physical space where the air conditioner 1 is located is divided into an air supply zone D1 and a non-air supply zone D3, and a movie viewing zone D2 is identified. The movie viewing zone D2 is located in the air supply zone D1 and / or the non-air supply zone D3. The air conditioner 1 is located in the air supply zone D1, the first smart terminal 2 is located in the movie viewing zone D2, and the second smart terminal 3 is located in the non-air supply zone D3.

[0043] like Figure 4 As shown, in this embodiment, the air conditioning control method based on acoustic positioning first executes step S1 to determine whether a wake-up voice command from the target user 4 has been received. The wake-up voice command can be set by the program developer or customized by the user. The wake-up voice command includes preset words; for example, if the user says the word "air conditioning system," it is considered that the wake-up voice command has been received. The wake-up voice command is simultaneously acquired by the air conditioner 1, the first smart terminal 2, and the second smart terminal 3.

[0044] If no voice command to wake up the air conditioner is received from target user 4, continue with step S1 for continuous detection. Upon receiving the voice command, proceed to step S2 to obtain the video noise index of the viewing area D2. The video noise index of the viewing area D2 can be obtained through the microphone of the first smart terminal 2. Since the noise in the viewing area D2 affects microphone reception, obtaining the video noise index is used to further confirm the appropriate method for microphone selection. While obtaining the video noise index of the viewing area D2, audio data of the space where the air conditioner is located can be collected, and key frequency bands can be extracted according to the frequency range. Video noise index = E_video / E_total, where E_video is the energy value of the video noise frequency band, and E_total is the energy value of the entire frequency band. The video noise frequency band is 500-2000Hz, and the entire frequency band is 0-8000Hz.

[0045] After obtaining the film noise index of viewing area D2, step S3 is executed to determine whether the film noise index is less than or equal to a preset threshold. The preset threshold can be preset based on experimental data, for example, the preset threshold is 0.6 to 0.7, and the preferred preset threshold is 0.65.

[0046] If the video noise index is confirmed to be less than or equal to a preset threshold, then step S4 is executed to enter the first microphone determination mode. When the video noise index is less than or equal to the preset threshold, the noise in the viewing area D2 has a relatively small impact on the microphone, and the first microphone determination mode can be entered.

[0047] In this embodiment, see Figure 5After entering the first microphone determination mode, step S11 is executed first to obtain the time difference between the sound propagating to air conditioner 1, first smart terminal 2, and second smart terminal 3. There is a time difference when the voice signal emitted by the user propagates to any two microphones. For example, the microphones of air conditioner 1 and first smart terminal 2 receive the same audio signal with a relative delay. Assuming that the time when the sound arrives at air conditioner 1 first is defined as the starting point and the time when it arrives at first smart terminal 2 is defined as the ending point, this time period is the time difference.

[0048] After obtaining the time difference between the sound propagation to air conditioner 1, first smart terminal 2, and second smart terminal 3, step S12 is executed to obtain the planar distance between air conditioner 1, first smart terminal 2, and second smart terminal 3. The planar distance between air conditioner 1, first smart terminal 2, and second smart terminal 3 is preset through detection settings. For example, any one of the voice terminals in air conditioner 1, first smart terminal 2, and second smart terminal 3 emits a recognition sound wave, which is received by the other devices. The straight-line distance between them can be measured by combining the arrival time of the sound wave signal. In this embodiment, microphones A, B, and C corresponding to air conditioner 1, first smart terminal 2, and second smart terminal 3 are connected by lines. The planar distance between air conditioner 1 and first smart terminal 2 is L1, the planar distance between first smart terminal 2 and second smart terminal 3 is L2, and the planar distance between air conditioner 1 and second smart terminal 3 is L3.

[0049] After obtaining the time difference and planar distance, step S13 is executed to calculate the coordinates of the target user 4 based on the time difference and planar distance.

[0050] In this embodiment, see Figure 6 When calculating the coordinates of target user 4 based on the time difference and planar distance, step S21 is executed first to establish a coordinate system with air conditioner 1 as the origin. The line connecting air conditioner 1 and the first smart terminal 2 forms the X-axis, and their perpendicular intersection line forms the Y-axis. When establishing the coordinate system, microphone A of air conditioner 1 is used as the origin, and the line connecting microphone A of air conditioner 1 and microphone B of the first smart terminal 2 forms the X-axis.

[0051] After establishing a coordinate system with air conditioner 1 as the origin, step S22 is executed to confirm the planar layout of air conditioner 1, first smart terminal 2 and second smart terminal 3.

[0052] In this embodiment, the step of confirming the planar layout of air conditioner 1, first smart terminal 2, and second smart terminal 3 includes: obtaining a first line connecting air conditioner 1 and first smart terminal 2, and obtaining a second line connecting air conditioner 1 and second smart terminal 3; when the angle between the first and second lines is greater than a preset angle value, confirming that air conditioner 1, first smart terminal 2, and second smart terminal 3 form a preset triangular planar layout; when the angle between the first and second lines is less than or equal to the preset angle value, confirming that air conditioner 1, first smart terminal 2, and second smart terminal 3 form a preset straight-line planar layout. The preset angle value can be preset based on experimental data, for example, a preset angle value of 30°. Using the angle between the first and second lines to confirm the planar layout of air conditioner 1, first smart terminal 2, and second smart terminal 3 allows for a rationally obtained planar layout based on the actual environment. A preset triangular planar layout is as follows: Figure 2 As shown, the preset linear floor plan layout is as follows: Figure 3 As shown.

[0053] After confirming the planar layout of air conditioner 1, first smart terminal 2, and second smart terminal 3, step S23 is executed to obtain the corresponding set of equations based on the planar layout and calculate the coordinates of target user 4. When calculating the coordinates of target user 4 based on planar distance, the coordinates of target user 4 are calculated using the corresponding set of equations based on the planar layout of air conditioner 1, first smart terminal 2, and second smart terminal 3, thereby improving the accuracy and efficiency of the calculation.

[0054] In this embodiment, the step of obtaining the corresponding set of equations based on the planar layout to calculate the coordinates of the target user 4 includes: when the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 are arranged in a preset triangular planar layout, the coordinates of the target user 4 are calculated according to the following first set of equations: ; Where X and Y are the coordinates of target user 4. The distance between air conditioner 1 and the first smart terminal 2. The speed of sound in air at room temperature (20℃) The time difference between the sound reaching air conditioner 1 and the first smart terminal 2. This is the time difference between the sound reaching air conditioner 1 and the second smart terminal 3. , The coordinates of the second smart terminal 3; , , The distance between air conditioner 1 and the second smart terminal 3. The distance between the first smart terminal 2 and the second smart terminal 3.

[0055] When the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 are arranged in a preset triangular plane, the coordinates of the first smart terminal 2 are: B = (dAB, 0), and the coordinates of the second smart terminal 3 are: C = ( , ),at this time ≠0. Secondly, assuming the target user 4's coordinates are (X, Y), the measured time difference... and The distance between target user 4 and microphone A is The distance between target user 4 and microphone B is The distance between target user 4 and microphone C is Then we can obtain the following system of equations: ; ; ; ; The above system of equations can be simplified to obtain the first system of equations. Substituting the known parameters into the first system of equations: =L1; =L3; =L2, which can be used to solve for the coordinates X and Y of the target user 4.

[0056] In this embodiment, the step of obtaining the corresponding set of equations based on the planar layout to calculate the coordinates of the target user 4 further includes: when the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 are arranged in a preset straight-line planar layout, the coordinates of the target user 4 are calculated according to the following second set of equations: ; Where X and Y are the coordinates of target user 4. The distance between air conditioner 1 and the first smart terminal 2. The time difference between the sound reaching air conditioner 1 and the first smart terminal 2. This is the time difference between the sound reaching air conditioner 1 and the second smart terminal 3. Let X be the X-axis coordinate of the second smart terminal 3.

[0057] When air conditioner 1, first smart terminal 2, and second smart terminal 3 are arranged in a preset straight-line planar layout, the coordinates of first smart terminal 2 are: B = ( The coordinates of the second smart terminal 3 are C=( , 0), ,0). Secondly, assuming the target user 4 is located at coordinates (X, Y), the time difference is measured. and Let dA be the distance between target user 4 and microphone A, dB be the distance between target user 4 and microphone B, and dC be the distance between target user 4 and microphone C. Then, the following system of equations can be derived: ; ; ; ; The above system of equations can be simplified to obtain the second system of equations. Substituting the known parameters into the second system of equations: =L1, =L1+L2=L3= The coordinates X and Y of the target user 4 can be obtained by solving this problem.

[0058] After obtaining the coordinates of the target user 4, step S14 is executed to determine the distances between the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 and the target user 4 based on the coordinates of the target user 4. In this embodiment, the distance dA between the air conditioner 1 and the target user 4 is obtained by the following formula: The distance dB between the first smart terminal 2 and the target user 4 is obtained by the following formula: The distance dC between the second smart terminal 3 and the target user 4 is obtained by the following formula: .

[0059] After obtaining the distances between the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 and the target user 4, step S15 is executed, selecting the microphone from the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 that is closest to the target user 4 as the sound receiving device. By using the microphone closest to the target user 4 as the sound receiving device, the sound reception effect can be improved.

[0060] In this embodiment, if the video noise index is greater than a preset threshold when performing step S3, then step S5 is performed to confirm the location of the target user 4. When the video noise index is greater than the preset threshold, the noise in the viewing area D2 has a significant impact on the microphone's sound pickup. At this time, it is necessary to select a microphone based on the user's location to improve detection accuracy. The location of the target user 4 can be determined using the method in the first microphone determination mode, which will not be elaborated here.

[0061] After confirming the location of target user 4, proceed to step S6 to determine whether target user 4 is in the air supply zone D1. Air supply zone D1 is the area where the user experiences the strongest airflow corresponding to air conditioner 1, and also the area with the strongest wind noise; this is the wind noise interference zone, located directly in front of the air outlet of air conditioner 1. Non-air supply zone D3 refers to the area other than air supply zone D1; the two zones have no overlap under any circumstances. Therefore, when target user 4 is in air supply zone D1 or non-air supply zone D3, different microphone detection modes need to be used to improve accuracy.

[0062] When the target user 4 is in the air supply zone D1, step S7 is executed to enter the second microphone confirmation mode.

[0063] In this embodiment, see Figure 7 After entering the second microphone confirmation mode, step S31 is executed first to determine whether the target user 4 is in the viewing area D2. The viewing area D2 is in the area affected by film and television noise. Therefore, if the target user 4 is in the air supply area D1, the user is already in the wind noise interference area, and it is necessary to further determine whether the user is in the viewing area D2.

[0064] If the target user 4 is in viewing area D2, then step S32 is executed. The microphones of the first smart terminal 2 and the second smart terminal 3 closest to the target user 4, along with the microphone corresponding to the air conditioner 1, are used as the main receiving devices. The other microphone in the first smart terminal 2 and the second smart terminal 3 is used as a reference receiving device. Since the user is in viewing area D2, meaning the user's location is affected by two interference zones, using the microphones of the first smart terminal 2 and the second smart terminal 3 closest to the target user 4, along with the microphone corresponding to the air conditioner 1, as the main receiving devices, and the other microphone in the first smart terminal 2 and the second smart terminal 3 as a reference receiving device, reduces interference.

[0065] If the target user 4 is not in the viewing area D2, then step S32 is executed: the microphone corresponding to the air conditioner 1 is used as the main receiving device, and the microphone of the first smart terminal 2 and the second smart terminal 3 that is closest to the target user 4 is used as the reference receiving device. Since the user is not in the viewing area D2, the user's location is affected by only one interference zone. In this case, the microphone of the air conditioner 1 is used as the main receiving device, while the microphone of the first smart terminal 2 and the second smart terminal 3 that is closest to the target user 4 is used as the reference receiving device, thus saving energy.

[0066] When performing step S6, if the target user 4 is not in the air supply zone D1, it is assumed that the target user 4 is in the non-air supply zone D3. At this time, step S8 is performed to enter the third microphone confirmation mode.

[0067] In this embodiment, see Figure 8 After entering the third microphone confirmation mode, step S41 is executed first to determine whether the target user 4 is in the viewing area D2. If the target user 4 is in the non-airflow area D3, it means that the user is far away from the wind noise interference area. At this time, it is further determined whether the user is in the viewing area D2.

[0068] If the target user 4 is in the viewing area D2, then step S42 is executed, using the microphones of the air conditioner 1 and the first smart terminal 2 closest to the target user 4, and the microphone of the second smart terminal 3, as the main receiving devices, and the other microphone of the air conditioner 1 and the first smart terminal 2 as the reference receiving device. Since the user is in the viewing area D2, meaning the user's location is affected by one and only one interference zone, the microphones of the air conditioner 1 and the first smart terminal 2 closest to the target user 4, and the microphone of the second smart terminal 3, are used as the main receiving devices, and the other microphone of the air conditioner 1 and the first smart terminal 2 is used as the reference receiving device to improve speech recognition accuracy.

[0069] If the target user 4 is not in the viewing area D2, then step S43 is executed: the microphone corresponding to the second smart terminal 3 is used as the main receiving device, and the microphones of the air conditioner 1 and the first smart terminal 2 that are closest to the target user 4 are used as reference receiving devices. Since the user is not in the viewing area D2, meaning the user's location is not affected by any interference zone, using the microphone corresponding to the second smart terminal 3 as the main receiving device and the microphones of the air conditioner 1 and the first smart terminal 2 that are closest to the target user 4 as the reference receiving device saves energy.

[0070] In subsequent speech recognition, the speech information acquired by the main and reference recording devices can be analyzed using a large language model. Only when the speech information acquired by the main and reference recording devices is consistent will the corresponding command be executed, thereby improving the accuracy of speech recording.

[0071] The location ranges of the air supply zone D1, the non-air supply zone D3, and the viewing zone D2 can be preset or automatically identified.

[0072] In an optional embodiment, before performing step S2 to obtain the film noise index of the viewing area D2, the following steps are also performed: obtaining the location ranges of the air supply area D1, the non-air supply area D3, and the viewing area D2. Obtaining the location ranges of the air supply area D1, the non-air supply area D3, and the viewing area D2 facilitates subsequent user location confirmation. For example, the location ranges of the air supply area D1, the non-air supply area D3, and the viewing area D2 can be determined according to the following table:

[0073] As described above, in the air conditioning control method based on acoustic positioning of the present invention, when the air conditioning wake-up voice command of the target user 4 is received, the time difference between the sound propagation to the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 is obtained, and the planar distance between the air conditioner 1, the first smart terminal 2, and the second smart terminal 3 is calculated. Based on the installation orientation and distance of each smart terminal, the sound receiving distance is detected and calculated to obtain the distance between the user and each smart terminal, and the smart terminal with the closest distance is selected. This intelligent and reasonable selection of the smart terminal for sound reception improves the accuracy of sound reception interaction between the various devices.

[0074] Air conditioning system example: The air conditioning system in this embodiment includes a controller, which executes the steps in the above-described embodiment of the air conditioning control method based on acoustic positioning when executing a computer program.

[0075] For example, a computer program can be divided into one or more modules, one or more of which are stored in memory and executed by a controller to perform the present invention. One or more modules can be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the air conditioning system.

[0076] An air conditioning system may include, but is not limited to, a controller and a memory. Those skilled in the art will understand that an air conditioning system may include more or fewer components, or a combination of certain components, or different components; for example, an air conditioning system may also include input / output devices, network access devices, buses, etc.

[0077] For example, a controller can be a Central Processing Unit (CPU), or other general-purpose controllers, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose controller can be a microcontroller or any conventional controller. The controller is the control center of the air conditioning system, connecting all parts of the system via various interfaces and lines.

[0078] The memory can be used to store computer programs and / or modules. The controller implements various functions of the air conditioning system by running or executing the computer programs and / or modules stored in the memory, and by calling the data stored in the memory. For example, the memory may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound receiving function, sound-to-text function, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, text data, etc.). In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, RAM, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0079] Examples of computer-readable storage media: If the modules integrated into the air conditioning system in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the above embodiments of the acoustic positioning-based air conditioning control method can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by the controller, it can implement the steps of the above embodiments of the acoustic positioning-based air conditioning control method. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The storage medium can include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0080] It should be noted that the above are only preferred embodiments of the present invention, but the design concept of the invention is not limited thereto. Any non-substantial modifications made to the present invention using this concept also fall within the protection scope of the present invention.

Claims

1. An air conditioning control method based on acoustic positioning, applied to an air conditioning system, the air conditioning system including an air conditioner, a first intelligent terminal, and a second intelligent terminal, wherein the air conditioner, the first intelligent terminal, and the second intelligent terminal are interconnected, and each of the air conditioner, the first intelligent terminal, and the second intelligent terminal is equipped with a microphone; characterized in that: The method includes: Upon receiving a voice command from the target user to wake up the air conditioner, the system enters the first microphone confirmation mode. After entering the first microphone determination mode, the time difference between the sound propagating to the air conditioner, the first smart terminal, and the second smart terminal is obtained; Obtain the planar distance between the air conditioner, the first smart terminal, and the second smart terminal; The coordinates of the target user are calculated based on the time difference and the planar distance. The distances between the air conditioner, the first smart terminal, and the second smart terminal and the target user are determined based on the target user's coordinates. The microphone of the air conditioner, the first smart terminal, and the second smart terminal that is closest to the target user is used as the sound receiving device.

2. The air conditioning control method based on acoustic positioning according to claim 1, characterized in that: The step of calculating the coordinates of the target user based on the time difference and the planar distance includes: Establish a coordinate system with the air conditioner as the origin, the line connecting the air conditioner and the first smart terminal forms the X-axis, and their perpendicular intersection line forms the Y-axis; Confirm the planar layout of the air conditioner, the first smart terminal, and the second smart terminal; The coordinates of the target user are calculated based on the corresponding set of equations obtained from the planar layout.

3. The air conditioning control method based on acoustic positioning according to claim 2, characterized in that: The steps for confirming the planar layout of the air conditioner, the first smart terminal, and the second smart terminal include: Obtain the first connection between the air conditioner and the first smart terminal, and obtain the second connection between the air conditioner and the second smart terminal; When the angle between the first connecting line and the second connecting line is greater than a preset angle value, it is confirmed that the air conditioner, the first smart terminal and the second smart terminal are arranged in a preset triangular plane. When the angle between the first connecting line and the second connecting line is less than or equal to a preset angle value, it is confirmed that the air conditioner, the first smart terminal and the second smart terminal are arranged in a preset straight-line planar layout.

4. The air conditioning control method based on acoustic positioning according to claim 2, characterized in that: The steps for calculating the coordinates of the target user based on the corresponding system of equations obtained from the planar layout include: When the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset triangular planar layout, the coordinates of the target user are calculated according to the following first set of equations: ； ； Where X and Y are the coordinates of the target user. The distance between the air conditioner and the first smart terminal. The speed of sound in air at room temperature. The time difference between the sound reaching the air conditioner and the first smart terminal. The time difference between the sound reaching the air conditioner and the second smart terminal. , The coordinates of the second smart terminal; , , The distance between the air conditioner and the second smart terminal. The distance between the first smart terminal and the second smart terminal is denoted as .

5. The air conditioning control method based on acoustic positioning according to claim 4, characterized in that: The step of obtaining the corresponding system of equations based on the planar layout and calculating the coordinates of the target user further includes: When the air conditioner, the first smart terminal, and the second smart terminal are arranged in a preset linear planar layout, the coordinates of the target user are calculated according to the following second set of equations: ； 。 6. The air conditioning control method based on acoustic positioning according to claim 5, characterized in that: The distance between the air conditioner and the target user Obtained from the following formula: ; The distance between the first smart terminal and the target user Obtained from the following formula: ; The distance between the second smart terminal and the target user Obtained from the following formula: .

7. The air conditioning control method based on acoustic positioning according to any one of claims 1 to 6, characterized in that: The physical space where the air conditioner is located is divided into an air supply zone and a non-air supply zone, and a movie viewing area is determined. The movie viewing area is located in the air supply zone and / or the non-air supply zone. The air conditioner is located in the air supply zone, the first smart terminal is located in the movie viewing area, and the second smart terminal is located in the non-air supply zone. Before entering the first microphone confirmation mode, the following steps are also included: Obtain the film noise index of the viewing area; Confirm that the video noise index is less than or equal to a preset threshold.

8. The air conditioning control method based on acoustic positioning according to claim 7, characterized in that: After obtaining the film noise index of the viewing area, the method further includes: If the video noise index is greater than a preset threshold, then the location of the target user is confirmed. When the target user is in the air supply area, the system enters the second microphone confirmation mode. After entering the second microphone determination mode, it is determined whether the target user is in the movie viewing area. If so, the microphone of the first smart terminal and the second smart terminal that is closest to the target user and the microphone of the air conditioner are used as the main sound receiving device, and the other microphone of the first smart terminal and the second smart terminal are used as the reference sound receiving device. If the target user is not in the viewing area, the microphone corresponding to the air conditioner will be used as the main recording device, and the microphone of the first smart terminal and the second smart terminal that is closest to the target user will be used as the reference recording device.

9. The air conditioning control method based on acoustic positioning according to claim 8, characterized in that: After confirming the location of the target user, the method further includes: When the target user is in the non-air supply zone, the third microphone confirmation mode is entered. After entering the third microphone determination mode, it is determined whether the target user is in the movie viewing area. If so, the microphones of the air conditioner and the first smart terminal that are closest to the target user and the microphones of the second smart terminal are used as the main sound receiving device, and the other microphone of the air conditioner and the first smart terminal is used as the reference sound receiving device. If the target user is not in the viewing area, the microphone corresponding to the second smart terminal will be used as the main recording device, and the microphone of the air conditioner and the first smart terminal that is closest to the target user will be used as the reference recording device.

10. The air conditioning control method based on acoustic positioning according to claim 7, characterized in that: Before obtaining the film noise index of the viewing area, the method further includes: Obtain the location range of the air supply area, the non-air supply area, and the viewing area.

11. An air conditioning system, comprising a processor and a memory, characterized in that: The memory stores a computer program that, when executed by the processor, implements the steps of the acoustic positioning-based air conditioning control method as described in any one of claims 1 to 10.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the controller, it implements the steps of the air conditioning control method based on acoustic positioning as described in any one of claims 1 to 10.

Images