Radar-based voice interaction assistance method and apparatus, and air conditioner

Abstract

The application provides a radar-based voice interaction auxiliary method, device and air conditioner, the method comprises the following steps: after determining that the voice interaction mode is activated, the contour information collected by the radar module on the indoor individual is used to determine the first position information and the second position information of each individual; the first swing interval is determined according to the first position information, and the second swing interval is determined according to the second position information; the air speed is adjusted to the mute gear, the vertical swing leaf assembly is controlled to swing left and right in the first swing interval, and the horizontal swing leaf assembly is controlled to swing up and down in the second swing interval; if the voice control signal is collected by the voice collection module within the preset time, the air conditioner is controlled according to the control intention corresponding to the voice control signal. The radar-based voice interaction auxiliary method, device and air conditioner provided by the application minimize the influence of the air conditioner on the sound source wave during voice interaction, and improve the sensing accuracy of voice interaction.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of air conditioners, and in particular to a radar-based voice interaction auxiliary method and device and an air conditioner. BACKGROUND

[0002] With the rapid development of the field of artificial intelligence and the increasing demand for intelligent monitoring, smart home and new human-computer interaction, voice interaction is increasingly applied to household appliances, such as voice air conditioners.

[0003] When a user transmits a corresponding voice control instruction to a voice air conditioner (or voice intelligent device) through vocal cord vibration, since speed is a vector and can be superimposed, if the direction of sound wave propagation speed and the direction of wind speed are the same, the sound speed becomes large, which is conducive to the voice air conditioner receiving sound signals, and conversely, the sound speed becomes small, which is not conducive to the voice air conditioner receiving sound signals. Therefore, during voice interaction, the air conditioner wind directly blows on the human face, which greatly interferes with the sound source wave, resulting in a decrease in the sensing accuracy of voice interaction. SUMMARY

[0004] The present application provides a radar-based voice interaction auxiliary method and device and an air conditioner to solve the defect that the air conditioner wind in front of the user when issuing a voice instruction interferes with sound propagation in the prior art.

[0005] The present application provides a radar-based voice interaction auxiliary method, comprising:

[0006] After determining that the voice interaction mode is activated, the profile information collected by the radar module for each individual in the room is used to determine the first position information and the second position information of each individual;

[0007] The first swing interval is determined according to the first position information, and the second swing interval is determined according to the second position information;

[0008] After adjusting the wind speed to the mute gear and controlling the vertical swing leaf assembly to swing left and right in the first swing interval and the horizontal swing leaf assembly to swing up and down in the second swing interval, if a voice control signal is collected by the voice collection module within a predetermined time, the air conditioner is controlled in response to the control intent corresponding to the voice control signal;

[0009] The voice semantics contained in the voice control signal correspond to the control intent of any individual on the air conditioner. Figure One The first position information is determined according to the coordinate points of the individual's torso profile in the radar coordinate system; and the second position information is determined according to the coordinate points of the individual's head profile in the radar coordinate system.

[0010] According to the radar-based voice interaction auxiliary method provided in the application, after determining that the voice interaction mode is activated, the contour information of each individual collected by the radar module is used to determine the first position information and the second position information of each individual, including:

[0011] In the case where the voice signal collected by the voice collection module is a voice wake-up signal, the contour coordinate point set perceived by the radar module for each individual in the radar coordinate system is received.

[0012] The contour coordinate point set is analyzed, the obtained trunk centroid coordinate is set as the first position information, and the obtained head centroid coordinate is set as the second position information.

[0013] The voice wake-up signal contains at least one preset wake-up word.

[0014] According to the radar-based voice interaction auxiliary method provided in the application, the first swing range is determined according to the first position information, including:

[0015] The right direction of the radar module in the horizontal direction is taken as the positive direction of the X-axis in the radar coordinate system, and if the X-axis coordinate value of the first position information is greater than 0, the right boundary of the rated swing range of the vertical swing blade assembly is updated to the execution angle corresponding to the first position information, and the first swing range is generated.

[0016] If the X-axis coordinate value of the first position information is less than 0, the left boundary of the rated swing range of the vertical swing blade assembly is updated to the execution angle corresponding to the first position information, and the first swing range is generated.

[0017] According to the radar-based voice interaction auxiliary method provided in the application, the second swing range is determined according to the second position information, including:

[0018] If it is determined that the current working mode is the refrigeration mode, the upper boundary of the rated swing range of the horizontal swing blade assembly is updated to the first execution angle, and the second swing range is generated.

[0019] If it is determined that the current working mode is the heating mode, the lower boundary of the rated swing range of the horizontal swing blade assembly is updated to the second execution angle, and the second swing range is generated.

[0020] The first execution angle is smaller than the included angle formed by the second position information relative to the Z-axis in the radar coordinate system, and the second execution angle is greater than the included angle formed by the second position information relative to the Z-axis in the radar coordinate system.

[0021] According to the radar-based voice interaction auxiliary method provided by the application, the wind speed is adjusted to a mute gear, and the vertical swing leaf assembly is controlled to swing left and right in the first swing wind interval, and the horizontal swing leaf assembly is controlled to swing up and down in the second swing wind interval.

[0022] If it is determined that the voice collection module has not collected a voice control signal continuously within a preset time length, the voice interaction mode is closed, and the air conditioner is controlled to return to the air supply mode before the voice interaction mode was activated.

[0023] The application further provides a radar-based voice interaction auxiliary device, comprising:

[0024] The voice interaction activation module is configured to determine first position information and second position information of each individual based on profile information of the individuals collected by the radar module after determining that the voice interaction mode is activated.

[0025] The voice collection auxiliary module is configured to determine a first swing wind interval based on the first position information and a second swing wind interval based on the second position information.

[0026] The voice interaction control module is configured to adjust the wind speed to a mute gear, control the vertical swing leaf assembly to swing left and right in the first swing wind interval, and control the horizontal swing leaf assembly to swing up and down in the second swing wind interval, and if a voice control signal is collected by the voice collection module within a preset time length, control the air conditioner according to a control intention corresponding to the voice control signal.

[0027] The voice control signal contains voice semantics corresponding to a control intention of any individual on the air conditioner. Figure One The first position information is determined based on a coordinate point of a torso profile of the individual in a radar coordinate system. The second position information is determined based on a coordinate point of a head profile of the individual in the radar coordinate system.

[0028] The application further provides an air conditioner, comprising an indoor unit and an outdoor unit, wherein the indoor unit is provided with a control processor, a voice collection module, and a radar module, the radar module is arranged on a surface of a shell of the indoor unit, and further comprising a memory and a program or instructions stored on the memory and executable on the control processor, the program or instructions are executed by the control processor to perform the radar-based voice interaction auxiliary method according to any one of the above.

[0029] The radar module comprises a millimeter wave radar.

[0030] According to the air conditioner provided by the application, the voice collection module is arranged in the indoor unit and / or a control terminal of the indoor unit.

[0031] The application further provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the radar-based voice interaction assistance method according to any one of the above.

[0032] The application further provides a computer program product comprising a computer program which, when executed by a processor, implements the radar-based voice interaction assistance method according to any one of the above.

[0033] The radar-based voice interaction assistance method, device and air conditioner provided by the application can immediately obtain first position information and second position information of the distribution of the individual contour in the horizontal dimension and the vertical dimension through the radar module after the voice interaction mode is activated, and on the basis of maintaining the wind speed at the mute gear within a preset time length, the control swing leaf is used to perform free swing in the first swing wind range and the second swing wind range respectively confirmed according to the position information, and when the voice control signal is listened to by the voice acquisition module in this process, the corresponding voice interaction is decided to be executed. The air conditioner is pre-avoided from the human body in the horizontal and vertical dimensions in the initialization stage of the voice interaction to realize minimum wind speed, the influence of the air conditioner wind on the sound source wave in the voice interaction is reduced to the minimum, the voice control signal can be quickly received by the air conditioner, and the sensing accuracy of the voice interaction is improved. BRIEF DESCRIPTION OF DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are some embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0035] Figure 1 is one of the flowcharts of the radar-based voice interaction assistance method provided by the application;

[0036] Figure 2 is the second flowchart of the radar-based voice interaction assistance method provided by the application;

[0037] Figure 3 is the structural schematic diagram of the radar-based voice interaction assistance device provided by the application;

[0038] Figure 4 is the structural schematic diagram of the air conditioner provided by the application. DETAILED DESCRIPTION

[0039] In order to make the objects, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be described clearly and completely below in conjunction with the drawings in the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work belong to the protection scope of the present application.

[0040] The terms "first", "second", and the like in the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually a class and do not limit the number of objects, for example, the first object can be one or more.

[0041] It should be understood that the terms used in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the present application, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0042] The terms "include" and "contain" indicate the presence of the described features, whole, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, whole, steps, operations, elements, components and / or sets thereof.

[0043] Figure 1 is one of the flow diagrams of the radar-based voice interaction assistance method provided by the present application. As shown in Figure 1 The radar-based voice interaction assistance method provided by the embodiment of the present application comprises the following steps: after determining that the voice interaction mode is activated, the contour information collected by the radar module for each individual in the room is used to determine the first position information and the second position information of each individual.

[0044] The first position information is determined according to the coordinate point of the torso contour of the individual in the radar coordinate system. The second position information is determined according to the coordinate point of the head contour of the individual in the radar coordinate system.

[0045] It should be noted that the execution subject of the radar-based voice interaction assistance method provided by the embodiment of the present application is a radar-based voice interaction assistance device.

[0046] The application scenario of the radar-based voice interaction auxiliary method provided by the embodiment of the application is that, after a user starts an air conditioner and activates a voice interaction mode, the human body distribution range of an individual in a three-dimensional space in a room is sensed by a radar module, so that the air conditioner is maintained in a stage of avoiding air supply to the human body for a period of time before the individual issues a formal voice control instruction, and the voice control signal issued by the user in the stage is responded to.

[0047] The voice collection module is in standby listening in the voice interaction mode, and the radar module can periodically collect all individuals in the room for monitoring at specified time intervals, and send the sensing information of each individual to the radar-based voice interaction auxiliary device. The working period of the radar module is not specifically limited in the embodiment of the application.

[0048] Optionally, the radar module can perform collection work at a default working period.

[0049] Optionally, the user can issue a period change instruction to make the radar module receive and respond to the change instruction, and change the working period to the period indicated by the instruction for collection work.

[0050] It should be noted that, before step 101, the user needs to send an activation instruction through a transmission medium to activate the working mode of the air conditioner, so that the indoor unit of the air conditioner operates at the default wind speed of the mode, and the outdoor unit operates at the default frequency of the mode.

[0051] Optionally, the user can transmit the activation instruction by a control device in a wireless communication manner between the control device and the air conditioner, so as to initialize the working mode of the air conditioner or activate the voice interaction function in the default working mode, to start the radar module and the voice collection module.

[0052] Optionally, the user can issue the activation instruction in a voice interaction manner, and the air conditioner receives the activation instruction and performs voice recognition, initializes the working mode, and starts the radar module and the voice collection module.

[0053] Specifically, in step 101, after the air conditioner starts the working mode, the radar-based voice interaction auxiliary device determines that the individual has activated the voice interaction mode of the air conditioner, receives the contour information of the human body distribution of each individual in the space where the air conditioner is located, which is monitored by the radar module in real time, and analyzes the contour information to obtain the first position information of each individual in the horizontal dimension relative to the radar module and the second position information of each individual in the vertical dimension relative to the radar module.

[0054] The radar module is used to perceive the human body contour in a coordinate system with the radar module as the origin. The X-axis of the radar coordinate system is defined as the horizontal line where the radar module is located, the Y-axis is defined as being perpendicular to the X-axis in the horizontal plane where the radar module is located, and the Z-axis is defined as the vertical line where the radar module is located, and is used to represent the spatial height.

[0055] The first position information refers to the position information of the torso in the radar coordinate system. The first position information can be calculated according to the coordinate points covered by the torso of the human body in the radar coordinate system, and is mainly used to represent the horizontal position of the human body in the three-dimensional space.

[0056] The second position information refers to the position information of the head in the radar coordinate system. The second position information can be calculated according to the coordinate points covered by the head of the human body in the radar coordinate system, and is mainly used to represent the pitch angle of the head of the human body relative to the vertical direction of the X-axis.

[0057] The type and number of radar perception devices in the radar module are not specifically limited in the embodiment of the application.

[0058] For example, the radar module can include a laser radar, an infrared sensor, etc.

[0059] Optionally, the horizontal detection range of the millimeter wave radar can reach ±75°, the vertical detection range can reach ±40°, the maximum detection distance can reach 8 meters, the distance output accuracy can reach 0.1 meters, the angle output accuracy can reach 1°, and the response speed is relatively fast, without involving privacy issues and being affected by light.

[0060] Therefore, the voice interaction auxiliary device based on the radar takes the coordinate information in the coverage range of the individual collected by the millimeter wave radar in real time as the contour information of the user individual.

[0061] For example, the radar module can include a laser radar, an infrared sensor, etc.

[0062] For example, the contour information in the coverage range of the individual can be collected by the millimeter wave radar, and a mapping relationship between the contour information and the torso size is fitted according to a large amount of prior data, so as to directly obtain the torso position and the head position corresponding to the current contour position.

[0063] In step 102, a first swing range is determined according to the first position information, and a second swing range is determined according to the second position information.

[0064] Specifically, in step 102, the radar-based voice interaction auxiliary device sets the horizontal range that can avoid the position where the individual is located as the first swing area corresponding to the vertical swing leaf assembly according to the horizontal position of the human body indicated by the first position information in the three-dimensional space, and sets the vertical activity range that can avoid the head of the individual as the second swing area corresponding to the horizontal swing leaf assembly according to the vertical direction angle of the head of the human body indicated by the second position information in the three-dimensional space.

[0065] Subsequently, the first swing area and the second swing area are both encapsulated into a pre-control instruction, so that the air conditioner controls the vertical swing leaf assembly to avoid the individual to horizontally swing and controls the horizontal swing leaf assembly to avoid the individual to vertically swing according to the pre-control instruction before executing the voice interaction.

[0066] Step 103, after adjusting the wind speed to the mute gear and respectively controlling the vertical swing leaf assembly to swing left and right in the first swing area and controlling the horizontal swing leaf assembly to swing up and down in the second swing area, if a voice control signal is collected by the voice collection module within a preset time, the air conditioner is controlled according to the control intention corresponding to the voice control signal.

[0067] Among them, the voice semantic contained in the voice control signal corresponds to the control intention of any individual to the air conditioner. Figure One One corresponds.

[0068] Specifically, in step 103, the radar-based voice interaction auxiliary device controls the wind speed to be low-speed air supply at the mute gear within a preset time after activating the voice interaction mode, and makes the vertical swing leaf assembly swing left and right in the first swing area to avoid the horizontal position of the human body, and makes the horizontal swing leaf assembly swing up and down in the second swing area to avoid the vertical direction of the head, while making the voice collection module continuously listen to the sound emitted in the room.

[0069] If the voice collection module continuously listens to the individual in the room emitting a voice control signal during this process, it means that the currently collected voice control signal is obtained within the effective sound collection period, and the signal is determined to be valid, and after the voice is converted into text and the content is understood, the air conditioner is controlled according to the control intention obtained by understanding to perform corresponding operation.

[0070] On the contrary, if the voice control signal cannot be obtained within the effective sound collection period, it is determined that the currently collected voice signal is invalid, and the corresponding interaction function is not executed.

[0071] Among them, the voice control signal refers to the audio frame obtained by the voice collection module collecting the text content corresponding to a certain instruction through the inherent characteristics of the human oral cavity and larynx when the human individual in the room has subjective control intention to the air conditioner.

[0072] It can be understood that the preset time length is used for a valid voice signal acquisition time range, and the larger the value is, the longer the voice interaction assistance period is, and the easier the control signal is collected.

[0073] For example, the preset time length can be set to 10 seconds.

[0074] In the embodiment of the application, after the voice interaction mode is activated, the first position information and the second position information of the individual profile distributed in the horizontal dimension and the vertical dimension are immediately acquired by the radar module, the wind speed is maintained at the mute file within the preset time length, the free swing is performed in the first swing area and the second swing area respectively confirmed according to the position information by using the control swing leaf, and when the voice control signal is listened to by the voice acquisition module in the process, the corresponding voice interaction is decided to be executed. In the initialization stage of the voice interaction, the air conditioner is pre-avoided in the horizontal and vertical dimensions to minimize the wind power, the influence of the air conditioner wind on the sound source wave during the voice interaction is minimized, the voice control signal can be quickly received by the air conditioner, and the sensing accuracy of the voice interaction is improved.

[0075] On the basis of any of the above embodiments, after it is determined that the voice interaction mode is activated, the first position information and the second position information of each individual are determined based on the profile information collected by the radar module for the individuals in the room, including: in the case where it is determined that the voice signal collected by the voice acquisition module is a voice wake-up signal, receiving a set of profile coordinate points sensed by the radar module for each individual in the radar coordinate system.

[0076] It should be noted that, before step 101, the wake-up instruction text for activating the voice interaction mode is pre-set based on the mapping relationship between the voice content containing at least one "wake-up word" and the activation event of the voice interaction mode, so that the user can sequentially emit corresponding syllables in the corresponding text by vocal cord vibration to form a voice wake-up signal, and the frequency domain features of the signal are stored in the memory for voice triggering of the activation event.

[0077] Specifically, in step 101, the voice interaction assistance device based on the radar collects voice signals in real time through the voice acquisition module. If the frequency domain features of the current voice signal are consistent with the frequency domain features of the pre-stored voice wake-up signal, that is, the current voice signal is a voice wake-up signal, the radar module can be driven to work to obtain the profile position sensed by the radar module for each individual in the voice interaction mode initialization process, and the profile positions belonging to the same individual are stored in a set of profile coordinate points to represent the human body distribution of the individual.

[0078] If the frequency domain feature of the current voice signal is inconsistent with the frequency domain feature of the pre-stored voice wake-up signal, that is, the current voice signal is not a voice wake-up signal, the voice interaction mode will not be activated, and the radar module is in a dormant state.

[0079] The obtained trunk centroid coordinate is set as the first position information, and the obtained head centroid coordinate is set as the second position information.

[0080] Specifically, the radar-based voice interaction auxiliary device analyzes the contour coordinate point set corresponding to each individual, filters out the coordinate point corresponding to the trunk centroid in the contour coordinate point set as the first position information output, and also filters out the coordinate point corresponding to the head centroid as the second position information output.

[0081] The embodiment of the application does not make specific limitation on the coordinate calculation method.

[0082] Exemplarily, clustering analysis can be performed on the coordinate point distribution indicated by the contour coordinate point set, the coordinate point closest to the trunk centroid is found, and the coordinate value corresponding to the coordinate point is output as the first position information, and the second position information is the same.

[0083] Exemplarily, the coordinate values of all coordinate points belonging to the trunk part contained in the contour coordinate point set can be weighted and averaged, and the finally calculated coordinate value is output as the first position information, and the second position information is the same.

[0084] When it is determined that the received signal is a voice wake-up signal, the voice interaction mode is activated, and the radar module is driven to perceive the individual contour, and the first position information representing the distribution of the trunk centroid in the horizontal dimension and the second position information representing the distribution of the head centroid in the vertical dimension are calculated by using the perceived contour point coordinates, which are used as the basis for dividing the swing range before voice interaction control. In the initialization stage of voice interaction, the distribution position of the individual in space is perceived by radar, and the sound source propagation range is defined with the corresponding position as the center, so that the air conditioner avoids the sound source propagation range during the process of waiting for voice control instructions.

[0085] On the basis of any of the above embodiments, the first swing interval is determined according to the first position information, including: taking the horizontal right direction of the radar module as the positive direction of the X-axis in the radar coordinate system, if it is determined that the X-axis coordinate value of the first position information is greater than 0, the right boundary of the rated swing range of the vertical swing leaf assembly is updated to the execution angle corresponding to the first position information, and the first swing interval is generated.

[0086] If it is determined that the X-axis coordinate value of the first position information is less than 0, the left boundary of the rated swing range of the vertical swing blade assembly is updated to the execution angle corresponding to the first position information, and the first swing range is generated.

[0087] Specifically, in step 102, if the radar-based voice interaction auxiliary device determines that there is an individual, the position of the individual is determined according to the horizontal position indicated in the first position information of the individual, and the interval in which the position is located is excluded from the default swing range of the vertical swing blade assembly, and the first swing range complementary to the interval is obtained.

[0088] If it is determined that there are multiple individuals, the horizontal positions indicated in the first position information of all individuals are taken as a union, the interval in which the position is located is excluded from the default swing range of the vertical swing blade assembly, and the first swing range complementary to the interval is obtained.

[0089] Exemplarily, taking the right direction of the radar module in the horizontal direction as the positive direction of the X-axis in the radar coordinate system as an example, if the X-axis coordinate value of the first position information is greater than 0, that is, a single individual or most of the group is in the right half of the radar center line, it is necessary to avoid blowing in the right half, so the left half of the rated swing range of the vertical swing blade assembly is taken as the first swing range.

[0090] If the X-axis coordinate value of the first position information is less than 0, that is, a single individual or most of the group is in the left half of the radar center line, it is necessary to avoid blowing in the left half, so the right half of the rated swing range of the vertical swing blade assembly is taken as the first swing range.

[0091] The embodiment of the application divides the center line of the radar module in the horizontal plane into two halves, determines the half in which the user is currently located according to the X-axis coordinate value of the first position information, and then takes the other half as the first swing range, so as to avoid horizontal blowing of the vertical swing blade around the sound source. In the process of waiting for a voice control instruction, the vertical swing blade is realized to guide the air to the left and right in the horizontal propagation range of the sound source, so as to avoid the influence of the air conditioner air on the propagation speed of the sound source within the range of the individual position.

[0092] On the basis of any of the above embodiments, if it is determined that the current working mode is a cooling mode, the upper boundary of the rated swing range of the horizontal swing blade assembly is updated to the first execution angle, and the second swing range is generated.

[0093] If it is determined that the current working mode is a heating mode, the lower boundary of the rated swing range of the horizontal swing blade assembly is updated to the second execution angle, and the second swing range is generated.

[0094] The first execution angle is less than an included angle formed by the second position information relative to a Z axis in a radar coordinate system.

[0095] Specifically, in step 102, if the radar-based voice interaction auxiliary device determines that there is an individual, according to a vertical included angle indicated in second position information of the individual, and in combination with air flow characteristics of different working modes, a second swing range is divided from a default swing range of a horizontal swing vane assembly:

[0096] If the current working mode is a cooling mode, since the density of the output cold air in the cooling mode is less than the air density, the connecting line between the head of the individual and the radar module should be taken as a demarcation line, the first execution angle of the horizontal swing vane assembly is set below the demarcation line, the lower boundary of the horizontal swing vane assembly is kept unchanged, to form a second swing range below the head of the individual, and to accelerate the flow of the cold air.

[0097] If the current working mode is a heating mode, since the density of the output hot air in the heating mode is greater than the air density, the connecting line between the head of the individual and the radar module should be taken as a demarcation line, the second execution angle of the horizontal swing vane assembly is set above the demarcation line, the upper boundary of the horizontal swing vane assembly is kept unchanged, to form a second swing range above the head of the individual, and to accelerate the flow of the hot air.

[0098] It can be understood that if multiple individuals are determined to exist in the room, the vertical angles indicated in the second position information of all the individuals can be taken as a union, and according to different working modes, the lower boundary of the angle union is taken as the first execution angle, or the upper boundary of the angle union is taken as the second execution angle.

[0099] The embodiment of the application updates the upper boundary of the swing range of the horizontal swing vane to below the included angle formed by the head of the individual and the vertical direction, or updates the lower boundary to above the included angle formed by the head of the individual and the vertical direction, according to the current working mode of the air conditioner, to form a second swing range corresponding to different working modes, so that the horizontal swing vane avoids vertical swing of the human body. In the process of waiting for a voice control instruction, the horizontal swing vane is realized to guide air upward and downward in the vertical propagation range of the sound source, to avoid the influence of the air conditioner air on the propagation speed of the sound source in the propagation range centered on the position of the individual.

[0100] On the basis of any of the above embodiments, the wind speed is adjusted to a mute gear, and the vertical swing leaf assembly is controlled to swing left and right within the first swing range, and the horizontal swing leaf assembly is controlled to swing up and down within the second swing range, and further comprising: if it is determined that the voice collection module has not collected a voice control signal for a predetermined time period, the voice interaction mode is closed, and the air conditioner is controlled to return to the air supply mode before the voice interaction mode is activated.

[0101] Specifically, after step 102, the radar-based voice interaction auxiliary device controls the wind speed to be low-speed air supply at a mute gear within a predetermined time period after the voice interaction mode is activated, and controls the vertical swing leaf assembly to swing left and right within the first swing range to avoid the horizontal position of the human body, and controls the horizontal swing leaf assembly to swing up and down within the second swing range to avoid the vertical position of the head, while the voice collection module continuously listens to the sound emitted indoors.

[0102] If the voice collection module fails to listen to the individual indoors emitting a voice control signal during this process, it means that the user has not output the subsequent control instruction in a timely manner after activating the voice interaction, and the voice interaction mode is closed and no longer responds to any interactive function. At the same time, the current air supply mode that avoids blowing air on the human body is also restored to the state before the user activated the voice interaction mode.

[0103] Exemplarily, Figure 2 is a flowchart of a radar-based voice interaction auxiliary method provided by the present application. As shown in Figure 2 , the present application provides a specific implementation of a radar-based voice interaction auxiliary method:

[0104] (1) After the air conditioner is started, the voice collection module listens to the sound signal, and if the current collected sound signal includes a pre-set wake-up word, it is determined to be a voice wake-up signal, and the voice interaction mode is activated.

[0105] (2) In the initialization stage of the voice interaction mode, the millimeter wave radar captures the human body contour information in the room.

[0106] (3) The human body horizontal position, i.e. the first position information, is calculated according to the contour information, and the angle between the head of the human body and the vertical direction, i.e. the second position information, is calculated according to the contour information.

[0107] (4) If the first position information indicates that the human body is in the left zone (i.e. the horizontal plane is divided into left and right zones by the vertical line of the air conditioner radar), the vertical swing leaf is controlled to swing freely in the right zone (first swing range). Conversely, if the first position information indicates that the human body is in the right zone, the vertical swing leaf is controlled to swing freely in the left zone (first swing range).

[0108] (5) While performing step (4), judge in combination with the second position information and the air conditioner working mode:

[0109] If the air conditioner is in cooling mode, the horizontal guide plate swings freely in the range below 15° downward offset based on the human head angle (i.e. the second swing range). Conversely, if the air conditioner is in heating mode, the horizontal guide plate swings freely in the range above 15° upward offset based on the human head angle (i.e. the second swing range).

[0110] (6) After adjusting the air supply to the silent air supply mode, the air conditioner voice interaction is formally started.

[0111] (7) If there is no voice interaction for 10 seconds, exit the voice mode, and restore the horizontal swing leaf, vertical guide plate, air speed, etc. to the state before voice wake-up.

[0112] The embodiment of the present application immediately obtains the first position information and the second position information of the individual contour distribution in the horizontal and vertical dimensions through the radar module after activating the voice interaction mode, maintains the air speed at the silent gear within the preset time length, and uses the control swing leaf to freely swing in the first swing range and the second swing range respectively confirmed according to the position information. In this process, when the voice control signal cannot be listened to through the voice collection module, the voice interaction mode is closed, and the original air supply state is restored. The air conditioner is pre-prevented from avoiding the human body in the horizontal and vertical dimensions to supply air with the minimum wind power in the initialization stage of voice interaction. If the voice control instruction is not received in the pre-preparation stage, the voice interaction mode is closed, and the energy efficiency is saved.

[0113] Figure 3 is a structural schematic diagram of the voice interaction auxiliary device based on radar provided by the present application. On the basis of any of the above embodiments, as shown in Figure 3 , the device includes a voice interaction activation module 310, a voice collection auxiliary module 320, and a voice interaction control module 330, wherein:

[0114] The voice interaction activation module 310 is used to determine the first position information and the second position information of each individual based on the contour information collected by the radar module for the indoor individual after determining that the voice interaction mode is activated.

[0115] The voice collection auxiliary module 320 is used to determine the first swing range according to the first position information, and determine the second swing range according to the second position information.

[0116] The voice interaction control module 330 is configured to adjust the wind speed to a mute gear, and control the vertical swing blade assembly to swing left and right in the first swing range and control the horizontal swing blade assembly to swing up and down in the second swing range, and if a voice control signal is collected by the voice collection module within a preset time period, the voice interaction control module 330 is configured to control the air conditioner according to a control intention corresponding to the voice control signal.

[0117] The voice control signal contains voice semantics corresponding to a control intention of any individual on the air conditioner. Figure One The first position information is determined according to the coordinate points of the body contour of the individual in the radar coordinate system. The second position information is determined according to the coordinate points of the head contour of the individual in the radar coordinate system.

[0118] Specifically, the voice interaction activation module 310, the voice collection auxiliary module 320 and the voice interaction control module 330 are sequentially electrically connected.

[0119] After the voice interaction activation module 310 determines that the individual has activated the voice interaction mode of the air conditioner after the air conditioner starts the working mode, the voice interaction activation module 310 receives the contour information of the body distribution of each individual in the space where the air conditioner is located, which is monitored by the radar module in real time, and analyzes the contour information to obtain the first position information of each individual in the horizontal dimension relative to the radar module and the second position information in the vertical dimension relative to the radar module.

[0120] The voice collection auxiliary module 320 sets the horizontal range that can avoid the position of the individual as the first swing range of the vertical swing blade assembly according to the horizontal position of the body indicated by the first position information in the three-dimensional space, and sets the vertical activity range that can avoid the head of the individual as the second swing range of the horizontal swing blade assembly according to the vertical direction angle of the head of the individual indicated by the second position information in the three-dimensional space.

[0121] The voice interaction control module 330 controls the wind speed to be low speed in the mute gear within a preset time period after the voice interaction mode is activated, and controls the vertical swing blade assembly to swing left and right in the first swing range to avoid the horizontal position of the body, and controls the horizontal swing blade assembly to swing up and down in the second swing range to avoid the vertical position of the head, and simultaneously controls the voice collection module to continuously listen to the sound emitted in the room.

[0122] If the voice collection module continuously listens to the sound emitted by the individual in the room during this process, it means that the voice control signal collected at this time is obtained within the effective sound collection period, and the voice control signal is determined to be valid. After the voice control signal is converted into text and the content is understood, the air conditioner is controlled according to the control intention obtained by understanding.

[0123] Conversely, if the voice control signal cannot be acquired within the effective voice collection period, it is determined that the current voice signal is invalid, and the corresponding interactive function is not executed.

[0124] Optionally, the voice interaction activation module 310 comprises a contour perception unit and a position analysis unit, wherein:

[0125] The contour perception unit is configured to, in a case where it is determined that the voice signal collected by the voice collection module is a voice wake-up signal, receive a contour coordinate point set perceived by the radar module for each individual in a radar coordinate system.

[0126] The position analysis unit is configured to analyze any contour coordinate point set, set the obtained trunk centroid coordinate as first position information, and set the obtained head centroid coordinate as second position information.

[0127] The voice wake-up signal comprises at least one preset wake-up word.

[0128] Optionally, the voice collection auxiliary module 320 comprises a first swing range determination module, wherein:

[0129] The first swing range determination module is configured to take the right horizontal direction of the radar module as the positive direction of the X-axis in the radar coordinate system, and if it is determined that the X-axis coordinate value of the first position information is greater than 0, update the right boundary of the rated swing range of the vertical swing blade assembly to the execution angle corresponding to the first position information, and generate the first swing range.

[0130] If it is determined that the X-axis coordinate value of the first position information is less than 0, update the left boundary of the rated swing range of the vertical swing blade assembly to the execution angle corresponding to the first position information, and generate the first swing range.

[0131] Optionally, the voice collection auxiliary module 320 comprises a second swing range determination module, wherein:

[0132] The second swing range determination module is configured to, if it is determined that the current working mode is a cooling mode, update the upper boundary of the rated swing range of the horizontal swing blade assembly to a first execution angle, and generate the second swing range.

[0133] If it is determined that the current working mode is a heating mode, update the lower boundary of the rated swing range of the horizontal swing blade assembly to a second execution angle, and generate the second swing range.

[0134] The first execution angle is less than the included angle formed by the second position information relative to the Z-axis in the radar coordinate system. The second execution angle is greater than the included angle formed by the second position information relative to the Z-axis in the radar coordinate system.

[0135] Optionally, the device further comprises a voice interaction closing module, wherein:

[0136] The voice interaction closing module is configured to, if it is determined that the voice collection module has not collected the voice control signal continuously for the preset time length, close the voice interaction mode and control the air conditioner to restore to the air supply mode before the voice interaction mode is activated.

[0137] The radar-based voice interaction auxiliary device provided by the embodiments of the present application is used to execute the radar-based voice interaction auxiliary method of the present application, and the implementation manner is consistent with that of the radar-based voice interaction auxiliary method of the present application, and the same beneficial effects can be achieved, which will not be described here.

[0138] In the embodiments of the present application, the first position information and the second position information of the individual contour distribution in the horizontal dimension and the vertical dimension are obtained by the radar module immediately after the voice interaction mode is activated, and on the basis of maintaining the wind speed at the mute gear for the preset time length, the control swing leaf is used to perform free swing in the first swing wind interval and the second swing wind interval respectively confirmed according to the position information, and in this process, when the voice control signal is listened to by the voice collection module, the corresponding voice interaction is decided to be executed. In the initialization stage of the voice interaction, the air conditioner is pre-avoided from the human body in the horizontal and vertical dimensions to realize the minimum wind supply, the influence of the air conditioner wind on the sound source wave in the voice interaction is reduced to the minimum, the voice control signal can be quickly received by the air conditioner, and the sensing accuracy of the voice interaction is improved.

[0139] Figure 4 is a structural schematic diagram of an air conditioner provided by the present application. On the basis of any of the above embodiments, as shown in Figure 4 The air conditioner provided by the embodiments of the present application comprises an indoor unit 410 and an outdoor unit 420, the indoor unit 410 is provided with a control processor 411, a voice collection module 412 and a radar module 413, the radar module 413 is arranged on the surface of the shell of the indoor unit. Further comprising a memory and a program or instruction stored on the memory and executable on the control processor 411, the program or instruction is executed by the control processor 411 to execute the radar-based air conditioner voice interaction method.

[0140] The radar module 413 comprises a millimeter wave radar.

[0141] Specifically, the air conditioner is provided with an indoor unit 410 and an outdoor unit 420, a control processor 411 is packaged on a control board card of the indoor unit 410, and a voice collection module 412 and a radar module 413 are inlaid on the surface of the shell of the indoor unit 410, after the control processor 411 determines that a user activates a voice interaction mode of the air conditioner through voice through the voice collection module 412 arranged in the indoor unit 410, the radar module 413 receives contour information of a human body distribution of each individual in a space where the air conditioner is located, which is monitored in real time, and analyzes the contour information to obtain first position information of each individual respectively relative to a horizontal dimension of the radar module 413, and second position information relative to a vertical dimension of the radar module.

[0142] The control processor 411 sets a horizontal range that can avoid the position where the individual is located as a first wind swinging interval corresponding to the vertical swing leaf assembly according to the horizontal position of the human body in the three-dimensional space indicated by the first position information, and sets a vertical movement range that can avoid the head of the individual as a second wind swinging interval corresponding to the horizontal swing leaf assembly according to the vertical direction angle of the head of the human body in the three-dimensional space indicated by the second position information.

[0143] The control processor 411 controls the air speed to be low speed in the mute mode within a preset time period after activating the voice interaction mode, and controls the vertical swing leaf assembly to swing left and right to avoid the horizontal position of the human body in the first wind swinging interval, and controls the horizontal swing leaf assembly to swing up and down to avoid the vertical position of the head in the second wind swinging interval, while the voice collection module 412 continuously listens to the sound emitted in the room.

[0144] If the control processor 411 listens to the voice control signal emitted by the individual in the room through the voice collection module 412 during this process, it means that the current collected voice control signal is obtained within the effective sound collection period, so the signal is determined to be valid, the voice is converted into text after responding to the voice control signal, the content is understood, and the air conditioner is controlled according to the control intention obtained by understanding to perform corresponding operation.

[0145] On the contrary, if the voice control signal cannot be obtained within the effective sound collection period, the current collected voice signal is determined to be invalid, and the corresponding interaction function is not executed.

[0146] The embodiment of the present application immediately obtains first position information and second position information of the individual contour distributed in horizontal and vertical dimensions through the radar module after activating the voice interaction mode, maintains the wind speed at the mute file within a preset time length on the basis of the first swing wind range and the second swing wind range obtained according to the position information, and controls the swing blade to swing freely in the first swing wind range and the second swing wind range. In this process, when the voice control signal is listened to through the voice collection module, the corresponding voice interaction is decided to be executed. The air conditioner is pre-avoided from the human body in horizontal and vertical dimensions in the initialization stage of the voice interaction to send the wind with the minimum wind power, the influence of the air conditioner wind on the sound source wave in the voice interaction is reduced to the minimum, the voice control signal can be quickly received by the air conditioner, and the sensing accuracy of the voice interaction is improved.

[0147] On the basis of any of the above embodiments, the voice collection module 412 is arranged in the indoor unit and / or the control terminal of the indoor unit.

[0148] Specifically, the voice collection module 412 can not only be integrated on the development board card in the indoor unit 410, but also be integrated in the development board card of the remote control terminal (for example, the air conditioner remote controller, the intelligent terminal in wireless communication with the air conditioner) for controlling the indoor unit 410, so that the user can output the voice to the air conditioner or the control terminal to obtain the response.

[0149] The embodiment of the present application can diversify the voice interaction by arranging the voice collection module on the indoor unit and / or the control terminal of the indoor unit.

[0150] In addition, the logic instructions in the above-mentioned memory can be realized in the form of a software function unit and sold or used as an independent product, and can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0151] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the radar-based voice interaction assistance method provided by the above methods. The method includes: after determining that the voice interaction mode is activated, determining the first position information and the second position information of each individual based on the contour information collected by the radar module from the individuals in the room; determining the first swing interval according to the first position information and the second swing interval according to the second position information; adjusting the fan speed to a silent mode, and controlling the vertical swing blade assembly to swing left and right in the first swing interval and controlling the horizontal swing blade assembly to swing up and down in the second swing interval; if a voice control signal is collected by the voice acquisition module within a preset time period, controlling the air conditioner in response to the control intention corresponding to the voice control signal; wherein, the voice semantics contained in the voice control signal are related to the control intention of any individual on the air conditioner. Figure One One-to-one correspondence; the first position information is determined based on the coordinate points of the individual's torso outline in the radar coordinate system; the second position information is determined based on the coordinate points of the individual's head outline in the radar coordinate system.

[0152] Furthermore, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program performs the radar-based voice interaction assistance method provided by the methods described above. This method includes: after determining that a voice interaction mode is activated, determining first and second position information for each individual based on contour information collected by a radar module from individuals in the room; determining a first swing interval based on the first position information and a second swing interval based on the second position information; adjusting the fan speed to a silent mode, and controlling the vertical sway blade assembly to swing left and right within the first swing interval and controlling the horizontal sway blade assembly to swing up and down within the second swing interval; if a voice control signal is collected by a voice acquisition module within a preset time period, controlling the air conditioner in response to the control intent corresponding to the voice control signal; wherein the voice semantics contained in the voice control signal correspond to the control intent of any individual regarding the air conditioner. Figure One One-to-one correspondence; the first position information is determined based on the coordinate points of the individual's torso outline in the radar coordinate system; the second position information is determined based on the coordinate points of the individual's head outline in the radar coordinate system.

[0153] The device embodiments described above are merely illustrative, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed to multiple network units. Part or all of the modules can be selected to achieve the purposes of the embodiments according to actual needs. Those skilled in the art can understand and implement without creative labor.

[0154] Through the description of the above embodiments, those skilled in the art can clearly understand that the embodiments can be realized by means of software and the necessary general hardware platform, and of course can also be realized by hardware. Based on such understanding, the above technical solutions can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiments.

[0155] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement to part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A radar-based voice interaction assistance method, characterized by, Comprise: After determining that the voice interaction mode is activated, based on the contour information of the indoor individuals collected by the radar module, the first position information and the second position information of each individual are determined; According to the first position information, the first swing range is determined, and according to the second position information, the second swing range is determined; After adjusting the wind speed to the mute gear, and respectively controlling the vertical swing leaf assembly to swing left and right in the first swing range, and controlling the horizontal swing leaf assembly to swing up and down in the second swing range, if the voice control signal is collected by the voice collection module within a preset time, the air conditioner is controlled according to the control intention corresponding to the voice control signal; Wherein, the voice semantics contained in the voice control signal one-to-one corresponds to the control intention of any individual to the air conditioner; the first position information is determined according to the coordinate point of the individual's torso contour in the radar coordinate system; the second position information is determined according to the coordinate point of the individual's head contour in the radar coordinate system; In the initialization stage of voice interaction, the air conditioner is precluded from the human body in the horizontal and vertical dimensions with the minimum wind power.

2. The radar-based voice interaction assistance method of claim 1, wherein, After determining that the voice interaction mode is activated, based on the contour information of the indoor individuals collected by the radar module, the first position information and the second position information of each individual are determined, comprising: In the case that the voice signal collected by the voice collection module is a voice wake-up signal, the radar module receives the contour coordinate point set perceived by each individual in the radar coordinate system; Any contour coordinate point set is analyzed, the obtained torso centroid coordinate is set as the first position information, and the obtained head centroid coordinate is set as the second position information; Wherein, the voice wake-up signal contains at least one preset wake-up word.

3. The radar-based voice interaction assistance method of claim 2, wherein, The first swing range is determined according to the first position information, comprising: Taking the horizontal right direction of the radar module as the positive direction of the X axis in the radar coordinate system, if it is determined that the X axis coordinate value of the first position information is greater than 0, the right boundary of the rated swing range of the vertical swing leaf assembly is updated to the execution angle corresponding to the first position information, and the first swing range is generated; If it is determined that the X axis coordinate value of the first position information is less than 0, the left boundary of the rated swing range of the vertical swing leaf assembly is updated to the execution angle corresponding to the first position information, and the first swing range is generated.

4. The radar-based voice interaction assistance method of claim 2, wherein, The second swing range is determined according to the second position information, comprising: If it is determined that the current working mode is the cooling mode, the upper boundary of the rated swing range of the horizontal swing leaf assembly is updated to the first execution angle, and the second swing range is generated; If it is determined that the current working mode is the heating mode, the lower boundary of the rated swing range of the horizontal swing leaf assembly is updated to the second execution angle, and the second swing range is generated; Wherein, the first execution angle is less than the included angle formed by the second position information relative to the Z axis in the radar coordinate system; the second execution angle is greater than the included angle formed by the second position information relative to the Z axis in the radar coordinate system.

5. The radar-based voice interaction assistance method according to any one of claims 1-4, characterized in that, After adjusting the wind speed to a silent mode and controlling the vertical oscillating blade assembly to oscillate left and right within the first oscillation range, and controlling the horizontal oscillating blade assembly to oscillate up and down within the second oscillation range, the method further includes: If the voice acquisition module fails to acquire a voice control signal within a preset time period, the air conditioner will be restored to the air supply mode before the voice interaction mode was activated after the voice interaction mode is turned off.

6. A radar-based voice interaction assistance device, characterized by include: The voice interaction activation module is used to determine the first and second position information of each individual based on the contour information collected by the radar module of the individual in the room after the voice interaction mode is activated. The voice acquisition auxiliary module is used to determine the first swing range based on the first location information and the second swing range based on the second location information. The voice interaction control module is used to adjust the fan speed to the silent mode, and control the vertical sway blade assembly to swing left and right in the first swing zone, and control the horizontal sway blade assembly to swing up and down in the second swing zone. If a voice control signal is collected by the voice acquisition module within a preset time, the module will operate the air conditioner in response to the control intention corresponding to the voice control signal. The voice control signal contains a voice semantic that corresponds one-to-one with any individual's control intention on the air conditioner; the first position information is determined based on the coordinates of the individual's torso outline in the radar coordinate system; the second position information is determined based on the coordinates of the individual's head outline in the radar coordinate system. During the initialization phase of voice interaction, the air conditioner is pre-positioned to avoid the human body in both horizontal and vertical dimensions, delivering air with minimal force.

7. An air conditioner comprising an indoor unit and an outdoor unit, characterized by comprising: The indoor unit is equipped with a control processor, a voice acquisition module, and a radar module, with the radar module disposed on the surface of the indoor unit's housing; it also includes a memory and a program or instructions stored in the memory and executable on the control processor, wherein the program or instructions, when executed by the control processor, perform the radar-based voice interaction assistance method as described in any one of claims 1 to 5; The radar module includes a millimeter-wave radar.

8. The air conditioner of claim 7, wherein The voice acquisition module is installed in the indoor unit and / or the control terminal of the indoor unit. 9.A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by the processor, it implements the radar-based voice interaction assistance method as described in any one of claims 1 to 5.

10. A computer program product comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the radar-based voice interaction assistance method as described in any one of claims 1 to 5.

Images