Control method and device of intelligent equipment, air conditioner, equipment and storage medium

Abstract

The invention relates to a control method and device of intelligent equipment, an air conditioner, equipment and a storage medium. The method comprises the following steps: collecting spatial semantic information and control rule information set through voice; when the spatial semantic information is collected, determining spatial positioning information corresponding to the spatial semantic information; binding the spatial semantic information, the control rule information and the spatial positioning information to form a binding relationship; when it is monitored that the current position of the user is matched with the spatial positioning information, intelligent equipment control is executed according to the binding relation. According to the method, the space semantic information, the control rule information and the space positioning information are bound together in a mode of combining a voice recognition technology and a space perception technology, so that the space region, the meaning referred by the space region and the control rule of the intelligent equipment correspond to one another, and the user can conveniently enter the space region every time the user enters the space region. The intelligent device can execute the control rule, so that the problem of poor experience feeling caused by the fact that a user needs to control the intelligent device through voice every time is avoided.

Description

Technical Field

[0001] The present application relates to the technical field of device control, and particularly to a control method, device, air conditioner, equipment and storage medium for intelligent devices. Background Art

[0002] With the development of smart home technology, intelligent devices have gradually evolved from traditional button operations and remote control to remote control and voice control based on mobile phone APPs. Moreover, with the continuous progress of technology, voice recognition technology has also begun to be applied in intelligent devices, and users can directly control the parameters of intelligent devices (such as a series of parameters like temperature, wind speed, mode, etc.) through voice commands, achieving an interactive experience of "hands-free operation".

[0003] However, in the existing voice control methods, every time a user manipulates an intelligent device, a voice command needs to be spoken. For example, when the user needs to increase the air conditioner temperature, the user needs to say "increase the air conditioner temperature" to the air conditioner. Even for some intelligent devices, the user needs to say a wake-up word first and then a voice command every time to control the intelligent device. For example, when the user needs to increase the air conditioner temperature, the user needs to say "intelligent air conditioner" to the air conditioner, and the voice module of the air conditioner replies "yes", then the user can say the voice command "increase the temperature". Therefore, the existing control method for intelligent devices based on voice recognition technology has a poor experience for users. Summary of the Invention

[0004] The present application provides a control method, device, air conditioner, equipment and storage medium for intelligent devices to solve the problem that in the existing control method for intelligent devices based on voice recognition technology, every time a user manipulates an intelligent device, a voice command needs to be spoken, resulting in a poor experience.

[0005] In view of the above technical problems, the technical solution of the present application is solved through the following embodiments:

[0006] An embodiment of the present application provides a control method for an intelligent device, including: setting spatial semantic information and control rule information in a voice manner; determining spatial positioning information corresponding to the spatial semantic information; binding the spatial semantic information, the control rule information and the spatial positioning information to form a binding relationship; and when it is detected that the current position of the user matches the spatial positioning information, performing intelligent device control according to the binding relationship.

[0007] Wherein, the spatial semantic information is used to indicate a spatial position or a motion trajectory; determining the spatial positioning information corresponding to the spatial semantic information includes: when the spatial semantic information is used to indicate a spatial position, locating the user's spatial position when setting the spatial semantic position in a voice manner, and determining the position information of a preset first spatial region centered on the user's spatial position as the spatial positioning information; when the spatial semantic information is used to indicate a motion trajectory, tracking the user's motion trajectory after setting the spatial semantic position in a voice manner, and determining the position information of a preset second spatial region with the user's motion trajectory as the midline as the spatial positioning information.

[0008] Wherein, performing intelligent device control according to the binding relationship includes: in the binding relationship, reading the control rule information; wherein, the types of the control rule information include a first type and a second type; when the control rule information is of the first type, controlling the intelligent device to execute the action instruction in the control rule information according to the spatial positioning information; when the control rule information is of the second type, controlling the intelligent device to generate a user status prompt information according to the spatial semantic information and the prompt information in the control rule information and controlling the intelligent device to perform voice broadcast.

[0009] Wherein, when it is monitored that the user's current position matches the spatial positioning information, performing intelligent device control according to the binding relationship includes: in the case that it is monitored that the user's current position matches at least two pieces of the spatial positioning information, determining the spatial positioning information with the highest priority among the at least two pieces of the spatial positioning information; performing intelligent device control according to the binding relationship corresponding to the spatial positioning information with the highest priority.

[0010] Wherein, determining the spatial positioning information with the highest priority includes: identifying the priority tags respectively corresponding to each piece of the spatial positioning information, and determining the spatial positioning information corresponding to the priority tag mapped by the highest priority as the spatial positioning information with the highest priority; or determining the spatial positioning information with the most frequent use of the control rule information as the spatial positioning information with the highest priority; or voice-broadcasting the control rule information respectively bound to each piece of the spatial positioning information; after the voice broadcast, collecting a voice selection instruction, and using the spatial positioning information indicated by the voice selection instruction as the spatial positioning information with the highest priority.

[0011] Wherein, the method further includes: after performing intelligent device control according to the binding relationship, when it is detected that the number of times of performing the same control operation on the intelligent device is greater than a preset number threshold, generating new control rule information according to the same control operation, so as to update the original control rule information with the new control rule information.

[0012] Wherein, after binding the spatial semantic information, the control rule information, and the spatial positioning information, it further includes: collecting a voice control instruction; wherein, the voice control instruction includes: a control operation and a control object; wherein, the control object is the spatial semantic information, the control rule information, and / or the spatial positioning information; performing the control operation on the control object.

[0013] An embodiment of the present application further provides a control device for an intelligent device, including: a collection module, configured to set spatial semantic information and control rule information in a voice manner; a determination module, configured to determine spatial positioning information corresponding to the spatial semantic information; a binding module, configured to bind the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship; a control module, configured to perform intelligent device control according to the binding relationship when it is monitored that the user's current position matches the spatial positioning information.

[0014] An embodiment of the present application further provides an air conditioner, and the air conditioner applies the intelligent device control method described in any one of the above.

[0015] An embodiment of the present application further provides a control device for an intelligent device, including: at least one communication interface; at least one bus connected to the at least one communication interface; at least one processor connected to the at least one bus; at least one memory connected to the at least one bus, wherein the processor is configured to: execute a control program for an intelligent device stored in the memory to implement the intelligent device control method described in any one of the above.

[0016] An embodiment of the present application further provides a computer-readable storage medium, and the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed, the intelligent device control method described in any one of the above is implemented.

[0017] The above technical solution provided by the embodiments of the present application has the following advantages compared with the prior art: The method provided by the embodiments of the present application can collect spatial semantic information and control rule information set by voice; when the spatial semantic information is collected, determine the spatial positioning information corresponding to the spatial semantic information; bind the spatial semantic information, the control rule information and the spatial positioning information to form a binding relationship; when it is monitored that the current position of the user matches the spatial positioning information, execute the intelligent device control according to the binding relationship. The embodiments of the present application combine voice recognition technology and spatial perception technology to bind spatial semantic information, control rule information and spatial positioning information together, so that the spatial area, the meaning represented by the spatial area and the control rules of the intelligent device correspond to each other. Furthermore, under this binding relationship, every time the user enters this spatial area, the intelligent device can execute the control rule without the user having to voice-control the intelligent device, thereby avoiding the problem of poor user experience caused by the user having to voice-control the intelligent device every time. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application and, together with the specification, are used to explain the principles of the present application.

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] One or more embodiments are illustrated by way of example in the accompanying drawings corresponding thereto. These exemplary illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are represented as similar elements, unless otherwise stated, and the drawings in the figures do not constitute a scale limitation.

[0021] Figure 1 It is a flowchart of a control method for an intelligent device according to an embodiment of the present application;

[0022] Figure 2 It is a schematic diagram of a first spatial area according to an embodiment of the present application;

[0023] Figure 3 It is a schematic diagram of a second spatial area according to an embodiment of the present application;

[0024] Figure 4 It is a structural diagram of a control device for an intelligent device according to an embodiment of the present application;

[0025] Figure 5Structural diagram of a control device for an intelligent device according to an embodiment of the present application. Detailed implementation manners

[0026] To make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Apparently, the described embodiments are some but not all of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0027] The following disclosure provides many different embodiments or examples for implementing different structures of the present application. To simplify the disclosure of the present application, the components and settings of specific examples are described below. Of course, they are only examples and are not intended to limit the present application. In addition, the present application may repeat reference numerals and / or letters in different examples. This repetition is for the purpose of simplification and clarity and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0028] The embodiments of the present application provide a control method for an intelligent device. The execution subject of this method is the intelligent device. As Figure 1 shown, it is a flowchart of a control method for an intelligent device according to an embodiment of the present application.

[0029] Step S110, set spatial semantic information and control rule information in a voice manner.

[0030] Spatial semantic information refers to the spatial area label of a spatial area in the environment where the intelligent device is located. For example: the spatial area label (spatial semantic information) is the living room or the bedroom.

[0031] Control rule information refers to the control rules waiting for the intelligent device to execute. For example: set the temperature of the air conditioner to 25°C.

[0032] Specifically, the spatial semantic information and control rule information input by the user in a voice manner can be collected and set.

[0033] Step S120, determine the spatial positioning information corresponding to the spatial semantic information.

[0034] Spatial positioning information refers to the spatial area range indicated by the user in the environment where the intelligent device is located when setting the spatial voice information by voice. For example: the living room area, the bedroom area, etc.

[0035] Step S130, bind the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship.

[0036] Step S140, when it is monitored that the user's current location matches the spatial positioning information, perform intelligent device control according to the binding relationship.

[0037] The matching of the user's current location and the spatial positioning information means that the user's current location is within the spatial area range indicated by the spatial positioning information.

[0038] Specifically, when it is monitored that the user's current location corresponding to the user in the environment where the intelligent device is located is within the spatial area range indicated by a piece of spatial positioning information, perform device control on the intelligent device according to the binding relationship corresponding to the spatial positioning information.

[0039] In the embodiments of the present application, an intelligent device control method with natural language interaction ability, spatial understanding ability, and behavior customization ability is provided. This method can collect spatial semantic information and control rule information set by voice; when the spatial semantic information is collected, determine the spatial positioning information corresponding to the spatial semantic information; bind the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship; when it is monitored that the user's current location matches the spatial positioning information, perform intelligent device control according to the binding relationship. In the embodiments of the present application, through the combination of voice recognition technology and spatial perception technology, the spatial semantic information, control rule information, and spatial positioning information are bound together, so that the spatial area, the meaning represented by the spatial area, and the control rules of the intelligent device correspond to each other. Furthermore, under this binding relationship, every time the user enters this spatial area, the intelligent device can execute this control rule without the user having to voice-control the intelligent device, thus avoiding the problem of poor user experience caused by the user having to voice-control the intelligent device every time.

[0040] To make the embodiments of the present application easier to understand, the control method of the intelligent device in the embodiments of the present application will be further described below.

[0041] In the embodiments of the present application, in order to configure rules for the intelligent device, the spatial semantic information and control rule information corresponding to the intelligent device can be set by voice.

[0042] Specifically, a voice module can be set in the environment where the intelligent device is located. The intelligent device uses this voice module to collect the voice setting information input by the user; and uses voice recognition technology to recognize the spatial semantic information and / or control rule information carried in the voice setting information.

[0043] Spatial semantic information refers to: the spatial region label corresponding to a spatial region, which can represent the meaning denoted by the spatial region. The types of spatial regions include, but are not limited to: spatial positions and movement trajectories. For example: If a user wishes to define the spatial region where they are as the living room, they can say "This is the living room", and the voice module will collect the voice setting information "This is the living room" and set "living room" as the spatial semantic information.

[0044] Control rule information refers to: the control rules waiting for the intelligent device to execute. For example: If a user wishes the cooling temperature of the air conditioner to be 26°C, they can say "Adjust the cooling temperature of the air conditioner to 26°C", and the voice module will collect this voice setting information "Adjust the cooling temperature of the air conditioner to 26°C" and set it as the control rule information.

[0045] Furthermore, the voice module can be integrated into the intelligent device, or, independently set in the environment where the intelligent device is located and establish a network connection with the intelligent device.

[0046] Furthermore, the sequence of setting spatial semantic information, control rule information, and determining spatial positioning information through voice is not limited. It is possible to first collect the spatial semantic information set through voice, and then collect the control rule information set through voice. It is also possible to first collect the spatial semantic information set through voice and determine the spatial positioning information corresponding to this spatial semantic information, and then collect the control rule information set through voice. It is also possible to collect the spatial semantic information and control rule information set through voice together. For example: A user can say "When standing in the kitchen, adjust the cooling temperature of the air conditioner to 26°C" all at once, which will set "kitchen" as the spatial semantic information and "Adjust the cooling temperature of the air conditioner to 26°C" as the control rule information all at once.

[0047] Furthermore, since users may have problems providing clear control rule information, the spatial semantic information and control rule information can be set by parsing the voice setting information. For example: When a user says "When I'm on the sofa, lower the wind speed and don't blow on me", it can be parsed into the spatial semantic information of "sofa", and the control rule information of "When the user enters the'sofa' → lower the wind speed + deflect the air outlet to avoid".

[0048] In the embodiments of the present application, in order to establish a connection between the spatial region, the meaning denoted by the spatial region, and the control rules of the intelligent device, a preset millimeter-wave radar can be used to determine the spatial positioning information corresponding to the spatial semantic information and monitor the current position of the user corresponding to the user in the environment where the intelligent device is located.

[0049] As a high-precision and non-contact human body perception sensor, a millimeter-wave radar can be integrated into intelligent devices or independently set in the environment where the intelligent devices are located. The millimeter-wave radar can be used to detect information such as whether there are people in a room, the approximate positions of the people, and whether the people are moving. In the embodiments of the present application, the sensing ability of the millimeter-wave radar can be utilized to detect whether there is a user in the environment where the intelligent device is located and the change in the user's position. In this way, the intelligent device can be automatically turned off or enter an energy-saving mode when there is no one, and when the distance between the person and the intelligent device is within a preset distance range, functions such as wind direction adjustment and temperature adjustment can be performed according to the user's position, improving energy saving and comfort.

[0050] Specifically, the spatial semantic information is used to indicate a spatial position or a motion trajectory.

[0051] When the spatial semantic information is used to indicate a spatial position, the user's spatial position when setting the spatial semantic position in a voice manner is located, and the position information of a preset first spatial region centered on the user's spatial position is determined as the spatial positioning information; when the spatial semantic information is used to indicate a motion trajectory, the user's motion trajectory after setting the spatial semantic position in a voice manner is tracked, and the position information of a preset second spatial region with the user's motion trajectory as the midline is determined as the spatial positioning information.

[0052] The user's spatial position refers to the coordinates of the user in the environment where the intelligent device is located.

[0053] The user's motion trajectory refers to the coordinate change curve of the user in the environment where the intelligent device is located.

[0054] The position information of the first spatial region is the coordinate range of the first spatial region. The shape of the first spatial region is not limited. For example: as Figure 2 shown, it is a schematic diagram of the first spatial region according to an embodiment of the present application. Among them, the first spatial region is a circle with a preset radius centered on the user's spatial position when setting the spatial semantic position (indicating the living room) in a voice manner, and the position information of the first spatial region is the coordinate range of this circle.

[0055] The position information of the second spatial region is the coordinate range of the second spatial region. The edge of the second spatial region can be a line at the same distance from the user's motion trajectory. For example: as Figure 3 shown, it is a schematic diagram of the second spatial region according to an embodiment of the present application. Among them, the second spatial region is a curved region defined by two curves with a preset distance value from the user's motion trajectory and with the user's motion trajectory after setting the spatial semantic position (indicating the motion trajectory from the living room to the kitchen) in a voice manner as the midline, and the position information of the second spatial region is the coordinate range of this curved region.

[0056] Furthermore, a millimeter-wave radar can be used to detect the user's spatial position and movement trajectory in the environment where the intelligent device is located. The coordinates detected by the millimeter-wave radar for the user in the environment where the intelligent device is located are three-dimensional spatial coordinates.

[0057] Furthermore, there is no limitation on the order of setting spatial semantic information, control rule information, and determining spatial positioning information by voice. That is to say, the embodiments of the present application support the user to speak while walking and set while speaking. For example, the user says while walking, "The route I am walking now is the route to the kitchen", "The wind speed gradually increases along this road", and at the same time, the millimeter-wave radar records the area range corresponding to the user's movement trajectory, sets "kitchen" as the spatial semantic information, the area range corresponding to the user's movement trajectory as the spatial positioning information, and the wind speed gradually increases according to a preset gradient as the control rule information, such as increasing gradually from wind speed gear 1 → gear 2 → gear 3.

[0058] Since the intelligent device does not know what spatial regions exist in the environment where the intelligent device is located and what each spatial region represents, the embodiments of the present application can first set the spatial semantic information by voice, and then determine the spatial positioning information corresponding to the spatial semantic information, so that the intelligent device can perceive each spatial region in the environment where the intelligent device is located and the meaning represented by each spatial region. For example, if the spatial semantic information is the living room, then the spatial positioning information is the coordinate range of the living room area.

[0059] In the embodiments of the present application, after collecting the spatial semantic information and control rule information set by the user by voice and determining the spatial positioning information corresponding to the spatial semantic information, a binding relationship can be established among the spatial semantic information, control rule information, and spatial positioning information, so as to establish a connection among the spatial region, the meaning represented by the spatial region, and the control rule of the intelligent device, form a behavior rule of a trigger condition and an execution action, and bind it to the corresponding spatial label (spatial semantic information) to achieve highly personalized scene control.

[0060] Furthermore, each binding relationship can be stored as an entry in a preset database. Among them, a spatial control rule engine can be set up to store, parse, and use each binding relationship by using the spatial control rule engine, and support priority judgment, conflict handling, and dynamic update of the binding relationship.

[0061] In the embodiments of the present application, based on the established binding relationship, the millimeter-wave radar can be used to monitor the user's current position in real time; when it is detected that the user's current position matches the spatial positioning information in a binding relationship, the intelligent device control is executed according to the binding relationship.

[0062] Specifically, when it is detected that the user's current location is within the coordinate range represented by the spatial positioning information, it indicates that the user's current location is matched with the spatial positioning information in a binding relationship. At this time, the control rule information can be read in the binding relationship; wherein, the types of the control rule information include a first type and a second type; when the control rule information is of the first type, control the intelligent device to execute the behavior instruction in the control rule information according to the spatial positioning information; when the control rule information is of the second type, control the intelligent device to generate user status prompt information according to the spatial semantic information and the prompt information in the control rule information and control the intelligent device to perform voice broadcast.

[0063] The first type indicates that the control rule information is a function control rule. For example: The control rule information of the first type is used to control the air conditioner to adjust the cooling temperature to 25°C.

[0064] The second type indicates that the control rule information is an information reminder rule. For example: The control rule information of the second type is used to indicate the generation of a notification informing the user of the current environment or situation.

[0065] The behavior instruction is used to control the intelligent device to adjust function parameters. Controlling the intelligent device to execute the behavior instruction in the control rule information according to the spatial positioning information includes: controlling the intelligent device to execute the behavior instruction for the coordinate range corresponding to the spatial positioning information. For example: The spatial positioning information corresponds to the living room area, and the behavior instruction is to control the air conditioner to adjust the cooling temperature to 25°C, then the air conditioner can be controlled to adjust the cooling temperature corresponding to the living room area to 25°C.

[0066] The user status prompt information refers to a notification that prompts the user of the current environment or situation. For example: The spatial semantic information is the ultraviolet disinfection area, and the prompt information in the control rule information is "Pay attention to safety", then the user status prompt information generated according to the spatial semantic information and the prompt information can be "The location where you are is the ultraviolet disinfection area, please pay attention to safety".

[0067] Certainly, the first type can also indicate that the control rule information is a function control rule and an information reminder rule. Further, when the control rule information is of the first type, the intelligent device can be controlled to execute the behavior instruction in the control rule information according to the spatial positioning information; and, according to the spatial semantic information and the device status after executing the behavior instruction, generate device status prompt information and perform voice broadcast.

[0068] The device state refers to the device state corresponding to the function controlled by the first type of behavior instruction after the intelligent device executes the first type of behavior instruction for the coordinate range corresponding to the spatial positioning information. For example: if the behavior instruction is used to control the cooling temperature of the air conditioner to be adjusted to 25°C and the spatial positioning information is the living room area, then after controlling the air conditioner to adjust the cooling temperature corresponding to the living room area to 25 degrees Celsius, the device state of the air conditioner can be that the air conditioner has adjusted the cooling temperature corresponding to the living room area (spatial positioning information) to 25°C.

[0069] The device state prompt information is used to prompt the device state corresponding to the function controlled by the first type of behavior instruction after the intelligent device executes the first type of behavior instruction for the spatial positioning information. For example: if the spatial semantic information is the living room and the device state is that the air conditioner has adjusted the cooling temperature corresponding to the living room area to 25°C, then the device state prompt information generated based on the spatial semantic information and the device state can be "The air conditioner has adjusted the cooling temperature of the living room to 25°C".

[0070] In the embodiments of the present application, during the process of configuring the binding relationship, there may be a problem that the spatial positioning information in multiple binding relationships is the same or overlapping. For such a problem, when it is detected that the user's current position matches at least two of the spatial positioning information, among the at least two spatial positioning information, the spatial positioning information with the highest priority is determined; the intelligent device control is executed according to the binding relationship corresponding to the spatial positioning information with the highest priority. In this way, the control rule information to be executed preferentially can be judged, and the consistency of the control strategy and the coherence of the user experience can be ensured.

[0071] Specifically, the priority labels corresponding to each of the spatial positioning information can be identified, and the spatial positioning information corresponding to the priority label mapped to the highest priority is determined as the spatial positioning information with the highest priority; or, the spatial positioning information with the most frequent use of the control rule information is determined as the spatial positioning information with the highest priority; or, the control rule information bound to each of the spatial positioning information is voice broadcast; after the voice broadcast, a voice selection instruction is collected, and the spatial positioning information indicated by the voice selection instruction is used as the spatial positioning information with the highest priority.

[0072] Further, during the process of configuring the binding relationship or during the process of using the binding relationship, the priority label can be set for the binding relationship in a voice manner. Different priority labels correspond to different priority levels. For example: the highest priority label corresponds to the highest priority, and the lowest priority label corresponds to the lowest priority.

[0073] Furthermore, the usage of the binding relationship can be recorded so as to determine the most frequently used binding relationship, and then the control rule information with the highest usage frequency can be determined.

[0074] Furthermore, the voice selection instruction is used to select one of the spatial positioning information. When the user's current position matches at least two of the spatial positioning information, the user can be asked which spatial positioning information to use, that is, the user is asked to select which control rule information to use. For example: The position where the user stands is close to the bedside. At this time, two spatial positioning information are matched, namely the window area and the living room area. The control rule information bound to the window area is to control the curtain to open, and the control rule information bound to the living room area is to turn on the TV. The voice broadcasts "Do you want to control the curtain to open or turn on the TV", and the user can say the requirement "Turn on the TV". "Turn on the TV" is the voice selection instruction, which means that the living room area corresponding to "Turn on the TV" has the highest priority.

[0075] In the embodiments of the present application, the control habits and satisfaction of the user at different times, positions, and environmental conditions can be recorded, and the binding relationship can be continuously and dynamically adjusted.

[0076] Specifically, after each intelligent device control is performed according to the binding relationship, the user may not be satisfied with the control result and actively re-controls the intelligent device, which will reduce the user experience. To address this problem, after the intelligent device control is performed according to the binding relationship, when the number of times of performing the same control operation on the intelligent device is detected to be greater than a preset number threshold, new control rule information is generated according to the same control operation, so as to update the original control rule information with the new control rule information.

[0077] For example: Each time the binding relationship can be used to control the air conditioner to adjust the cooling temperature corresponding to the living room area to 26°C. However, after each adjustment, the user has to adjust it again to adjust the cooling temperature corresponding to the living room area to 22°C. If the number of times of this control operation is detected to be greater than the preset number threshold, then the control of the air conditioner to adjust the cooling temperature to 22°C can be updated to the control rule information of this binding relationship. In this way, the next time the air conditioner can be controlled according to the binding relationship to adjust the cooling temperature corresponding to the living room area to 22°C without the user having to adjust it again. Through this method, the dynamic update of the binding relationship can be realized, and then the life cycle management of the full voice scene control rule can be formed.

[0078] Furthermore, before the new control rule information is used to update the original control rule information, a preset update prompt information may be announced by voice. For example, the update prompt information is "New control rule information has been generated. Do you want to set this control rule information as default?" If the collected voice information is confirmation information, the new control rule information is used to update the original control rule information.

[0079] In an embodiment of the present application, after the binding relationship configuration is completed, the user can also actively adjust or query the information in the binding relationship through voice, so that the binding relationship is more in line with the user's expectations, and can avoid the user's dependence on the smart device APP or visual interface, thereby establishing a complete voice interaction closed-loop system, realizing the "speakable, configurable, modifiable, and checkable" space control, greatly improving the configuration efficiency and natural interaction experience.

[0080] Specifically, voice control instructions can be collected; wherein the voice control instructions include: a control operation and a control object; wherein the control object is the spatial semantic information, the control rule information and / or the spatial positioning information; and the control operation is executed for the control object.

[0081] The voice control instruction is a control instruction input by the user in voice mode, and is used to add, delete, modify or query the spatial semantic information, control rule information and / or spatial positioning information in the binding relationship.

[0082] Types of control operations include: add, delete, modify, and query.

[0083] The control object refers to the object that needs to be controlled.

[0084] For example: the user says the voice control command "Please change the air conditioning cooling temperature corresponding to the living room area to 22°C", where the control operation is modification, and the control object is the control rule information bound to the living room area. At this time, the control rule information bound to the living room area can be modified to control the air conditioner to adjust the cooling temperature to 22°C.

[0085] For another example: the user says the voice control command "Please check which positions I have set", where the control operation is query, and the control object is the spatial semantic information in each binding relationship. The spatial semantic information in each binding relationship can be queried and the spatial semantic information in each binding relationship can be broadcasted to the user by voice, so that the user can know which positions are set. This process does not require the help of the APP graphical interface or remote control of the smart device, and the process is simple.

[0086] In the embodiments of the present application, it is possible to monitor whether the user leaves the space area corresponding to the spatial positioning information and does not enter the space area corresponding to other spatial positioning information. If so, after a preset time length, the intelligent device is controlled to enter the energy-saving mode. Among them, when it is detected that the user enters the space area corresponding to other spatial positioning information, the intelligent device control is directly executed according to the binding relationship corresponding to the other spatial positioning information.

[0087] Generally speaking, intelligent devices can be controlled by voice. However, based on the user's voice information, the intelligent device can only know how to operate, but does not know in which area to execute the operation, because the intelligent device cannot understand where the area is. For example, before configuring the binding relationship, if the user says "For the sofa area, adjust the cooling temperature to 26°C", the air conditioner cannot understand where the sofa area is. However, in the embodiments of the present application, by combining spatial perception technology, it is possible to understand where the sofa area is and can also sense whether the user enters the sofa area.

[0088] Through the embodiments of the present application, users can configure any bindings according to their needs, and the configuration process can be achieved through voice, which is convenient for users to operate. There is no need to draw a detailed floor plan of the environment where the intelligent device is located in the corresponding APP of the intelligent device, nor to set area labels in the detailed floor plan and set corresponding device operation modes for the area labels. Through the embodiments of the present application, this over-reliance on manual operations based on the APP can be avoided, enhancing the real-time interactivity and convenience of user control of the device.

[0089] Through the embodiments of the present application, voice commands can be deeply associated with the user's real-time behaviors such as spatial position and path trajectory, realizing a true "voice + space" context interaction, generating subsequent binding relationships for automatic control, and avoiding staying at the basic voice control level, such as "increase the temperature", "turn on the air conditioner", etc.

[0090] Through the embodiments of the present application, through the deep integration of speech recognition and millimeter-wave radar, users can directly assign labels to the current location or trajectory by voice (such as: "sofa", "by the window", "kitchen") and define control behaviors for the location or trajectory (such as "reduce the wind speed here", "increase the wind speed along this route"), thereby forming a binding relationship that can be used to automatically control intelligent devices. Moreover, after the binding relationship is configured, control rules can be added, revoked (deleted), modified, and queried by voice. When using the binding relationship, the millimeter-wave radar can be combined to continuously sense the user's location in real time, enabling instant scene matching and automatic control of intelligent devices, getting rid of the strong dependence of users on the APP, enabling users to truly complete spatial behavior definition and personalized scene setting through natural language, and subsequent eliminating the trouble caused by the need for users to use voice to control intelligent devices every time, greatly improving the interaction efficiency and user experience, and achieving a fundamental leap from command control to spatial semantic drive.

[0091] Through the embodiments of the present application, all user space positions and user movement trajectories set by voice are based on the millimeter-wave radar to achieve real-time perception. As long as the user enters the corresponding position or trajectory, the corresponding control strategy can be automatically recognized and triggered without the user having to issue another command, thus realizing a truly "say once, long-term effective, real-time response" spatial interactive control experience.

[0092] The embodiments of the present application also provide an air conditioner that applies the above intelligent device control method.

[0093] The embodiments of the present application also provide a control device for an intelligent device. As Figure 4 shown, it is a structural diagram of a control device for an intelligent device according to an embodiment of the present application.

[0094] The control device for the intelligent device includes:

[0095] An acquisition module 410, configured to set spatial semantic information and control rule information in a voice manner.

[0096] A determination module 420, configured to determine the spatial positioning information corresponding to the spatial semantic information.

[0097] A binding module 430, configured to bind the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship.

[0098] A control module 440, configured to execute intelligent device control according to the binding relationship when it is detected that the user's current position matches the spatial positioning information.

[0099] The functions of the device described in the embodiments of the present application have been described in the above method embodiments. Therefore, for the details not described in the description of this embodiment, reference may be made to the relevant descriptions in the foregoing embodiments, and no further elaboration will be provided here.

[0100] The embodiments of the present application further provide a control device for an intelligent device, as Figure 5 shown, which is a structural diagram of a control device for an intelligent device according to an embodiment of the present application.

[0101] The control device for the intelligent device includes: a processor 510, a communication interface 520, a memory 530, and a communication bus 540. Among them, the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540.

[0102] The memory 530 is used to store computer programs.

[0103] In an embodiment of the present application, when the processor 510 is used to execute the program stored on the memory 530, it implements the control method for the intelligent device provided in any of the foregoing method embodiments, including: setting spatial semantic information and control rule information in a voice manner; determining the spatial positioning information corresponding to the spatial semantic information; binding the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship; and when it is detected that the current position of the user matches the spatial positioning information, performing intelligent device control according to the binding relationship.

[0104] Among them, the spatial semantic information is used to indicate a spatial position or a movement trajectory; the determining the spatial positioning information corresponding to the spatial semantic information includes: when the spatial semantic information is used to indicate a spatial position, positioning the user's spatial position when the spatial semantic position is set in a voice manner, and determining the position information of a preset first spatial area centered on the user's spatial position as the spatial positioning information; when the spatial semantic information is used to indicate a movement trajectory, tracking the user's movement trajectory after the spatial semantic position is set in a voice manner, and determining the position information of a preset second spatial area with the user's movement trajectory as the midline as the spatial positioning information.

[0105] Among them, the performing intelligent device control according to the binding relationship includes: in the binding relationship, reading the control rule information; where the types of the control rule information include a first type and a second type; when the control rule information is of the first type, controlling the intelligent device to execute the behavior instruction in the control rule information according to the spatial positioning information; when the control rule information is of the second type, controlling the intelligent device to generate a user status prompt information according to the spatial semantic information and the prompt information in the control rule information and controlling the intelligent device to perform voice broadcast.

[0106] Among them, when it is monitored that the user's current location matches the spatial positioning information, performing intelligent device control according to the binding relationship includes: when it is monitored that the user's current location matches at least two pieces of the spatial positioning information, determining the spatial positioning information with the highest priority among the at least two pieces of the spatial positioning information; and performing intelligent device control according to the binding relationship corresponding to the spatial positioning information with the highest priority.

[0107] Among them, determining the spatial positioning information with the highest priority includes: identifying the priority tags respectively corresponding to each piece of the spatial positioning information, and determining the spatial positioning information corresponding to the priority tag mapped by the highest priority as the spatial positioning information with the highest priority; or determining the spatial positioning information with the most frequent use of the control rule information as the spatial positioning information with the highest priority; or voice broadcasting the control rule information respectively bound to each piece of the spatial positioning information; after the voice broadcasting, collecting a voice selection instruction, and using the spatial positioning information indicated by the voice selection instruction as the spatial positioning information with the highest priority.

[0108] Among them, the method further includes: after performing intelligent device control according to the binding relationship, when it is detected that the number of times of performing the same control operation on the intelligent device is greater than a preset number threshold, generating new control rule information according to the same control operation, so as to update the original control rule information with the new control rule information.

[0109] Among them, after binding the spatial semantic information, the control rule information, and the spatial positioning information, it further includes: collecting a voice control instruction; where the voice control instruction includes: a control operation and a control object; where the control object is the spatial semantic information, the control rule information, and / or the spatial positioning information; and performing the control operation on the control object.

[0110] The embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the control method of the intelligent device provided in any one of the foregoing method embodiments are implemented. Since the control method of the intelligent device has been described in detail above, for the parts not described in detail in this embodiment, reference may be made to the relevant descriptions in the foregoing embodiments, and details are not repeated here.

[0111] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0112] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the related technology can be embodied in the form of a software product, and this computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0113] It should be understood that the terms used in this document are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" as used in this document may also represent the plural form. The terms "include", "comprise", "contain", and "have" are inclusive and therefore specify the presence of the stated features, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components, and / or their combinations. The method steps, processes, and operations described in this document are not to be construed as necessarily requiring them to be executed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps can be used.

[0114] The above description is only the specific implementation manner of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application will not be limited to these embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A control method for an intelligent device, characterized in that, including: setting spatial semantic information and control rule information in a voice manner; determining spatial positioning information corresponding to the spatial semantic information; binding the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship; when it is detected that the user's current position matches the spatial positioning information, performing intelligent device control according to the binding relationship.

2. The method according to claim 1, wherein: the spatial semantic information is used to indicate a spatial position or a movement trajectory; the determining the spatial positioning information corresponding to the spatial semantic information includes: when the spatial semantic information is used to indicate a spatial position, locating the user's spatial position when the spatial semantic position is set in a voice manner, and determining the position information of a preset first spatial area centered on the user's spatial position as the spatial positioning information; when the spatial semantic information is used to indicate a movement trajectory, tracking the user's movement trajectory after the spatial semantic position is set in a voice manner, and determining the position information of a preset second spatial area with the user's movement trajectory as the midline as the spatial positioning information.

3. The method according to claim 1, wherein The performing intelligent device control according to the binding relationship includes: in the binding relationship, reading the control rule information; wherein, the types of the control rule information include a first type and a second type; when the control rule information is of the first type, controlling the intelligent device to execute the behavior instruction in the control rule information according to the spatial positioning information; when the control rule information is of the second type, controlling the intelligent device to generate user status prompt information according to the spatial semantic information and the prompt information in the control rule information and controlling the intelligent device to perform voice broadcast.

4. The method according to claim 1, wherein The performing intelligent device control according to the binding relationship when it is detected that the user's current position matches the spatial positioning information includes: when it is detected that the user's current position matches at least two of the spatial positioning information, determining the spatial positioning information with the highest priority among the at least two spatial positioning information; performing intelligent device control according to the binding relationship corresponding to the spatial positioning information with the highest priority.

5. The method according to claim 4, characterized in that, The determining the spatial positioning information with the highest priority includes: identifying the priority labels respectively corresponding to each spatial positioning information, and determining the spatial positioning information corresponding to the priority label mapped by the highest priority as the spatial positioning information with the highest priority; or, determining the spatial positioning information with the most frequent use of the control rule information as the spatial positioning information with the highest priority; or, voice-broadcasting the control rule information respectively bound to each spatial positioning information; after the voice broadcast, collecting a voice selection instruction, and using the spatial positioning information indicated by the voice selection instruction as the spatial positioning information with the highest priority.

6. The method according to claim 1, characterized in that, The method further includes: After performing the intelligent device control according to the binding relationship, in the case where the number of times of performing the same control operation on the intelligent device is detected to be greater than a preset number threshold, new control rule information is generated according to the same control operation, so as to update the original control rule information with the new control rule information.

7. The method according to claim 1, characterized in that After binding the spatial semantic information, the control rule information, and the spatial positioning information, it further includes: Collecting a voice control instruction; wherein, the voice control instruction includes: a control operation and a control object; wherein, the control object is the spatial semantic information, the control rule information, and / or the spatial positioning information; Performing the control operation on the control object.

8. A control device for an intelligent device, characterized in that, It includes: A collection module, configured to set the spatial semantic information and the control rule information in a voice manner; A determination module, configured to determine the spatial positioning information corresponding to the spatial semantic information; A binding module, configured to bind the spatial semantic information, the control rule information, and the spatial positioning information to form a binding relationship; A control module, configured to perform intelligent device control according to the binding relationship when it is detected that the user's current position matches the spatial positioning information.

9. An air conditioner, characterized in that, The air conditioner applies the control method of the intelligent device according to any one of claims 1-7.

10. A control device for an intelligent device, characterized in that, It includes: At least one communication interface; At least one bus connected to the at least one communication interface; At least one processor connected to the at least one bus; At least one memory connected to the at least one bus, wherein the processor is configured to: execute the control program of the intelligent device stored in the memory to implement the control method of the intelligent device according to any one of claims 1-7.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed, the control method of the intelligent device according to any one of claims 1-7 is implemented.

Images