Smart scene control method and system and electronic equipment
By analyzing user historical control data to generate adaptive control commands, the fuzzy problem of voice control in smart devices is solved, the user experience and control accuracy is improved, and adaptive control is suitable for new devices.
Patent Information
- Application Number
- CN202310611874.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2024-11-26
Smart Images

Figure CN119028338A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of smart life, and in particular, to a control method, system and electronic device for a smart scene. Background Art
[0002] In the application fields of smart life or whole-house intelligence, users can control smart devices through voice commands. Usually, the voice commands input by users are often vague; for example, in the voice control air-conditioning scenario, the voice control corpus frequently used by users may include "adjust the air-conditioning temperature a little higher", "adjust the air-conditioning temperature a little lower", "adjust the air-conditioning temperature to the maximum", etc. At present, the recognition and control of such fuzzy control intentions of users by systems such as smart home control are based on the functional range and functional accuracy of the controlled smart devices. However, considering the different habits of different users, this control method may be quite different from the user's habitual expectations, resulting in large differences in experience for different users.
[0003] Therefore, how to improve the control intelligence of smart devices in smart scenarios is of great research significance. Summary of the invention
[0004] The embodiments of the present application provide a smart scene control method, system and electronic device, which are used to realize adaptive control of smart devices in the scenario of controlling smart devices by voice, thereby improving the user experience of controlling smart devices by voice.
[0005] In the first aspect, the embodiment of the present application provides a method for controlling a smart scene. In the method, the voice control command input by the user is analyzed to determine the controlled smart device and the user's control intention; the historical control data associated with the controlled smart device by the user is obtained; according to the historical control data, a device control command corresponding to the user's control intention is generated; and based on the device control command, the controlled smart device is controlled.
[0006] Through this method, based on the user's usage habits analyzed from historical control data, it is possible to adaptively generate device control commands based on the user's usage habits and user control intentions. In this way, in the scenario where the user performs fuzzy voice control, through this method, it is not limited to the self-control of the controlled smart device, and adaptive control can be achieved, thereby improving the control matching degree and control intelligence of the smart device, improving the control efficiency, and thus improving the user experience.
[0007] In some possible embodiments, the controlling of the controlled smart device based on the device control command includes: controlling the controlled smart device based on the first control mode indicated by the device control command; wherein the first control mode is different from the second control mode specified by the factory for the controlled smart device. For example, the second control mode specified by the factory for the controlled smart device may be the user's control of the smart device through a remote control, such as when the user controls the air conditioner through a remote control, the temperature changes by 1 degree Celsius each time a button is pressed. However, in this method, when the user's control intention is to change the temperature by 2 degrees Celsius based on historical control data, the first control mode may be to directly adjust the temperature by 2 degrees Celsius; it can be understood that the second control mode in this scenario requires two controls. Therefore, this embodiment can improve control efficiency, and thus improve the user experience.
[0008] In one possible scenario, the user control intent is used to indicate control of the basic functions of the controlled smart device. The generating of the device control command corresponding to the user intent according to the historical control data includes: counting N pieces of data information corresponding to N control values from the historical control data, where N is a positive integer; determining a target control value from the N control values according to the N pieces of data information; and generating the device control command according to the target control value. In this scenario, the user's usage habits can be analyzed and obtained through statistics and analysis of the historical control data, so that the device control command can be generated based on the user's usage habits, which can improve the control matching degree.
[0009] In some possible embodiments, the controlled smart device is an air conditioner, the basic function includes temperature, and the target control value is a maximum temperature, a minimum temperature, or a temperature adjustment step; or, the controlled smart device is a speaker, the basic function includes sound, and the target control value is a maximum sound, mute, or a sound adjustment step.
[0010] In some possible embodiments, the controlled smart device is an air conditioner, the basic function includes temperature, the maximum temperature is different from the nominal maximum temperature of the air conditioner, the minimum temperature is different from the nominal minimum temperature of the air conditioner, and the temperature adjustment step is different from the nominal temperature adjustment step of the air conditioner. The controlled smart device is a speaker, the basic function includes sound, the maximum sound value is different from the nominal maximum sound value of the speaker, and the sound adjustment step is different from the nominal sound adjustment step of the speaker. Through this embodiment, it can be obtained that the control method of the device control command can simulate the user's usage habits without being limited to the function settings of the smart device in this application. In this way, through this method, the device control command can be controlled based on the user's commonly used function range, the user's commonly used adjustment accuracy, etc., which can improve the control efficiency and control matching.
[0011] In another possible scenario, the user control intention is used to indicate the control of the combination function of the controlled smart device; the combination function consists of M basic functions and corresponding M control values, where M is a positive integer. The generating of a device control command corresponding to the user intention based on the historical control data includes: obtaining L basic functions and corresponding L control values included in the combination function of at least one similar device from the historical control data, where L is a positive integer. In this scenario, the historical combination functions commonly used by users can be analyzed based on the historical control data, so that the historical combination functions can be simulated to generate device control commands for the controlled smart device. This scenario may include the following methods:
[0012] Mode 1: Determine the first basic function and the first control value corresponding to it in the device control command according to the first basic function and the first control value corresponding to it in the L basic functions; wherein the first control value is included in the factory nominal function range of the first basic function of the controlled intelligent device. In this mode, when the controlled intelligent device can realize the basic functions and the corresponding control values included in the historical combination function, the device control command can directly use the control value set in the historical combination function, thereby realizing the same control.
[0013] Method 2: Determine the second basic function and the corresponding third control value in the device control command according to the second basic function in the L basic functions and the corresponding second control value; wherein the second control value is not included in the factory nominal function range of the second basic function of the controlled intelligent device, and the first absolute difference between the third control value and the second control value is less than the second absolute difference; the second absolute difference is the absolute difference between the fourth control value and the second control value, and the fourth control value is any control value except the third control value within the factory nominal function range of the second basic function. In this method, when the controlled intelligent device can realize the basic function included in the historical combination function but cannot meet the control value corresponding to the basic function, the device control instruction can use the value within the function range that is closest to the control value set in the historical combination function, so as to realize similar control.
[0014] In addition, it can be understood that when the controlled smart device cannot implement the basic function included in the historical combination function, the device control instruction can ignore the control of the basic function, and can also send a prompt message to the user to inform the user that the controlled smart device cannot implement the basic function.
[0015] In some possible embodiments, the controlled smart device is an air conditioner, and the combined function includes at least one of temperature and its corresponding temperature value, wind speed and its corresponding wind speed level, wind swing direction and its set placement direction.
[0016] In some possible embodiments, the combination function indicated by the device control command is different from the nominal combination function of the air conditioner; or the air conditioner does not have the combination function when it leaves the factory. Through this embodiment, a combination function mode different from the combination function mode that the controlled smart device itself can provide can be simulated, or a combination function mode that the controlled smart device itself does not support can be simulated, which can improve the control intelligence of the smart device.
[0017] In some possible embodiments, before analyzing the voice control command input by the user to determine the controlled smart device and the user's control intention, the method further includes: detecting a function of turning on the adaptive control. In some possible embodiments, detecting the function of turning on the adaptive control includes: detecting a switch control for turning on the adaptive control on the first interface. Through this embodiment, the adaptive control function can be flexibly provided to the user, thereby meeting the user's needs for more scenarios.
[0018] In some possible embodiments, the associated historical control data includes: historical control data of the controlled smart device, historical control data of devices of the same type as the controlled smart device. In this embodiment, based on the historical control data of the controlled smart device itself, and / or the historical control data of old devices with the same or similar functions as the controlled smart device, the user's usage habits of the smart device can be analyzed, so that adaptive control based on the user's usage habits can be achieved, and the control intelligence of the smart device can be improved. Exemplarily, the controlled smart device can be an unfamiliar device such as a new device or a device shared by others. Through the method provided in the present application, it is possible to simulate the control of the unfamiliar device by referring to the user's control habits of the old device, thereby improving the control efficiency and control matching of the smart device, and improving the user's usage experience.
[0019] In the second aspect, the present application also provides a control system for a smart scene. The system may include at least an electronic device and a controlled smart device. Among them, the electronic device is used to receive a voice control instruction input by a user; the electronic device is also used to analyze the voice control instruction to determine the controlled smart device and the user's control intention; obtain the historical control data associated with the controlled smart device by the user; generate a device control command corresponding to the user's control intention according to the historical control data; send the device control command to the controlled smart device; the controlled smart device is used to receive the device control command; and control according to the device control command. For example, the electronic device can be one, such as a mobile phone, a tablet computer, and other devices that have both voice input capabilities and processing capabilities. For another example, the electronic device can also be multiple, such as a speaker and other devices with voice input capabilities, which are used to receive voice control instructions input by the user, and mobile phones, tablet computers and other devices with processing capabilities, which are used to process voice control instructions and generate device control commands.
[0020] In a third aspect, the present application further provides an electronic device, the electronic device comprising a plurality of functional modules; the plurality of functional modules interact with each other to implement the method performed by the electronic device in any of the above aspects and its respective embodiments. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementations.
[0021] In a fourth aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the method executed by the electronic device in any of the above aspects and its various embodiments.
[0022] In a fifth aspect, the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes any one of the above aspects and each possible method of designing an electronic device to execute the method.
[0023] In a sixth aspect, the present application provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute any of the above aspects and possible methods of designing an electronic device.
[0024] In the seventh aspect, an embodiment of the present application also provides a graphical user interface on an electronic device, which electronic device has a display screen, one or more memories, and one or more processors, wherein the one or more processors are used to execute one or more computer programs stored in the one or more memories, and the graphical user interface includes a graphical user interface displayed when the electronic device executes any of the above aspects and their possible designs.
[0025] In an eighth aspect, the present application also provides a chip, which is used to read a computer program stored in a memory and execute any of the above aspects and possible methods for designing electronic devices to execute.
[0026] In a ninth aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement any of the above aspects and possible methods for designing electronic devices to execute. In one possible design, the chip system also includes a memory, which is used to store programs and data necessary for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.
[0027] For the beneficial effects of any aspect from the second to the ninth aspect and its possible designs, please refer to the beneficial effects of the various possible designs in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1a It is a schematic diagram of an interface of a control method of a smart scene;
[0029] Figure 1b It is a control scenario for a smart scenario;
[0030] Figure 2 A schematic diagram of a possible hardware structure of an electronic device provided in an embodiment of the present application;
[0031] Figure 3 A software structure block diagram of an electronic device provided in an embodiment of the present application;
[0032] Figure 4a One of the flow charts of a control method of a smart scene provided in an embodiment of the present application;
[0033] Figure 4b A second flow chart of a control method for a smart scene provided in an embodiment of the present application;
[0034] Figure 5 One of the interface schematic diagrams of a smart scene control method provided in an embodiment of the present application;
[0035] Figure 6a A third flow chart of a control method for a smart scene provided in an embodiment of the present application;
[0036] Figure 6b A fourth flow chart of a method for controlling a smart scene provided in an embodiment of the present application;
[0037] Figure 7 A second schematic diagram of an interface of a method for controlling a smart scene provided in an embodiment of the present application;
[0038] Figure 8 A fifth flow chart of a method for controlling a smart scene provided in an embodiment of the present application. DETAILED DESCRIPTION
[0039] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0040] The technical solution provided in the embodiments of the present application can be applied to fields such as smart life, and can be specifically applied to application fields related to the Internet of Things, such as whole-house intelligence and smart office. With the development and popularization of smart life technology, users are increasingly using smart scenes (also referred to as "smart scenes", etc.). Based on the convenience of voice control of smart devices, the scene of voice control of smart devices plays a very important role in smart scenes.
[0041] In some embodiments, Figure 1aIt is a control scenario of a smart scene. An APP or process that can receive voice control instructions, such as a voice assistant application (application, APP) or a smart home APP, is installed in the mobile phone. After the user completes the device registration in the mobile phone, he can wake up the voice assistant APP in the mobile phone and enter the voice control instruction. After receiving the voice control instruction, the voice assistant APP can parse the user's original intention, such as which device the user wants to operate and what control he wants to perform. The cloud server can receive the user's original intention sent by the voice assistant APP, and generate the corresponding device control command according to the functional capability range and accuracy of the controlled smart device. For example, if the user's original intention is "adjust the air conditioner temperature to the maximum", the generated device control command can be to set the temperature of the air conditioner to the maximum temperature. For example, if the user's original intention is "adjust the sound of the speaker a little higher", the generated device control command can be based on the volume adjustment accuracy of the speaker, and increase the accuracy of one step. Finally, the cloud server sends the device control command to the controlled smart device to realize voice control of the controlled smart device. However, due to the different behavioral habits of different users, and the different functional capability range and accuracy of the controlled smart devices, the experience of different users is somewhat different, which may cause some users to be unaccustomed to use.
[0042] In other embodiments, a time of flight (TOF) sensor can be added to the smart home control system, and the TOF sensor can dynamically detect user information related to the control panel; then, the screen on or off control of the control panel and voice control of smart devices in the smart home control system can be implemented according to the detected user information. However, the voice control method based on the sensor has the problem of limited usage scenarios, and can only be used in front of a terminal with a sensor, and cannot be used on a terminal device such as a mobile phone or a tablet computer that does not have a TOF sensor.
[0043] In some further embodiments, Figure 1b It is another control scenario of smart scene. Figure 1b In the interface 11 shown, the user can also arrange the smart scene on the mobile phone display interface. By arranging the smart scene, the user can set the parameters for controlling the smart device in advance, and then trigger the execution scene by voice control. However, every time the user uses a newly registered device or a smart device shared by others, the user needs to reset the smart scene for the new device, and every time the user adjusts the parameters, the user needs to perform user operations on the interface 11, which makes the user operation more cumbersome and the user experience is not intelligent.
[0044] In some other embodiments, the user can also control the smart device through a traditional remote control. Taking the smart device as an air conditioner as an example, when the user adjusts the temperature of the air conditioner, he often presses "△" on the remote control to increase the temperature of the air conditioner, or presses "▽" to decrease the temperature of the air conditioner; and each time the button is pressed, the temperature is generally adjusted by 1 degree Celsius (℃). It can be understood that when the user wants to increase or decrease the temperature difference by more than 1 degree Celsius, he needs to press the button multiple times to achieve the control purpose.
[0045] It can be understood that in the above various embodiments, the control of the smart device is generally implemented based on the factory-nominal functional capability range and adjustment accuracy of the smart device. For example, the factory-nominal functional capability range of the air conditioner is 16°C to 30°C, and the adjustment accuracy is 1°C. When the air conditioner is adjusted through the above various embodiments, the maximum adjustable temperature is 30°C, the minimum adjustable temperature is 16°C, and the adjustment step length during the adjustment process is 1°C.
[0046] In view of this, an embodiment of the present application provides a control method for a smart scene. The method provides a technical solution that can improve the intelligence of the user's voice control of smart devices. When the user performs voice control on the smart device, control instructions that match the user's habit characteristics can be adaptively generated for the user, so that the control result of the smart device can be more in line with the user's behavior habits, the user experience can be guaranteed, and targeted smart device control can be performed for different users to improve the intelligence of the control of the smart device. In addition, for new smart devices or smart devices shared by others, the method can also realize the user's adaptive control of unfamiliar devices, so that even if the user's voice control of unfamiliar devices, it can better meet the user's behavior habits and ensure the user experience.
[0047] This solution can be applied to smart home control systems. In one possible scenario, the smart home control system may include smart devices; wherein the smart devices may include, but are not limited to: air conditioners, speakers, desk lamps, refrigerators, etc. In this scenario, the smart devices may have voice control capabilities and processing capabilities. For example, it can be realized that the smart device receives the user's voice control instructions through a voice assistant APP, and processes based on the voice control instructions to generate device control commands; wherein the device control commands can be used to control the functions of the smart home. It can be understood that the voice control capability is used to indicate that the device can receive voice commands input by the user, and the voice commands can be used to control the device.
[0048] In another possible scenario, the smart home control system may include smart devices (which may also be understood as "controlled smart devices" in the following embodiments) and may also include voice control devices; wherein the voice control devices may be, for example, terminal devices such as mobile phones and tablet computers, or devices such as smart speakers. In this scenario, the voice control device may be used to receive voice control instructions input by the user. Also, when the voice control device has processing capabilities, the voice control device may process based on the voice control instructions to generate device control commands, for example, when the voice control device is a mobile phone; or, when the smart device has processing capabilities, the smart device may receive the voice control instructions and process based on the voice control instructions to generate device control commands.
[0049] In another possible scenario, the smart home control system may include smart devices, cloud servers, etc., wherein the cloud server may be used to process based on voice control instructions and generate device control commands. It is understandable that in this scenario, when the smart device has voice control capabilities, the voice control instructions may be received by the smart device; when the smart device does not have voice control capabilities, the smart home control system may also include a voice control device.
[0050] It should be noted that the embodiments of the present application are not limited to the various scenarios introduced above. For example, the number and types of smart devices included in the smart home control system are not limited, and the smart home control system may include voice control devices, terminal devices, cloud servers, smart devices, etc., and the number and types of terminal devices included in the smart home control system are not limited.
[0051] The control method of the smart scene provided in the embodiment of the present application can be applicable to the system, and the system can include the various scene contents as described above. For example, the system can include smart devices, or the system can also include smart devices and voice control devices, or the system can also include smart devices and cloud servers, etc.
[0052] The control method of the smart scene provided in the embodiment of the present application can also be applied to electronic devices. Exemplarily, the electronic device can be the smart device in the aforementioned introduction scene content, and the smart device can be, for example, a smart home device such as a TV, a refrigerator, etc.; it can also be a portable electronic device such as a mobile phone, a tablet computer, a laptop computer, etc., which can receive voice control instructions and generate device control commands based on voice control instructions; or, it can also be a wearable device such as a watch or a bracelet; or, it can also be a car-mounted device, etc., or, it can also be a virtual reality (VR) device, an augmented reality (AR) device, a mixed reality (MR) device, etc. In short, the embodiment of the present application does not limit the specific type of electronic device. In some examples, the control method of the smart scene provided in the embodiment of the present application can be a function, service or application in an electronic device. The application can be an application that comes with the electronic device, or an application downloaded from the network, such as a smart life APP.
[0053] In summary, the control method of the smart scene provided in the embodiment of the present application can be completed by a single device or by the system.
[0054] The electronic devices to which the embodiments of the present application can be applied include but are not limited to electronic devices equipped with Or electronic devices with other operating systems. The electronic device may be, for example, the intelligent device introduced in the foregoing embodiment, or the terminal device introduced in the foregoing embodiment.
[0055] Figure 2 Schematic diagram of a possible hardware structure of an electronic device is shown. The electronic device 200 includes: a radio frequency (RF) circuit 210, a power supply 220, a processor 230, a memory 240, an input unit 250, a display unit 260, an audio circuit 270, a communication interface 280, and a Wi-Fi module 290. Those skilled in the art will understand that Figure 2 The hardware structure of the electronic device 200 shown in the figure does not constitute a limitation on the electronic device 200. The electronic device 200 provided in the embodiment of the present application may include more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 2 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0056] Combine the following Figure 2 The components of the electronic device 200 are described in detail:
[0057] The RF circuit 210 can be used for receiving and sending data during communication or calls. In particular, after receiving downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing; in addition, the uplink data to be sent is sent to the base station. Generally, the RF circuit 210 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc.
[0058] In addition, the RF circuit 210 can also communicate with other devices through a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.
[0059] Wi-Fi technology belongs to short-range wireless transmission technology. The electronic device 200 can connect to an access point (AP) through a Wi-Fi module 290 to access the data network. The Wi-Fi module 290 can be used for receiving and sending data during the communication process. In an embodiment of the present application, when the electronic device 200 is a mobile phone, the mobile phone can send device control commands to the controlled smart device through the Wi-Fi module 290. In another possible embodiment, when the electronic device 200 is a smart speaker, the smart speaker can send the voice control instructions input by the user or the original user intention parsed based on the voice control instructions to the mobile phone through the Wi-Fi module 290.
[0060] The electronic device 200 can be physically connected to other devices through the communication interface 280. Optionally, the communication interface 280 is connected to the communication interface of the other device through a cable to achieve data transmission between the electronic device 200 and the other device.
[0061] The electronic device 200 can also implement communication services and interact with other electronic devices, so the electronic device 200 needs to have a data transmission function, that is, the electronic device 200 needs to include a communication module. Figure 2 Communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280 are shown, but it is understandable that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exist in the electronic device 200 to perform data transmission.
[0062] For example, when the electronic device 200 is a mobile phone, the electronic device 200 may include the RF circuit 210, and may also include the Wi-Fi module 290, or may include a Bluetooth module ( Figure 2 When the electronic device 200 is a smart home device, the electronic device 200 may include the Wi-Fi module 290, or may include a Bluetooth module ( Figure 2 When the electronic device 200 is a tablet computer, the electronic device 200 may include the Wi-Fi module, or may include a Bluetooth module ( Figure 2 not shown).
[0063] The memory 240 can be used to store software programs and modules. The processor 230 executes various functional applications and data processing of the electronic device 200 by running the software programs and modules stored in the memory 240. Optionally, the memory 240 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including software programs or modules corresponding to the kernel layer, system layer, application framework layer, and application layer, etc.).
[0064] In addition, the memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. In the embodiment of the present application, the memory 240 may store historical control data; wherein the historical control data may include but is not limited to being obtained from the following data sources: historical control data of old functionally similar devices of the same type, historical control data of old functionally different devices of the same type, historical control data of currently controlled smart devices, etc. It can be understood that the historical control data can be used to infer the user's intention of voice control in combination with the user's historical behavior habits.
[0065] The input unit 250 can be used to receive editing operations of various types of data objects such as digital or character information input by the user, and generate key signal input related to user settings and function control of the electronic device 200. Optionally, the input unit 250 may include a touch panel 251 and other input devices 252.
[0066] The touch panel 251, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch panel 251), and drive the corresponding connection device according to a pre-set program. In the embodiment of the present application, the touch panel 251 can collect user operations on or near it; for example, when the electronic device 200 is a mobile phone, the user operations can be used for the user to register a new device on the mobile phone interface, or receive devices shared by others.
[0067] Optionally, the other input devices 252 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, etc.
[0068] The display unit 260 can be used to display information input by the user or information provided to the user and various menus of the electronic device 200. The display unit 260 is the display system of the electronic device 200, which is used to present an interface and realize human-computer interaction. The display unit 260 may include a display panel 261. Optionally, the display panel 261 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In an embodiment of the present application, the display unit 260 can be used to display a display interface related to a smart scene for the user, for example, the control results of the smart scene can be displayed, etc., for the user to consult.
[0069] The processor 230 is the control center of the electronic device 200, and uses various interfaces and lines to connect various components, and executes various functions and processes data of the electronic device 200 by running or executing software programs and / or modules stored in the memory 240, and calling data stored in the memory 240, so as to realize various services based on the electronic device 200. In the embodiment of the present application, the processor 230 can be used to implement the method provided in the embodiment of the present application.
[0070] The electronic device 200 also includes a power supply 220 (such as a battery) for supplying power to various components. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.
[0071] like Figure 2 As shown, the electronic device 200 also includes an audio circuit 270, a microphone 271 and a speaker 272, which can provide an audio interface between the user and the electronic device 200. The audio circuit 270 can be used to convert audio data into a signal that can be recognized by the speaker 272, and transmit the signal to the speaker 272, which is converted by the speaker 272 into a sound signal for output. The microphone 271 is used to collect external sound signals (such as the sound of a person speaking, or other sounds, etc.), and convert the collected external sound signals into signals that can be recognized by the audio circuit 270, and send them to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 to send it to, for example, another electronic device, or output the audio data to the memory 240 for subsequent further processing. In the embodiment of the present application, the speaker 272 can be used to execute a smart scene that needs to output a sound signal. For example, the electronic device 200 can also feedback the control result through the speaker 272, and the control result can include, for example: "The air conditioner has been controlled according to your requirements", "The current volume of the speaker is high, which may damage your ears. Do you want to lower the volume?". The microphone 271 may be used to receive voice control instructions input by the user, for example, the microphone 271 may collect user input such as “adjust the air conditioner temperature to the maximum” or “turn up the speaker volume”.
[0072] Although not shown, the electronic device 200 may also include a camera, at least one sensor, etc., which will not be described in detail herein. The at least one sensor may include but is not limited to a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.
[0073] The operating system (OS) involved in the embodiment of the present application is the most basic system software running on the electronic device 200. The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an operating system adopting a layered architecture as an example to illustrate the software structure of the electronic device 200.
[0074] Figure 3 The software structure block diagram of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 3As shown, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.
[0075] The application layer can include a series of application packages. Figure 3 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include, for example, wireless local area network (WLAN), music, calls, Bluetooth, videos, etc.
[0076] In one possible implementation, applications can be developed using the Java language by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the bottom layer of the operating system (such as the hardware layer, kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.
[0077] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0078] The activity manager is used to manage the life cycle of each application and provide common navigation back functions, providing an interactive interface for all program windows.
[0079] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0080] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0081] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).
[0082] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0083] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0084] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0085] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0086] The system library may include multiple functional modules, such as a surface manager, a media framework, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.
[0087] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0088] The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media framework can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0089] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0090] A 2D graphics engine is a drawing engine for 2D drawings.
[0091] In some embodiments, a three-dimensional graphics processing library may be used to draw a three-dimensional motion trajectory image, and a two-dimensional graphics engine may be used to draw a two-dimensional motion trajectory image.
[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0093] The hardware layer can include various types of sensors, such as accelerometers, gravity sensors, touch sensors, etc.
[0094] Usually, the electronic device 200 can run multiple applications at the same time. In a simpler case, one application can correspond to one process, and in a more complex case, one application can correspond to multiple processes. Each process has a process number (process ID).
[0095] It should be understood that in the embodiments of the present application, "at least one of the following" or similar expressions refer to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple. "Multiple" refers to two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship.
[0096] In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.
[0097] It should be understood that the hardware structure of the electronic device can be as follows Figure 2 As shown, the software system architecture can be Figure 3 As shown, the software programs and / or modules corresponding to the software system architecture in the electronic device can be stored in the memory 240, and the processor 230 can run the software programs and applications stored in the memory 240 to execute the process of a smart scene control method provided in an embodiment of the present application.
[0098] In order to facilitate understanding of a control method of a smart scene provided by this application, the following Figures 4a to 6a The content shown in introduces the implementation process of the method provided by this application.
[0099] The embodiments of the present application are applicable to application scenarios such as smart life. In a smart home control system, when a user uses a newly registered smart device or a smart device shared by others (also understood as a "strange device"), the user can perform intelligent control on the strange device based on historical control records, so that the control of the strange device can be achieved by learning the user's control habits from historical control records, so that the control result can be more in line with the user's actual behavior habits and ensure user experience. Alternatively, when a user performs voice control on a smart device, intelligent control can also be achieved based on historical control records, so that the control result can be more accurately in line with the user's recent behavior habits; for example, the user's control habits for the air conditioner may change with changes in factors such as the environment and time.
[0100] First, the processing effect of the method provided by the embodiment of the present application is described through the following multiple application scenarios. It can be understood that the embodiment of the present application is not limited to the following application scenarios.
[0101] See also Figure 4a , is a flow chart of a control method of a smart scene provided in an embodiment of the present application, and the flow chart can be applied to a smart home control system. In some possible embodiments, the smart home control system can include at least a terminal device and a smart device. In some other possible embodiments, the smart home control system can also include at least a terminal device, a cloud server, and a smart device. It can be understood that in executing Figure 4a Before the process shown, the smart device has completed device registration and account login, or received device sharing, etc. The process may include the following steps:
[0102] Step 401: The terminal device receives a voice control instruction input by the user. For example, when the smart device is an air conditioner, the voice control instruction may include but is not limited to: "Adjust the temperature of air conditioner B to the maximum", "Adjust the temperature of air conditioner B a little higher"; when the smart device is a speaker, the voice control instruction may include but is not limited to: "Turn up the volume of the speaker a little", "Turn down the volume of the speaker to the minimum". It can be understood that the terminal device is a device capable of receiving voice control instructions, for example, the terminal device may be a mobile phone, and a voice assistant APP may be installed in the mobile phone; for another example, the terminal device may also be a smart speaker, and a voice assistant application or process may also be pre-installed in the smart speaker.
[0103] Step 402: The terminal device analyzes the original intention of the user based on the voice control instruction. In some possible embodiments, when the terminal device has processing capabilities, it can perform voice recognition and semantic analysis on the voice control instruction to analyze the original intention of the user. For example, the original intention of the user corresponding to "adjust the temperature of air conditioner B to the maximum" may include: the controlled smart device is air conditioner B, the controlled function is temperature, and the intention is to adjust it to the maximum. For another example, the original intention of the user corresponding to "turn up the volume of the speaker a little bit" may include: the controlled smart device is a speaker, the controlled function is sound, and the intention is to turn it up a little bit.
[0104] Smart devices generally have one or more basic functions. For example, the basic functions of an air conditioner include temperature, wind speed, and wind direction. With the development of smart devices and the convenience of user control, there may also be a combined function mode composed of one or more basic functions. For example, an air conditioner may have an air conditioner sleep mode, and a desk lamp may have a desk lamp reading mode. Moreover, the combined function mode may also set the control value corresponding to each basic function. In this way, users can quickly control smart devices through the combined function mode. In the embodiment of the present application, in the smart home control system, when the control of the basic function is detected according to the original intention of the user, it can be controlled through Figure 4a The embodiment described realizes the control of the smart scene; when the control of the combined function mode is detected according to the original intention of the user, the following Figure 6a The introduced embodiment realizes the control of smart scenes.
[0105] Optionally, the terminal device can synchronize with the cloud server through the following steps 403a and 403b. In this way, in some possible embodiments, the cloud server can count the control records of multiple terminal devices on the same device, so as to expand the historical control data. For example, the same user account can perform voice control on air conditioner B through a mobile phone and a smart speaker respectively; in this way, the cloud server can receive the control records of air conditioner B synchronized by the mobile phone, and can also receive the control records of air conditioner B synchronized by the smart speaker, so as to summarize the control records of air conditioner B by users through different terminal devices. In other possible embodiments, data synchronization can also be achieved between multiple terminal devices through short-range communication technology. Among them, short-range communication technology can include, but is not limited to: Wi-Fi, Bluetooth, near field communication (NFC), etc.
[0106] Optionally, in step 403a, the terminal device synchronizes the user control record and device information with the cloud server. In some possible embodiments, the terminal device may synchronize the user control record and device information with the cloud server periodically, or may synchronize the control record and device information with the cloud server in response to a trigger event; the trigger event may be, for example, the detection of a new voice control event, the user manually triggering synchronization, etc. The device information may include, for example, a list of devices under the user account, such as the device list may include air conditioner B and a speaker; the device information may also include, but is not limited to, device identification, device function, etc. For example, the function of air conditioner B may include, but is not limited to, temperature, wind speed, and swing direction, etc.
[0107] Optionally, step 403b, the cloud server returns the user control record and device information to the terminal device. In some possible embodiments, the cloud server may return the user control record and device information of the same user account to the terminal device, which may also include the user control record and device information of the same user account on other terminal devices, thereby achieving data synchronization of multiple devices.
[0108] In some optional embodiments, when the terminal device has processing capability, the following steps 404 and the following may be performed: Figure 4b In some other optional embodiments, when the terminal device does not have processing capability or has weak processing capability, the user's original intention may be sent to the cloud server, and the cloud server executes the following steps 404 and the following Figure 4b In the embodiment of the present application, the terminal device generates a device control command as an example for introduction, such as the following steps 404 and the following Figure 4b The content introduced in step 405 in.
[0109] Step 404: The terminal device parses the user control record and device information, and collects statistics on the historical control data based on the device function.
[0110] In some possible embodiments, the data source of the user control record may include but is not limited to: historical control data of old functionally similar devices of the same type, historical control data of the currently controlled smart device, etc. In a possible scenario, the user has an old air conditioner (air conditioner A) and a new air conditioner (air conditioner B); and the user has an old speaker (speaker A) and a new speaker (speaker B). The following Table 1-0 is a possible functional comparison information of functionally similar devices, as follows:
[0111] Table 1-0
[0112] Device Name Function Adjustment range Adjustment accuracy Air Conditioner A temperature 18~30 degrees 1 degree Air Conditioner B temperature 15~31 degrees 0.5 degrees Speaker A sound 100% 10% Speaker B sound 100% 5%
[0113] From the content shown in Table 1-0, based on the similar functions of air conditioner A and air conditioner B, in the smart home control system, the user's control record of air conditioner A can be referred to to realize voice control of air conditioner B. In this way, even if air conditioner B is a newly registered device of the user or a device shared by others, the historical control data of the old device with similar functions can be referred to to realize voice control of air conditioner B, so that the control result of the smart device can be more in line with the user's behavior habits. Alternatively, based on the similar functions of air conditioner A and air conditioner B, in the smart home control system, the user's control record of air conditioner A and the user's historical control record of air conditioner B can be referred to as historical control data to realize voice control of air conditioner B. In this way, through more historical control data, the user's behavior habits can be analyzed more accurately, and the user portrait can be obtained, so that more accurate voice control of smart devices based on the user portrait can be realized.
[0114] In an optional embodiment, the user's behavior habits are analyzed based on historical control data, which can be implemented as a statistical control number method. Taking air conditioner B as an example, the function control of air conditioner B is temperature adjustment; wherein the temperature adjustment method may include a maximum temperature range value and a temperature change accuracy value. In an embodiment of the present application, the historical control data may be statistically analyzed to obtain the user's behavior habits. For example, the following Tables 1-1, 1-2, and 1-3 are possible scenarios of statistical results, as follows:
[0115] Table 1-1
[0116] Temperature range maximum 30 degrees 28 degrees 27 degrees frequency 1 time 2 times 49 times
[0117] Table 1-2
[0118] Temperature range min. 18 degrees 19 degrees 20 degrees frequency 5 times 3 times 45 times
[0119] Table 1-3
[0120] Temperature variation accuracy 1 degree 2 degrees 3 degrees frequency 8 times 65 times 4 times
[0121] The statistical results shown in Table 1-1 to Table 1-3 can reflect the user's behavior habits through the frequency. For example, from Table 1-1, it can be seen that the maximum value of the temperature range with the highest frequency is 27 degrees, which can indicate that the user is accustomed to using 27 degrees as the maximum temperature value of the user's intention; similarly, the user is accustomed to using 20 degrees as the minimum temperature value of the user's intention, and is accustomed to using a temperature change accuracy of 2 degrees as the temperature change step size that the user is accustomed to using. It can be understood that when controlling the controlled smart device, using the temperature change step size that the user is accustomed to using can reduce the user's operations, thereby improving the efficiency of control.
[0122] It should be noted that in the embodiments of the present application, other data information obtained through statistical analysis can also be used to obtain user behavior habits. For example, other data information may include but is not limited to user behavior information, control time information, outdoor temperature information, etc. The present application does not limit the data analysis method. Figure 4a The process shown can realize data analysis based on historical control data in response to user voice control instructions, so that the user's usage habits can be analyzed through the statistical frequency information to better match the user's control intention indicated by the voice control instruction. It can be understood that Figure 4a This is a possible embodiment provided for the present application and is not intended to limit the data analysis method of the present application.
[0123] See also Figure 4b , is another flow chart of a control method of a smart scene provided in an embodiment of the present application. The flow can realize the control process of the smart device and may include the following processes:
[0124] Step 405: The terminal device generates a device control command based on the user's original intention and the data information obtained through statistical analysis.
[0125] For example, in a scenario where the voice control command is "adjust the temperature of air conditioner B to the maximum", the corresponding original user intention may include: the controlled smart device is air conditioner B, the controlled function is temperature, the intention is to adjust it to the maximum; and, based on the statistical results of Table 1-1, the maximum value of the temperature range with the highest number of times is 27 degrees.
[0126] In an optional embodiment, the device control command can take 27 degrees as the target control value. In addition, the terminal device can also feedback the control result to the user through voice reminder and / or interface reminder. Figure 5 , is a display interface diagram of the control results provided by the embodiment of the present application. Figure 5 In the interface 510 shown, in the embodiment of the present application, a prompt can be displayed on the display interface of the mobile phone: According to your historical control habits, the maximum temperature value of air conditioner B has been adjusted to 27 degrees, and the maximum adjustable temperature value of air conditioner B is 31 degrees. If it needs to be adjusted to 31 degrees, please continue to say to me "adjust the maximum temperature of air conditioner B to 31 degrees". At the same time, the mobile phone can also prompt the user with the interface shown in interface 510 through voice playback. Optionally, the reminder method adopted by the terminal device can be based on the method preset by the user, such as only voice reminder method, or voice reminder and interface reminder method; it can also adopt the default setting method, etc., which is not limited in the present application.
[0127] In addition, in Figure 5The reminder interface shown may also include at least control 501, control 502, and control 503; wherein control 501 may be used to increase the temperature, control 502 may be used to decrease the temperature, and control 503 may be used to indicate the maximum adjustable temperature value of air conditioner B. In a possible embodiment, the mobile phone detects a user's click operation on control 501, and in response to the click operation, adjusts the maximum temperature value of the air conditioner B target to 28 degrees, and records the adjustment information. Then, when it is detected that the user's next voice control instruction is a scenario of "adjusting the temperature of air conditioner B to the maximum", the device control command may take 28 degrees as the target control value.
[0128] In another optional embodiment, the device control command can also select the maximum value (MAX) as the target control value from the maximum value of the temperature range with the highest number of times and the maximum adjustable temperature value of air conditioner B. For example, if the maximum adjustable temperature value of air conditioner B is 31 degrees, 31 degrees can be used as the target control value. In addition, in this embodiment, the terminal device can also feedback the control result to the user through voice reminders and / or interface reminders.
[0129] For another example, in the scenario where the voice control command is "turn up the volume of the speaker", the corresponding original intention of the user may include: the controlled smart device is a speaker, the function controlled is sound, and the intention is to turn up a little; and, referring to the statistical results of Table 1-3, the volume change accuracy with the highest number of times is 10%. Based on this, the device control command can take a volume increase of 10% as the target control value. Combined with Table 1-0, the accuracy of speaker A is 10%, and the accuracy of speaker B is 5%. When the user is accustomed to using 10% as the volume adjustment step, when the user uses speaker B, 10% can also be used as the volume adjustment step for control. It can be understood that in this scenario, the target adjustment step of the voice control of the smart device provided in the embodiment of the present application may be different from the actual adjustment step of the device. In addition, the smart device or terminal device can also prompt the user through voice reminders or interface reminders that the volume adjustment step of speaker B can be set to 5%, so that the user can determine whether to update the adjustment step according to the user's intention.
[0130] In some possible embodiments, the terminal device can directly send device control commands to the smart device through short-range communication technology, see the contents introduced in steps 406a to 406c below. Among them, short-range communication technology may include, but is not limited to: Wi-Fi, Bluetooth, NFC, etc.
[0131] Step 406a: The terminal device sends a device control command to the smart device. For example, when the mobile phone and the air conditioner B are connected to the same Wi-Fi, the mobile phone can directly send the generated device control command to the air conditioner B through the Wi-Fi technology.
[0132] Step 406b: The smart device returns a device response result to the terminal device. In some embodiments, the smart device may return a response result indicating successful device control to the terminal device.
[0133] Optionally, in step 406c, the terminal device records the control information. In some possible embodiments, the terminal device may incrementally update the historical control data based on the control information, so that the historical control data can be updated in a timely manner, and more accurate device control commands can be obtained. In other possible embodiments, the terminal device may also retain a preset period or a preset number of historical control data, and may delete expired control data in a timely manner, so as to obtain device control commands that are more in line with the user's current behavior habits. In addition, after the terminal device updates the control record, it may also refer to the contents of step 403a and step 403b to synchronize the user control record with the cloud server in a timely manner.
[0134] In some other possible embodiments, the terminal device may also send device control commands to the cloud server via the communication network, see the contents described in steps 407a to 407e below.
[0135] Optionally, in step 407a, the terminal device sends a device control command to the cloud server. In some possible embodiments, when the terminal device and the smart device cannot communicate through short-range communication technology, they can communicate indirectly through the cloud server; or, the terminal device and the smart device prefer to communicate through the cloud server, which is not limited in this application.
[0136] Optionally, in step 407b, the cloud server receives the device control command sent by the terminal device, and sends the device control command to the smart device. In some possible embodiments, when the terminal device generates the device control command, the cloud server can distribute the device control command to the corresponding smart home device. It can be understood that the smart device has completed device registration; it can also be understood that the cloud server can perceive the smart device.
[0137] In addition, in some other possible embodiments, the cloud server may also receive the voice control instructions or the original intention of the user sent by the terminal device, and parse the user control record and device information, calculate the number of times based on the device function and historical control data, and then generate the device control command based on the original intention of the user and the number of times. In this embodiment, the cloud server can directly send the generated device control command to the corresponding smart device, such as air conditioner B.
[0138] Optionally, in step 407c, the smart device returns a device response result to the cloud server.
[0139] Optionally, in step 407d, the cloud server receives the device response result sent by the smart device and records the control information.
[0140] Optionally, in step 407e, the cloud server returns a device response control command to the terminal device.
[0141] Through the above method, in the smart home control system, it is possible to generate device control commands based on the historical control data of similar devices from the granularity of device type and device function. Moreover, the maximum value of the target functional capability range of the device control command in this method can be determined based on the user's behavioral habits, and at this time, the maximum value of the target functional capability range can be different from the maximum value of the actual functional capability range of the device; similarly, the target functional change accuracy value of the device control command can also be determined based on the user's behavioral habits, and at this time, the target functional change accuracy value can be greater than the actual functional change accuracy value of the device. In this way, the user's control of the smart home can be adaptively adjusted without being limited to the functional capability range and functional change accuracy of the device in this application, thereby making the control more efficient and more in line with the user's behavioral habits.
[0142] See also Figure 6a , is another flow chart of a control method of a smart scene provided in an embodiment of the present application, and the flow chart can be applied to a smart home control system. In some possible embodiments, the smart home control system can include at least a terminal device and a smart device. In some other possible embodiments, the smart home control system can also include at least a terminal device, a cloud server, and a smart device. It can be understood that in executing Figure 6a Before the process shown, the smart device has completed device registration and account login, or received device sharing, etc. Figure 6a The implementation of steps 401 to 402 in Figure 4a As shown, it will not be repeated in the following embodiments. Figure 6a The process shown may include the following steps:
[0143] Step 401: The terminal device receives a voice control instruction input by a user.
[0144] Step 402: The terminal device analyzes the user's original intention based on the voice control instruction.
[0145] Optionally, in step 603a, the terminal device synchronizes device information and combined function mode information to the cloud server. The combined function mode is used to indicate a function mode composed of at least one basic function of the device and its corresponding control value, which can enable users to adjust the device in a portable manner. For example, an air conditioner can be set to a sleep mode composed of temperature, wind speed and wind direction and their corresponding control values, and a desk lamp can be set to a reading mode composed of brightness and its corresponding control value.
[0146] In some possible embodiments, the terminal device may periodically synchronize device information and combined functional mode information to the cloud server, or may synchronize control records and combined functional mode information to the cloud server in response to a trigger event, where the trigger event may be, for example, detection of a new voice control event, manual synchronization triggered by the user, etc. For example, the following Table 2-0 shows an example of a possible combined functional mode information corresponding to the air conditioner C and the desk lamp A, as follows:
[0147] Table 2-0
[0148]
[0149] As can be seen from Table 2-0, air conditioner C can provide air conditioner sleep mode; wherein, air conditioner sleep mode is a combination of three basic functions: temperature, wind speed, and placement direction. Moreover, each basic function corresponding to the air conditioner sleep mode has a set control value. Desk lamp A can provide desk lamp reading mode; wherein, desk lamp reading mode is used to indicate the state when the control value of the brightness basic function is set to 65.
[0150] Optionally, in step 603b, the cloud server returns device information and combined functional mode information to the terminal device. In some possible embodiments, the cloud server may return device information and combined functional mode information of the same user account to the terminal device, which may also include device information and combined functional mode information of the same user account on other terminal devices, thereby achieving data synchronization of multiple devices.
[0151] In some optional embodiments, when the terminal device has processing capability, the following step 604 may be performed, or the following step 605 may be performed. Figure 6b In some other optional embodiments, when the terminal device does not have processing capability or has weak processing capability, the user's original intention may be sent to the cloud server, and the cloud server executes the following steps 604 or 606. Figure 6b In the embodiment of the present application, the terminal device generates a device control command as an example for introduction, such as the following steps 604 and Figure 6b The contents introduced in steps 605 to 606 shown in FIG.
[0152] Step 604: The terminal device obtains basic functions and corresponding control values according to the user's original intention, device type and combined function mode name.
[0153] In some possible embodiments, the data source of the user control record may include but is not limited to: historical control data of old functionally similar devices of the same type, historical control data of old functionally different devices of the same type, historical control data of currently controlled smart devices, etc. In one possible scenario, the user has an old air-conditioning device (air-conditioning C) and a new air-conditioning device (air-conditioning D), wherein air-conditioning C has an air-conditioning sleep mode as shown in Table 2-0, while air-conditioning D does not support the air-conditioning sleep mode or the air-conditioning sleep mode is different from the air-conditioning sleep mode shown in Table 2-0; and the user has an old desk lamp device (desk lamp A) and a new desk lamp device (desk lamp B); wherein desk lamp A has a desk lamp reading mode as shown in Table 2-0, while desk lamp B does not have a desk lamp reading mode as shown in Table 2-0 or the control value set for the desk lamp reading mode is different from the control value shown in Table 2-0. In order to facilitate the user to realize voice control of the new device through the historical control records of the old device, the method provided in the embodiment of the present application can simulate and generate the combined function mode of the new device based on the combined function mode information of the old device. The following Table 2-1 is an example of the basic function information of air-conditioning D and desk lamp B, as follows:
[0154] Table 2-1
[0155]
[0156]
[0157] As can be seen from Table 2-1, air conditioner D has three basic functions: temperature, wind speed and placement direction, and the desk lamp has the basic function of brightness.
[0158] Understandably, through Figure 6a The process shown can realize the process of data collection and data analysis in response to user voice control instructions, thereby providing reference data information for controlling smart devices. It should be noted that the embodiment of the present application does not limit the method of obtaining reference data information. For example, a data set can also be downloaded from the network to statistically analyze the combined functional mode information of similar devices.
[0159] See also Figure 6b , is another flow chart of a control method for a smart scene provided in an embodiment of the present application; wherein, Figure 6b The implementation of steps 406a to 407e in Figure 4b The process can realize the control process of the smart device and may include the following process:
[0160] Step 605: Compare the basic functions and corresponding control values of the smart device capabilities and the combined function mode to determine the target control value.
[0161] In some possible embodiments, taking the device type as an air conditioner as an example, the scenario of controlling the combined function mode of the air conditioner may include the following possible scenarios:
[0162] Scenario 1: Air conditioner D does not support one or more basic functions included in the combined function mode of air conditioner C. In this case, the control of the basic function can be ignored in the device control command generated for air conditioner D. For example, when air conditioner D does not support the basic function of left and right wind direction supported by air conditioner C, the generated device control command may not control the wind direction for the voice control scenario in which air conditioner D is set to air conditioner sleep mode. In addition, in this scenario, reminders can be sent to the user through voice reminders and / or interface reminders, so that the user can accurately perceive the specific functions of the combined function mode.
[0163] Scenario 2: If the control value set in the air-conditioning sleep mode of air-conditioning C is within the adjustment range of air-conditioning D, the target control value of air-conditioning D can be obtained by directly referring to the control value of air-conditioning C. For example, if the temperature control value set in the air-conditioning sleep mode of air-conditioning C is 26 degrees, then for the voice control scenario in which air-conditioning D is set to the air-conditioning sleep mode, the generated device control command includes control information for setting the temperature to 26 degrees.
[0164] Scenario 3: If the control value set in the air-conditioning sleep mode of air-conditioning C is outside the adjustment range of air-conditioning D, the control value closest to the control value of air-conditioning C can be used to obtain the target control value of air-conditioning D. For example, if the wind speed control value set in the air-conditioning sleep mode of air-conditioning C is level 4, then for the voice control scenario in which air-conditioning D is set to the air-conditioning sleep mode, the wind speed level only includes level 1, level 2, and level 3, and the generated device control command includes setting the wind speed to level 3, which is closest to level 4.
[0165] Similarly, by adopting the method provided in the embodiment of the present application, it is possible to set the control value of the desk lamp sleep mode of desk lamp B with reference to the desk lamp sleep mode of desk lamp A, that is, to set it to 65.
[0166] Step 606: Generate a device control command based on the multiple functions and their corresponding target control values. Based on the content introduced in step 605, the device control command generated in this scenario can be understood as a combination of at least one basic function. For example, when the voice control instruction is "set air conditioner D to sleep mode", the generated device control command may include: set the temperature to 26 degrees and set the wind speed to the third gear.
[0167] In some possible embodiments, the terminal device can directly send device control commands to the smart device through short-range communication technology, see the contents introduced in steps 406a to 406c below. Among them, short-range communication technology may include, but is not limited to: Wi-Fi, Bluetooth, NFC, etc.
[0168] Step 406a: The terminal device sends a device control command to the smart device.
[0169] Step 406b: The smart device returns a device response result to the terminal device.
[0170] Optionally, in step 406c, the terminal device records the control information.
[0171] In some other possible embodiments, the terminal device may also send device control commands to the cloud server via the communication network, see the contents described in steps 407a to 407e below.
[0172] Optionally, in step 407a, the terminal device sends a device control command to the cloud server.
[0173] Optionally, in step 407b, the cloud server receives the device control command sent by the terminal device, and sends the device control command to the smart device.
[0174] Optionally, in step 407c, the smart device returns a device response result to the cloud server.
[0175] Optionally, in step 407d, the cloud server receives the device response result sent by the smart device and records the control information.
[0176] Optionally, in step 407e, the cloud server returns a device response control command to the terminal device.
[0177] Through the above method, in the smart home control system, not only can the control of a function of a new device or a device shared by others be realized based on the historical control data of devices of the same or similar type, but also the control of a combined functional mode composed of at least one basic function can be realized, so that the existing combined functional mode of the old device can be simulated. In this way, the user's control of the smart home can be adaptively adjusted without being limited to the functional capability range and function change accuracy of the device in this application, so that the control can be more efficient and more in line with the user's behavior habits.
[0178] In some possible embodiments, for Figure 4a and Figure 4b The embodiments described, or Figure 6a and Figure 6b In the embodiment described above, the embodiment of the present application can also provide the user with a switch control for turning on adaptive voice control through the interface. It can be understood that when the user turns on the switch control for adaptive control, the smart home control system can use the following method: Figure 4a and Figure 4b The embodiments described, or Figure 6a and Figure 6b The embodiments introduced are used to implement the control method of the smart scene provided by the present application; when the user turns off the switch control for adaptive control, the smart home control system can realize voice control of the smart device based on the original functional capability range, function change accuracy and combined function mode of the device. In some possible embodiments, the switch control of adaptive control can act on all devices bound to the terminal device, or one switch control can act on a class of devices, or one switch control can act on one device. Figure 7 , which is a schematic diagram of an interface of a smart scene control method provided in an embodiment of the present application. Figure 7 Interface 700A is shown, including a switch control 701 for adaptive control. It can be seen that the switch control 701 can act on all devices in interface 700A, such as air conditioner A, air conditioner B, speaker B and desk lamp B shown in interface 700A. Figure 7 Also shown is an interface 700B, which includes multiple switch controls 702 for adaptive control. It can be seen that one device corresponds to one switch control 702; when the switch control 702 is turned on, the smart device can be adaptively controlled, such as the air conditioner B, speaker B and desk lamp B shown in the interface 700B.
[0179] See also Figure 8 , is a control method for a smart scene provided in an embodiment of the present application. The method can be applied to electronic devices or smart home systems, etc., and may include the following steps:
[0180] Step 801: Analyze the voice control command input by the user to determine the controlled smart device and the user's control intention.
[0181] Step 802: Obtain historical control data associated with the controlled smart device by the user. In some possible embodiments, the historical control data associated with the controlled smart device may include, but is not limited to: historical data of the controlled smart device; historical control data of devices belonging to the same category as the controlled smart device, for example, the controlled smart device may be a new air conditioner of the user, and devices of the same category as the new air conditioner may be an old air conditioner of the user.
[0182] Step 803: Generate a device control command corresponding to the user's control intention based on the historical control data. In some possible embodiments, the above-mentioned Figure 4b The embodiment shown, or the execution as described above Figure 6b The embodiment shown is used to obtain the device control command, and this application will not go into details.
[0183] Step 804: Based on the device control command, control the controlled smart device. In some possible embodiments, when the controlled smart device itself executes step 803, the device control command can be directly executed. In other possible embodiments, when step 803 is executed by a terminal device such as a mobile phone or a tablet computer, and is different from the controlled smart device, a device control command can be sent to the controlled smart device through short-range communication technology or wired methods to achieve control of the controlled smart device. In other possible embodiments, when step 803 is executed by a cloud server, a device control command can be sent to the controlled smart device through a communication network or other methods to achieve control of the controlled smart device.
[0184] Based on the above embodiments, the present application further provides an electronic device, the electronic device comprising multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation. Figure 4a In the embodiment shown, the terminal device executes steps 401 to 404; or executes Figure 4b In the embodiment shown, the terminal device performs steps 405 to 407e, or performs Figure 6a In the embodiment shown, the terminal device performs steps 401 to 604, or performs Figure 6b The terminal device of the embodiment shown in the figure performs steps 605 to 407e, or performs Figure 8 The electronic device in the illustrated embodiment executes steps 801 to 804 .
[0185] Based on the above embodiments, the present application further provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the functions executed by the electronic device in each method described in the embodiments of the present application. Figure 4a In the embodiment shown, the terminal device executes steps 401 to 404; or executes Figure 4b In the embodiment shown, the terminal device performs steps 405 to 407e, or performs Figure 6a In the embodiment shown, the terminal device performs steps 401 to 604, or performs Figure 6b In the embodiment shown, the terminal device performs steps 605 to 407e, or performs Figure 8 The electronic device in the illustrated embodiment executes steps 801 to 804 .
[0186] Based on the above embodiments, the present application also provides a control system for a smart scene, which may include the electronic device and the controlled smart device in the above embodiments. Optionally, the system may also include a cloud server, or at least one other electronic device, or at least one other smart device.
[0187] Based on the above embodiments, the present application also provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which enables a computer to execute the methods described in the embodiments of the present application when the computer program is executed.
[0188] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.
[0189] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the methods described in the embodiments of the present application.
[0190] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In a possible design, the chip system also includes a memory, which is used to store the necessary programs and data of the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. It should be understood by those skilled in the art that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0191] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.
[0192] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0193] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0194] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of protection of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A control method for a smart scene, It is characterized in that include: Analyze the voice control commands input by the user to determine the controlled smart device and the user's control intention; Acquire historical control data associated with the controlled smart device by the user; generating a device control command corresponding to the user control intention according to the historical control data; Based on the device control command, the controlled intelligent device is controlled.
2. The method according to claim 1, It is characterized in that The controlling the controlled intelligent device based on the device control command includes: The controlled smart device is controlled based on a first control mode indicated by the device control command; wherein the first control mode is different from a second control mode specified by the factory for the controlled smart device.
3. The method according to claim 1 or 2, It is characterized in that The user control intention is used to indicate the control of the basic functions of the controlled smart device; The generating, according to the historical control data, a device control command corresponding to the user intention comprises: From the historical control data, N pieces of data information corresponding to N control values are counted, where N is a positive integer; Determining a target control value from the N control values according to the N pieces of data information; The device control command is generated according to the target control value.
4. The method according to claim 3, It is characterized in that The controlled smart device is an air conditioner, the basic function includes temperature, and the target control value is a maximum temperature, a minimum temperature, or a temperature adjustment step; or, The controlled smart device is a speaker, the basic function includes sound, and the target control value is the maximum sound value, mute, or sound adjustment step.
5. The method according to claim 4, It is characterized in that The controlled smart device is an air conditioner, the basic function includes temperature, the maximum temperature is different from the nominal maximum temperature of the air conditioner, the minimum temperature is different from the nominal minimum temperature of the air conditioner, and the temperature adjustment step is different from the nominal temperature adjustment step of the air conditioner; The controlled smart device is a speaker, the basic functions include sound, the maximum sound value is different from the nominal maximum sound value of the speaker, and the sound adjustment step is different from the nominal sound adjustment step of the speaker.
6. The method according to claim 1 or 2, It is characterized in that The user control intention is used to indicate the control of the combined function of the controlled smart device; the combined function is composed of M basic functions and corresponding M control values, where M is a positive integer; The generating, according to the historical control data, a device control command corresponding to the user intention comprises: From the historical control data, obtain L basic functions and corresponding L control values of the combined function of at least one similar device, where L is a positive integer; Determine the first basic function and the first control value corresponding to it in the device control command according to the first basic function in the L basic functions and the first control value corresponding to it; wherein the first control value is included in the factory nominal function range of the first basic function of the controlled smart device; According to the second basic function among the L basic functions and its corresponding second control value, the second basic function in the device control command and its corresponding third control value are determined; wherein the second control value is not included in the factory nominal functional range of the second basic function of the controlled intelligent device, and the first absolute difference between the third control value and the second control value is less than the second absolute difference; the second absolute difference is the absolute difference between the fourth control value and the second control value, and the fourth control value is any control value within the factory nominal functional range of the second basic function except the third control value.
7. The method according to claim 6, It is characterized in that The controlled smart device is an air conditioner, and the combined function includes at least one of temperature and its corresponding temperature value, wind speed and its corresponding wind speed gear, wind swing direction and its set placement direction.
8. The method according to claim 7, It is characterized in that The combination function indicated by the device control command is different from the nominal combination function of the air conditioner; or, the air conditioner does not have the combination function when leaving the factory.
9. The method according to any one of claims 1 to 8, It is characterized in that Before analyzing the voice control command input by the user to determine the controlled smart device and the user's control intention, the method further includes: The function of turning on adaptive control is detected.
10. The method according to claim 9, It is characterized in that The function of detecting the start of adaptive control includes: A switch control for turning on adaptive control is detected on the first interface.
11. The method according to any one of claims 1 to 10, It is characterized in that The associated historical control data includes: historical control data of the controlled smart device and historical control data of devices of the same type as the controlled smart device.
12. A control system for smart scenes, It is characterized in that The system includes an electronic device and a controlled intelligent device; The electronic device is used to receive a voice control instruction input by a user; The electronic device is further used to analyze the voice control instruction to determine the controlled smart device and the user's control intention; obtain the historical control data associated with the controlled smart device by the user; and generate a device control command corresponding to the user's control intention based on the historical control data; Sending the device control command to the controlled smart device; The controlled smart device is used to receive the device control command; Control is performed according to the device control command.
13. An electronic device, It is characterized in that The system comprises at least one processor coupled to at least one memory, wherein the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 11.
14. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 11.
15. A computer program product comprising instructions, It is characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Voice control method and device, electronic equipment and computer readable storage medium
CN111986670A
Volume adjustment method and device based on voice control, equipment and medium
CN112185369A
Voice control method and device, readable storage medium and vehicle
CN114516334A
Cognitive volume and speech frequency levels adjustment
US10652655B1
Sound volume adjustment method and electronic device
WO2023087874A1
Cited By
Cross-brand intelligent electric appliance unified management and control method for smart home ecology
CN120071910A
Unified Control Method for Cross-Brand Smart Appliances in the Smart Home Ecosystem
CN120071910B
Intelligent household electrical appliance interaction control system based on embedded software
CN120447407A
