Control method and system for smart scenario, and electronic device
By analyzing user historical control data to generate device control commands, the adaptive control of smart devices is realized, and the experience differences caused by the ambiguity of voice control is solved, and the control intelligence and user experience are improved.
Patent Information
- Application Number
- PCT/CN2024/070920
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-26
- Filing Date
- 2024-01-05
- Publication Date
- 2024-12-05
AI Technical Summary
In the field of smart life, when users control the voice of smart devices, the input commands are often blurred, resulting in large differences in experiences between different users. It is difficult for the existing technology to effectively identify and implement adaptive control, affecting the user experience.
By analyzing the user's historical control data, generating device control commands corresponding to the user's control intentions, the adaptive control of the intelligent device is realized, and the control matching degree and efficiency are improved.
It improves the control intelligence and user experience of smart devices, is suitable for the habits and differences in device functions of different users, and is suitable for newly registered or shared smart devices to achieve more accurate voice control.
Smart Images

Figure CN2024070920_05122024_PF_FP_ABST
Abstract
Description
A control method, system and electronic device for smart scenes
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of the People's Republic of China on May 26, 2023, with application number 202310611874.X and invention name "A control method, system and electronic device for smart scenes", the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The embodiments of the present application relate to the field of smart life, and in particular to a control method, system, and electronic device for smart scenes. Background Art
[0004] In applications such as smart living or whole-home intelligence, users can control smart devices through voice commands. Typically, the voice commands input by users are often ambiguous. For example, in a voice-controlled air conditioner scenario, frequently used voice control corpus may include "turn up the air conditioner temperature a little," "turn down the air conditioner temperature a little," "turn the air conditioner temperature to the maximum," and so on. Currently, smart home control systems recognize and control these types of fuzzy control intentions based on the functional scope and functional accuracy of the controlled smart devices. However, given the different habits of different users, this control method may differ significantly from the user's habitual expectations, resulting in significant differences in user experience.
[0005] Therefore, how to improve the control intelligence of smart devices in smart scenarios has great research significance.
[0006] Summary of the Invention
[0007] The embodiments of the present application provide a smart scene control method, system and electronic device for realizing adaptive control of smart devices in the scenario of controlling smart devices by voice, thereby improving the user experience of using voice to control smart devices.
[0008] First, embodiments of the present application provide a method for controlling a smart scene. The method analyzes a user's voice control command to determine a controlled smart device and the user's control intent; obtains historical control data associated with the user's controlled smart device; generates a device control command corresponding to the user's control intent based on the historical control data; and controls the controlled smart device based on the device control command.
[0009] This method, based on analyzing user usage habits from historical control data, can adaptively generate device control commands based on user usage habits and control intent. This allows for adaptive control beyond the control of the controlled smart device itself, improving control matching and intelligence, increasing control efficiency, and ultimately, enhancing the user experience.
[0010] In some possible embodiments, the controlling of the controlled smart device based on the device control command includes: controlling the controlled smart device based on the first control mode indicated by the device control command; wherein the first control mode is different from the second control mode specified by the factory for the controlled smart device. For example, the second control mode specified by the factory for the controlled smart device may be the user controlling the smart device through a remote control, such as when the user controls the air conditioner through the remote control, the temperature changes by 1 degree Celsius each time a button is pressed. However, in this method, when the user's control intention is to change the temperature by 2 degrees Celsius based on historical control data, the first control mode may be to directly adjust the temperature by 2 degrees Celsius; it can be understood that the second control mode in this scenario requires two controls. Therefore, this embodiment can improve control efficiency, and thus improve the user experience.
[0011] In one possible scenario, the user control intent is used to instruct control of the basic functions of the controlled smart device. The generation of a device control command corresponding to the user intent based on the historical control data includes: counting N pieces of data information corresponding to N control values from the historical control data, where N is a positive integer; determining a target control value from the N control values based on the N pieces of data information; and generating the device control command based on the target control value. In this scenario, the user's usage habits can be analyzed and analyzed through statistics and analysis of historical control data, so that device control commands can be generated based on the user's usage habits, thereby improving control matching.
[0012] In some possible embodiments, the controlled smart device is an air conditioner, the basic function includes temperature, and the target control value is the maximum temperature, the minimum temperature, or the temperature adjustment step; or, the controlled smart device is a speaker, the basic function includes sound, and the target control value is the maximum sound, mute, or the sound adjustment step.
[0013] In some possible embodiments, the controlled smart device is an air conditioner, the basic function includes temperature, the maximum temperature is different from the nominal maximum temperature of the air conditioner, the minimum temperature is different from the nominal minimum temperature of the air conditioner, and the temperature adjustment step is different from the nominal temperature adjustment step of the air conditioner. The controlled smart device is a speaker, the basic function includes sound, the maximum sound value is different from the nominal maximum sound value of the speaker, and the sound adjustment step is different from the nominal sound adjustment step of the speaker. Through this embodiment, it can be obtained that the control method of the device control command can simulate the user's usage habits without being limited to the function settings of the smart device in this application. In this way, through this method, the device control command can be controlled based on the user's commonly used function range, the user's commonly used adjustment accuracy, etc., which can improve the control efficiency and control matching.
[0014] In another possible scenario, the user control intention is used to indicate the control of the combination function of the controlled smart device; the combination function consists of M basic functions and corresponding M control values, where M is a positive integer. The device control command corresponding to the user intention is generated based on the historical control data, including: obtaining L basic functions and corresponding L control values included in the combination function of at least one similar device from the historical control data, where L is a positive integer. In this scenario, the historical combination functions commonly used by users can be analyzed based on the historical control data, so that the historical combination functions can be simulated to generate device control commands for the controlled smart device. This scenario may include the following methods:
[0015] Method 1: Determine the first basic function and its corresponding first control value in the device control command based on the first basic function of the L basic functions and its corresponding first control value; wherein the first control value is included in the factory-rated functional range of the first basic function of the controlled intelligent device. In this method, if the controlled intelligent device can implement the basic functions and their corresponding control values included in the historical combination of functions, the device control command can directly use the control value set in the historical combination of functions, thereby achieving the same control.
[0016] Method 2: Determine the second basic function and its corresponding third control value in the device control command based on the second basic function of the L basic functions and its corresponding second control value; wherein the second control value is not included in the factory-rated functional range of the second basic function of the controlled intelligent device, and the first absolute difference between the third control value and the second control value is less than the second absolute difference; the second absolute difference is the absolute difference between the fourth control value and the second control value, and the fourth control value is any control value within the factory-rated functional range of the second basic function, excluding the third control value. In this method, if the controlled intelligent device can implement the basic function included in the historical combination function but cannot meet the control value corresponding to the basic function, the device control command may use a value within the functional range that is closest to the control value set in the historical combination function, thereby achieving similar control.
[0017] In addition, it can be understood that when the controlled smart device cannot implement the basic function included in the historical combination function, the device control instruction can ignore the control of the basic function, and can also send a prompt message to the user to inform the user that the controlled smart device cannot implement the basic function.
[0018] In some possible embodiments, the controlled smart device is an air conditioner, and the combined function includes at least one of temperature and its corresponding temperature value, wind speed and its corresponding wind speed level, wind swing direction and its set placement direction.
[0019] In some possible embodiments, the function combination indicated by the device control command differs from the nominal function combination of the air conditioner; or the air conditioner does not have the function combination when it leaves the factory. This embodiment can simulate a function combination mode that is different from the function combination mode that the controlled smart device itself can provide, or a function combination mode that the controlled smart device itself does not support, thereby improving the control intelligence of the smart device.
[0020] In some possible embodiments, before analyzing the voice control command input by the user to determine the controlled smart device and the user's control intent, the method further includes: detecting the activation of an adaptive control function. In some possible embodiments, detecting the activation of the adaptive control function includes: detecting a switch control for activating the adaptive control on the first interface. Through this embodiment, the adaptive control function can be flexibly provided to the user, thereby meeting the user's needs in a variety of scenarios.
[0021] In some possible embodiments, the associated historical control data includes: historical control data of the controlled smart device, and historical control data of devices of the same type as the controlled smart device. In this embodiment, based on the historical control data of the controlled smart device itself, and / or the historical control data of old devices with the same or similar functions as the controlled smart device, the user's usage habits of the smart device can be analyzed, so that adaptive control based on the user's usage habits can be achieved, and the control intelligence of the smart device can be improved. Exemplarily, the controlled smart device can be an unfamiliar device such as a new device or a device shared by others. Through the method provided in this application, it is possible to simulate the control of the unfamiliar device by referring to the user's control habits of the old device, thereby improving the control efficiency and control matching of the smart device, and improving the user's usage experience.
[0022] In the second aspect, the present application also provides a control system for a smart scene. The system may include at least an electronic device and a controlled smart device. The electronic device is used to receive a voice control instruction input by a user; the electronic device is also used to analyze the voice control instruction to determine the controlled smart device and the user's control intention; obtain the historical control data associated with the controlled smart device by the user; generate a device control command corresponding to the user's control intention based on the historical control data; send the device control command to the controlled smart device; the controlled smart device is used to receive the device control command; and perform control according to the device control command. For example, the electronic device can be one, such as a mobile phone, a tablet computer, or other device that has both voice input capability and processing capability. For another example, the electronic device can also be multiple, such as a device with voice input capability such as a speaker, which is used to receive the voice control instruction input by the user, and a device with processing capability such as a mobile phone, a tablet computer, which is used to process the voice control instruction and generate the device control command.
[0023] In a third aspect, the present application further provides an electronic device comprising multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the electronic device in any of the above aspects and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.
[0024] In a fourth aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the method executed by the electronic device in any of the above aspects and its various embodiments.
[0025] In a fifth aspect, the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes any one of the above aspects and its possible methods for designing electronic devices to execute.
[0026] In a sixth aspect, the present application provides a computer program product, which includes: a computer program (also referred to as code, or instructions), which, when executed, enables a computer to execute any of the above aspects and possible methods of designing electronic devices.
[0027] In the seventh aspect, an embodiment of the present application also provides a graphical user interface on an electronic device, which electronic device has a display screen, one or more memories, and one or more processors, wherein the one or more processors are used to execute one or more computer programs stored in the one or more memories, and the graphical user interface includes a graphical user interface displayed when the electronic device executes any of the above aspects and its possible designs.
[0028] In an eighth aspect, the present application also provides a chip, which is used to read a computer program stored in a memory and execute any of the above aspects and their possible methods of designing electronic devices to execute.
[0029] In a ninth aspect, the present application further provides a chip system, comprising a processor for supporting a computer device in implementing any of the above aspects and possible methods for designing electronic devices for execution. In one possible design, the chip system further comprises a memory for storing programs and data necessary for the computer device. The chip system may be composed of a chip alone, or may include a chip and other discrete components.
[0030] For the beneficial effects of any of the second to ninth aspects and their possible designs, please refer to the beneficial effects of the various possible designs in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1a is a schematic diagram of an interface of a control method for a smart scene;
[0032] Figure 1b shows a control scenario of a smart scene;
[0033] FIG2 is a schematic diagram of the hardware structure of a possible electronic device provided in an embodiment of the present application;
[0034] FIG3 is a software structure block diagram of an electronic device provided in an embodiment of the present application;
[0035] FIG4a is a flow chart of a control method for a smart scene according to an embodiment of the present application;
[0036] FIG4 b is a second flow chart of a method for controlling a smart scene provided in an embodiment of the present application;
[0037] FIG5 is a schematic diagram of one interface of a method for controlling a smart scene provided in an embodiment of the present application;
[0038] FIG6a is a third flow chart of a method for controlling a smart scene provided in an embodiment of the present application;
[0039] FIG6b is a fourth flow chart of a method for controlling a smart scene provided in an embodiment of the present application;
[0040] FIG7 is a second schematic diagram of an interface of a method for controlling a smart scene provided in an embodiment of the present application;
[0041] FIG8 is a fifth flow chart of a method for controlling a smart scene provided in an embodiment of the present application. DETAILED DESCRIPTION
[0042] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0043] The technical solutions provided in the embodiments of this application can be applied to fields such as smart living, and specifically to IoT-related application fields such as whole-house intelligence and smart office. With the development and popularization of smart living technologies, users are increasingly using smart scenarios (also referred to as "smart scenes", etc.). Based on the convenience of voice control of smart devices, the scenario of voice control of smart devices plays a very important role in smart scenes.
[0044] In some embodiments, Figure 1a illustrates a smart scene control scenario. A mobile phone is installed with an app or process that can receive voice control commands, such as a voice assistant application (APP) or a smart home app. After registering a device on the phone, the user can wake up the voice assistant app and enter a voice control command. After receiving the voice control command, the voice assistant app can parse the user's original intent, such as which device the user wants to operate or what control they want to perform. A cloud server can receive the user's original intent sent by the voice assistant app and generate corresponding device control commands based on information such as the functional capabilities and accuracy of the controlled smart device. For example, if the user's original intent is "to set the air conditioner temperature to maximum," the generated device control command may be to set the air conditioner temperature to the maximum value. Alternatively, if the user's original intent is "to turn up the volume on the speaker," the generated device control command may be to increase the accuracy of the speaker volume by one step. Finally, the cloud server sends the device control command to the controlled smart device to implement voice control of the controlled smart device. However, due to the different behavioral habits of different users and the different functional capabilities and accuracy of the controlled smart devices, there are certain differences in the experience of different users, which may cause some users to become unfamiliar with the use.
[0045] In other embodiments, a time-of-flight (TOF) sensor can be added to the smart home control system to dynamically detect user information related to the control panel. Based on the detected user information, the control panel's screen can be turned on or off, and voice control of smart devices in the smart home control system can be implemented. However, sensor-based voice control methods have limited usage scenarios and can only be used in front of terminals equipped with sensors. They cannot be used on terminal devices such as mobile phones and tablets that do not have TOF sensors.
[0046] In some other embodiments, Figure 1b is a control scene of another smart scene. As shown in interface 11 of Figure 1b, users can also arrange smart scenes on the mobile phone display interface. By arranging smart scenes, users can set the parameters for controlling smart devices in advance, and then trigger the execution of scenes through voice control. However, every time the user uses a newly registered device or a smart device shared by others, the user needs to reset the smart scene for the new device, and each time the user adjusts the parameters, the user needs to perform user operations on interface 11, which makes the user operation more cumbersome and the user experience unintelligent.
[0047] In other embodiments, users can also control smart devices using a traditional remote control. For example, if the smart device is an air conditioner, users typically adjust the temperature by pressing the "△" button on the remote control to increase the temperature or the "▽" button to decrease it. Each button press typically adjusts the temperature by 1 degree Celsius (°C). It's understandable that if the user wants to increase or decrease the temperature by more than 1 degree Celsius, they'll need to press the button multiple times to achieve the desired control.
[0048] It will be appreciated that in the various embodiments described above, control of smart devices is generally based on the factory-specified functional capability range and adjustment accuracy of the smart devices. For example, if an air conditioner's factory-specified functional capability range is 16°C to 30°C, with an adjustment accuracy of 1°C, then when adjusting the air conditioner using the various embodiments described above, the maximum adjustable temperature is 30°C, the minimum adjustable temperature is 16°C, and the adjustment step size is 1°C.
[0049] In view of this, an embodiment of the present application provides a control method for a smart scene. The method provides a technical solution that can improve the intelligence of the user's voice control of smart devices. When the user performs voice control on the smart device, the method can adaptively generate control instructions that match the user's habit characteristics for the user, so that the control result of the smart device can be more in line with the user's behavior habits, which can ensure the user experience, and can perform targeted smart device control for different users, thereby improving the intelligence of the control of the smart device. Moreover, for new smart devices or smart devices shared by others, the method can also achieve user-adaptive control of unfamiliar devices, so that even if the user performs voice control on an unfamiliar device, it can better meet the user's behavior habits and ensure the user experience.
[0050] This solution can be applied to smart home control systems. In one possible scenario, the smart home control system may include smart devices; where smart devices may include, but are not limited to, air conditioners, speakers, desk lamps, refrigerators, etc. In this scenario, the smart devices may have voice control capabilities as well as processing capabilities. For example, the smart device may receive a user's voice control commands through a voice assistant app, process the voice control commands based on the commands, and generate device control commands; where the device control commands can be used to control the functions of the smart home. It can be understood that voice control capability indicates that the device can receive voice commands input by the user, and voice commands can be used to control the device.
[0051] In another possible scenario, the smart home control system may include smart devices (also referred to as "controlled smart devices" in the following embodiments) and may also include voice control devices; wherein the voice control devices may be, for example, terminal devices such as mobile phones and tablet computers, or devices such as smart speakers. In this scenario, the voice control device can be used to receive voice control instructions input by the user. In addition, when the voice control device has processing capabilities, the voice control device can process the voice control instructions based on the voice control instructions to generate device control commands, such as when the voice control device is a mobile phone; or, when the smart device has processing capabilities, the smart device can also receive the voice control instructions and process them based on the voice control instructions to generate device control commands.
[0052] In another possible scenario, a smart home control system may include smart devices and a cloud server, wherein the cloud server may be used to process voice control instructions and generate device control commands. It is understood that in this scenario, if the smart device has voice control capabilities, the voice control instructions can be received by the smart device; if the smart device does not have voice control capabilities, the smart home control system may also include a voice control device.
[0053] It should be noted that the embodiments of the present application are not limited to the various scenarios introduced above. For example, the number and type of smart devices included in the smart home control system are not limited, and the smart home control system may include voice control devices, terminal devices, cloud servers, smart devices, etc., and the number and type of terminal devices included in the smart home control system are also not limited.
[0054] The control method of the smart scene provided in the embodiment of the present application can be applicable to the system, and the system can include the various scene contents as described above. For example, the system may include smart devices, or the system may also include smart devices and voice control devices, or the system may also include smart devices and cloud servers, etc.
[0055] The control method of the smart scene provided in the embodiment of the present application can also be applied to electronic devices. For example, the electronic device can be the smart device in the aforementioned introduction scene content. The smart device can be, for example, a smart home device such as a TV, a refrigerator, etc.; it can also be a portable electronic device such as a mobile phone, a tablet computer, a laptop computer, etc., which can receive voice control instructions and generate device control commands based on the voice control instructions; or it can also be a wearable device such as a watch or a bracelet; or it can also be a car-mounted device, etc., or it can also be a virtual reality (VR) device, an augmented reality (AR) device, a mixed reality (MR) device, etc. In short, the embodiment of the present application does not limit the specific type of electronic device. In some examples, the control method of the smart scene provided in the embodiment of the present application can be a function, service or application in an electronic device. The application can be an application that comes with the electronic device, or an application downloaded from the Internet, such as a smart life APP.
[0056] In summary, the control method of the smart scene provided in the embodiment of the present application can be completed by a single device or by the system.
[0057] The electronic devices to which the embodiments of the present application can be applied include but are not limited to electronic devices equipped with Or electronic devices with other operating systems. The electronic device may be, for example, the smart device introduced in the aforementioned embodiment, or the terminal device introduced in the aforementioned embodiment.
[0058] FIG2 shows a schematic diagram of the hardware structure of a possible electronic device. Wherein, the electronic device 200 includes components such as a radio frequency (RF) circuit 210, a power supply 220, a processor 230, a memory 240, an input unit 250, a display unit 260, an audio circuit 270, a communication interface 280, and a Wi-Fi module 290. Those skilled in the art will appreciate that the hardware structure of the electronic device 200 shown in FIG2 does not constitute a limitation on the electronic device 200. The electronic device 200 provided in the embodiment of the present application may include more or fewer components than shown, may combine two or more components, or may have different component configurations. The various components shown in FIG2 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application-specific integrated circuits.
[0059] The following is a detailed introduction to the various components of the electronic device 200 with reference to FIG. 2 :
[0060] The RF circuit 210 can be used to receive and transmit data during communications or calls. Specifically, after receiving downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing. Furthermore, it sends uplink data to the base station. Typically, the RF circuit 210 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier (LNA), a duplexer, and the like.
[0061] In addition, the RF circuit 210 can also communicate with other devices via a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.
[0062] Wi-Fi technology is a short-range wireless transmission technology. The electronic device 200 can connect to an access point (AP) through the Wi-Fi module 290 to achieve access to the data network. The Wi-Fi module 290 can be used for receiving and sending data during the communication process. In an embodiment of the present application, when the electronic device 200 is a mobile phone, the mobile phone can send device control commands to the controlled smart device through the Wi-Fi module 290. In another possible embodiment, when the electronic device 200 is a smart speaker, the smart speaker can send the voice control instructions input by the user or the original user intention parsed based on the voice control instructions to the mobile phone through the Wi-Fi module 290.
[0063] The electronic device 200 can be physically connected to other devices via the communication interface 280. Optionally, the communication interface 280 is connected to the communication interface of the other device via a cable to achieve data transmission between the electronic device 200 and the other device.
[0064] The electronic device 200 can also implement communication services and interact with other electronic devices. Therefore, the electronic device 200 needs to have a data transmission function, that is, the electronic device 200 needs to include a communication module. Although Figure 2 shows communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280, it is understandable that the electronic device 200 contains at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication to perform data transmission.
[0065] For example, when the electronic device 200 is a mobile phone, the electronic device 200 may include the RF circuit 210, and may also include the Wi-Fi module 290, or may include a Bluetooth module (not shown in Figure 2); when the electronic device 200 is a smart home device, the electronic device 200 may include the Wi-Fi module 290, or may include a Bluetooth module (not shown in Figure 2); when the electronic device 200 is a tablet computer, the electronic device 200 may include the Wi-Fi module, or may include a Bluetooth module (not shown in Figure 2).
[0066] The memory 240 can be used to store software programs and modules. The processor 230 executes various functional applications and data processing of the electronic device 200 by running the software programs and modules stored in the memory 240. Optionally, the memory 240 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including the corresponding software programs or modules of the kernel layer, system layer, application framework layer and application layer).
[0067] In addition, the memory 240 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. In embodiments of the present application, the memory 240 may store historical control data; wherein, the historical control data may include, but is not limited to, historical control data obtained from the following data sources: historical control data of previous devices of the same type with similar functions, historical control data of previous devices of the same type with different functions, and historical control data of the currently controlled smart device. It is understood that historical control data can be used to infer the user's voice control intentions based on the user's historical behavioral habits.
[0068] The input unit 250 may be configured to receive user input for editing operations on various types of data objects, such as numbers or characters, and to generate key signal inputs related to user settings and function control of the electronic device 200. Optionally, the input unit 250 may include a touch panel 251 and other input devices 252.
[0069] The touch panel 251, also known as a touch screen, can collect user touch operations on or near it (for example, operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch panel 251) and drive corresponding connection devices according to a pre-set program. In an embodiment of the present application, the touch panel 251 can collect user operations on or near it; for example, when the electronic device 200 is a mobile phone, the user operations can be used by the user to register a new device on the mobile phone interface or receive devices shared by others.
[0070] Optionally, the other input devices 252 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, etc.
[0071] The display unit 260 can be used to display information input by the user or information provided to the user and various menus of the electronic device 200. The display unit 260 is the display system of the electronic device 200, which is used to present an interface and realize human-computer interaction. The display unit 260 may include a display panel 261. Optionally, the display panel 261 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In an embodiment of the present application, the display unit 260 can be used to display a display interface related to a smart scene for the user, for example, it can display the control results of the smart scene, etc., for the user to check.
[0072] The processor 230 is the control center of the electronic device 200. It connects various components using various interfaces and lines, executes or runs software programs and / or modules stored in the memory 240, and calls data stored in the memory 240 to perform various functions of the electronic device 200 and process data, thereby realizing various services based on the electronic device 200. In the embodiment of the present application, the processor 230 can be used to implement the method provided in the embodiment of the present application.
[0073] The electronic device 200 also includes a power supply 220 (such as a battery) for powering various components. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, thereby managing charging, discharging, and power consumption through the power management system.
[0074] As shown in Figure 2, the electronic device 200 also includes an audio circuit 270, a microphone 271 and a speaker 272, which can provide an audio interface between the user and the electronic device 200. The audio circuit 270 can be used to convert audio data into a signal that can be recognized by the speaker 272, and transmit the signal to the speaker 272, which is converted into a sound signal for output by the speaker 272. The microphone 271 is used to collect external sound signals (such as the sound of a person speaking or other sounds, etc.), and convert the collected external sound signals into signals that can be recognized by the audio circuit 270 and send them to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 to be sent to, for example, another electronic device, or output the audio data to the memory 240 for subsequent further processing. In this embodiment of the present application, the speaker 272 can be used to execute smart scenarios that require the output of sound signals. For example, the electronic device 200 can also feedback control results through the speaker 272. The control results may include, for example: "The air conditioner has been controlled according to your requirements", "The current volume of the speaker is too high and may damage your ears. Do you want to lower the volume?" The microphone 271 may be used to receive voice control commands input by the user. For example, the microphone 271 may receive user input such as “adjust the air conditioner temperature to the maximum” or “adjust the speaker volume a little higher”.
[0075] Although not shown, the electronic device 200 may further include a camera, at least one sensor, etc., which will not be described in detail herein. The at least one sensor may include but is not limited to a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.
[0076] The operating system (OS) involved in the embodiments of the present application is the most basic system software running on the electronic device 200. The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application use an operating system adopting a layered architecture as an example to illustrate the software structure of the electronic device 200.
[0077] Figure 3 is a block diagram of the software structure of an electronic device provided in an embodiment of the present application. As shown in Figure 3, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime and system library, the kernel layer, and the hardware layer.
[0078] The application layer can include a series of application packages. As shown in Figure 3, the application layer can include camera, settings, skin modules, user interface (UI), third-party applications, etc. Among them, third-party applications can include wireless local area network (WLAN), music, call, Bluetooth, video, etc.
[0079] In one possible implementation, applications can be developed using Java by calling the application programming interface (API) provided by the application framework layer. Developers can use the application framework layer to interact with the underlying operating system layers (e.g., the hardware layer, kernel layer, etc.) to develop their own applications. The application framework layer primarily provides a series of services and management systems for the operating system.
[0080] The application framework layer provides an application programming interface and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 3, the application framework layer can include an activity manager, a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and so on.
[0081] The activity manager is used to manage the life cycle of each application and provide common navigation back functions, providing an interactive interface for all program windows.
[0082] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.
[0083] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0084] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).
[0085] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0086] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0087] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0088] The core library consists of two parts: one containing the Java language's callable functions and the other containing the operating system's core libraries. The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0089] The system library can include multiple functional modules, such as a surface manager, a media framework, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).
[0090] The surface manager is used to manage the display subsystem and provide the fusion of two-dimensional and 3D layers for multiple applications.
[0091] The media framework supports playback and recording of a variety of common audio and video formats, as well as static image files. The media framework can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0092] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0093] A 2D graphics engine is a drawing engine for 2D drawings.
[0094] In some embodiments, a three-dimensional graphics processing library may be used to draw a three-dimensional motion trajectory image, and a two-dimensional graphics engine may be used to draw a two-dimensional motion trajectory image.
[0095] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0096] The hardware layer can include various sensors, such as accelerometers, gravity sensors, touch sensors, etc.
[0097] Typically, the electronic device 200 can run multiple applications simultaneously. In simpler cases, one application corresponds to one process, while in more complex cases, one application corresponds to multiple processes. Each process has a process ID.
[0098] It should be understood that in the embodiments of the present application, "at least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple. "Multiple" refers to two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.
[0099] In addition, it should be understood that, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.
[0100] It should be understood that the hardware structure of the electronic device can be as shown in Figure 2, and the software system architecture can be as shown in Figure 3, wherein the software programs and / or modules corresponding to the software system architecture in the electronic device can be stored in the memory 240, and the processor 230 can run the software programs and applications stored in the memory 240 to execute the process of a smart scene control method provided in an embodiment of the present application.
[0101] In order to facilitate understanding of a smart scene control method provided by the present application, the implementation process of the method provided by the present application is introduced below in combination with the contents shown in Figures 4a-4b, Figure 5, and Figures 6a-6b.
[0102] The embodiments of the present application are applicable to application scenarios such as smart life. In a smart home control system, when a user uses a newly registered smart device or a smart device shared by others (which can also be understood as a "strange device"), the user can perform intelligent control on the strange device based on historical control records, so that the control of the strange device can be achieved by learning the user's control habits from the historical control records, so that the control results can be more in line with the user's actual behavior habits and ensure user experience. Alternatively, when the user performs voice control on the smart device, intelligent control can also be achieved based on historical control records, so that the control results can be more accurately in line with the user's recent behavior habits; for example, the user's control habits for the air conditioner may change with changes in factors such as the environment and time.
[0103] First, the processing effect of the method provided by the embodiment of the present application is described through the following multiple application scenarios. It is understood that the embodiment of the present application is not limited to the following application scenarios.
[0104] Refer to Figure 4a, which is a flow chart of a control method for a smart scene provided in an embodiment of the present application. The flow can be applied to a smart home control system. In some possible embodiments, the smart home control system may include at least a terminal device and a smart device. In other possible embodiments, the smart home control system may also include at least a terminal device, a cloud server, and a smart device. It can be understood that before executing the process shown in Figure 4a, the smart device has completed device registration and account login, or received device sharing, etc. The process may include the following steps:
[0105] Step 401: The terminal device receives a voice control command input by the user. For example, if the smart device is an air conditioner, voice control commands may include, but are not limited to, "Adjust the temperature of air conditioner B to the maximum" or "Adjust the temperature of air conditioner B a little higher." If the smart device is a speaker, voice control commands may include, but are not limited to, "Turn up the volume of the speaker a little" or "Turn down the volume of the speaker." It is understood that a terminal device is a device capable of receiving voice control commands. For example, the terminal device may be a mobile phone, which may have a voice assistant app installed. In another example, the terminal device may be a smart speaker, which may also have a pre-installed voice assistant application or process.
[0106] Step 402: The terminal device analyzes the user's original intention based on the voice control instruction. In some possible embodiments, when the terminal device has processing capabilities, it can perform voice recognition and semantic analysis on the voice control instruction to analyze the user's original intention. For example, the original user intention corresponding to "adjust the temperature of air conditioner B to the maximum" may include: the controlled smart device is air conditioner B, the controlled function is temperature, and the intention is to adjust it to the maximum. For another example, the original user intention corresponding to "turn up the volume of the speaker a little bit" may include: the controlled smart device is a speaker, the controlled function is volume, and the intention is to turn it up a little bit.
[0107] Smart devices generally have one or more basic functions. For example, the basic functions of an air conditioner include temperature, wind speed, and wind direction. With the development of smart devices and the convenience of user control, there may also be a combination function mode composed of one or more basic functions. For example, an air conditioner may have an air conditioner sleep mode, and a desk lamp may have a desk lamp reading mode. Moreover, the combination function mode may also set the control value corresponding to each basic function. In this way, users can quickly control smart devices through the combination function mode. In an embodiment of the present application, in the smart home control system, when the control of the basic function is detected according to the original intention of the user, the control of the smart scene can be achieved through the embodiment introduced in Figure 4a; when the control of the combination function mode is detected according to the original intention of the user, the control of the smart scene can be achieved through the embodiment introduced in Figure 6a below.
[0108] Optionally, the terminal device can synchronize with the cloud server through the following steps 403a and 403b. In this way, in some possible embodiments, the cloud server can collect statistics on the control records of the same device by multiple terminal devices, so as to expand the historical control data. For example, the same user account can perform voice control on air conditioner B through a mobile phone and a smart speaker respectively; in this way, the cloud server can receive the control records of air conditioner B synchronized by the mobile phone, and can also receive the control records of air conditioner B synchronized by the smart speaker, so as to summarize the control records of air conditioner B by users through different terminal devices. In other possible embodiments, data synchronization can also be achieved between multiple terminal devices through short-range communication technology. Among them, short-range communication technology can include but is not limited to: Wi-Fi, Bluetooth, near field communication (NFC), etc.
[0109] Optionally, in step 403a, the terminal device synchronizes user control records and device information with the cloud server. In some possible embodiments, the terminal device may synchronize user control records and device information with the cloud server periodically or in response to a trigger event. Trigger events may include, for example, the detection of a new voice control event or manual synchronization triggering by the user. The device information may include, for example, a list of devices under the user account, such as air conditioner B and a speaker. The device information may also include, but is not limited to, device identification, device functions, and other information. For example, the functions of air conditioner B may include, but are not limited to, temperature, wind speed, and wind direction.
[0110] Optionally, in step 403b, the cloud server returns the user control record and device information to the terminal device. In some possible embodiments, the cloud server may return the user control record and device information of the same user account to the terminal device. In this scenario, the user control record and device information of the same user account on other terminal devices may also be included, thereby achieving data synchronization across multiple devices.
[0111] In some optional embodiments, when the terminal device has processing capabilities, the following step 404 and step 405 in Figure 4b below can be executed. In other optional embodiments, when the terminal device does not have processing capabilities or has weak processing capabilities, the user's original intention can be sent to the cloud server, which then executes the following step 404 and step 405 in Figure 4b below. In the embodiments of this application, the generation of device control commands by a terminal device is used as an example for description, as described in the following step 404 and step 405 in Figure 4b below.
[0112] Step 404: The terminal device parses the user control record and device information, and collects statistics on the historical control data based on the device function.
[0113] In some possible embodiments, the data sources of user control records may include, but are not limited to: historical control data of old functionally similar devices of the same type, historical control data of the currently controlled smart device, etc. In one possible scenario, the user has an old air conditioner (air conditioner A) and a new air conditioner (air conditioner B); and the user has an old speaker (speaker A) and a new speaker (speaker B). The following Table 1-0 shows a possible functional comparison information of functionally similar devices, as follows:
[0114] Table 1-0
[0115] As shown in Table 1-0, given that air conditioners A and B have similar functions, the smart home control system can reference the user's control history for air conditioner A to enable voice control of air conditioner B. This allows voice control of air conditioner B, even if the user has newly registered air conditioner B or shared it with someone else, to reference the historical control data of an older device with similar functions. This allows smart device control to better align with user behavior. Alternatively, given that air conditioners A and B have similar functions, the smart home control system can reference both the user's control history for air conditioner A and the historical control history for air conditioner B as historical control data to enable voice control of air conditioner B. This increased historical control data allows for more accurate analysis of user behavior, resulting in a user profile, enabling more precise voice control of smart devices based on that profile.
[0116] In an optional embodiment, the user's behavior habits are analyzed based on historical control data, which can be implemented as a statistical control number method. Taking air conditioner B as an example, the function control of air conditioner B is temperature adjustment; wherein the temperature adjustment method can include the maximum value of the temperature range and the temperature change accuracy value. In the embodiment of the present application, the historical control data can be statistically analyzed to obtain the user's behavior habits. For example, the following Tables 1-1, 1-2 and 1-3 are possible scenarios of statistical results, as follows:
[0117] Table 1-1
[0118] Table 1-2
[0119] Table 1-3
[0120] The statistical results shown in Tables 1-1 through 1-3 reflect user behavior habits through frequency. For example, Table 1-1 shows that the temperature range with the highest frequency has a maximum value of 27 degrees Celsius, indicating that users are accustomed to using 27 degrees Celsius as their intended maximum temperature value. Similarly, users are accustomed to using 20 degrees Celsius as their intended minimum temperature value and a temperature change step size of 2 degrees. It can be understood that when controlling a controlled smart device, using the temperature change step size that users are accustomed to can reduce user operations and thus improve control efficiency.
[0121] It should be noted that in the embodiments of the present application, other data information obtained through statistical analysis can also be used to obtain user behavior habits. For example, other data information may include but is not limited to user behavior information, control time information, outdoor temperature information, etc. This application does not limit the data analysis method. For example, through the process shown in Figure 4a, it is possible to respond to user voice control instructions and perform data analysis based on historical control data, so that the user's usage habits can be obtained by analyzing the number of times information obtained by statistics, so as to better match the user control intention indicated by the voice control instruction. It can be understood that Figure 4a is a possible embodiment provided by this application and is not used to limit the data analysis method of this application.
[0122] Refer to Figure 4b, which is another flow chart of a method for controlling a smart scene according to an embodiment of the present application. This flow can realize the control process of the smart device and may include the following process:
[0123] Step 405: The terminal device generates a device control command based on the user's original intention and the data information obtained through statistical analysis.
[0124] For example, in the scenario where the voice control command is "adjust the temperature of air conditioner B to the maximum", the corresponding user's original intention may include: the controlled smart device is air conditioner B, the controlled function is temperature, the intention is to adjust it to the maximum; and, based on the statistical results of Table 1-1, the maximum value of the temperature range with the highest number of times is 27 degrees.
[0125] In an optional embodiment, the device control command can take 27 degrees as the target control value. In addition, the terminal device can also feedback the control results to the user through voice reminders and / or interface reminders. Refer to Figure 5, which is a display interface diagram of the control results provided in the embodiment of the present application. As shown in interface 510 in Figure 5, in the embodiment of the present application, a prompt can be displayed on the display interface of the mobile phone: According to your historical control habits, the maximum temperature value of air conditioner B has been adjusted to 27 degrees, and the maximum adjustable temperature value of air conditioner B is 31 degrees. If it needs to be adjusted to 31 degrees, please continue to say to me "Adjust the maximum temperature of air conditioner B to 31 degrees." At the same time, the mobile phone can also prompt the user with the interface shown in interface 510 through voice playback. Optionally, the reminder method adopted by the terminal device can be based on the method pre-set by the user, such as only voice reminder method, or voice reminder and interface reminder method; it can also adopt the default setting method, etc., and this application does not limit this.
[0126] In addition, the reminder interface shown in Figure 5 may also include at least controls 501, 502, and 503; control 501 can be used to increase the temperature, control 502 can be used to decrease the temperature, and control 503 can be used to indicate the maximum adjustable temperature value of air conditioner B. In one possible embodiment, the mobile phone detects a user click on control 501 and, in response to the click, adjusts the maximum temperature value of air conditioner B to 28 degrees and records the adjustment information. Then, when the user's next voice control command is detected as "adjust air conditioner B to the maximum temperature," the device control command can use 28 degrees as the target control value.
[0127] In another optional embodiment, the device control command may also select the maximum value (MAX) from the maximum value of the temperature range with the highest number of times and the maximum adjustable temperature value of air conditioner B as the target control value. For example, if the maximum adjustable temperature value of air conditioner B is 31 degrees, 31 degrees can be used as the target control value. In addition, in this embodiment, the terminal device may also provide feedback on the control results to the user through voice prompts and / or interface prompts.
[0128] For another example, in the scenario where the voice control command is "turn up the volume of the speaker", the corresponding original intention of the user may include: the controlled smart device is a speaker, the controlled function is sound, and the intention is to turn up the volume; and, referring to the statistical results of Table 1-3, the volume change accuracy with the highest number of times is 10%. Based on this, the device control command can take a volume increase of 10% as the target control value. Combined with Table 1-0, the accuracy of speaker A is 10%, and the accuracy of speaker B is 5%. When the user is accustomed to using 10% as the volume adjustment step, when the user uses speaker B, 10% can also be used as the volume adjustment step for control. It can be understood that in this scenario, the target adjustment step of the voice control of the smart device provided in the embodiment of the present application may be different from the actual adjustment step of the device. In addition, the smart device or terminal device can also prompt the user through voice reminders or interface reminders that the volume adjustment step of speaker B can be set to 5%, so that the user can determine whether to update the adjustment step according to the user's intention.
[0129] In some possible embodiments, the terminal device can directly send device control commands to the smart device via short-range communication technology, as described in steps 406a to 406c. Examples of short-range communication technologies include, but are not limited to, Wi-Fi, Bluetooth, and NFC.
[0130] Step 406a: The terminal device sends a device control command to the smart device. For example, when the mobile phone and air conditioner B are connected to the same Wi-Fi, the mobile phone can directly send the generated device control command to air conditioner B via Wi-Fi technology.
[0131] Step 406b: The smart device returns a device response result to the terminal device. In some embodiments, the smart device may return a response result indicating successful device control to the terminal device.
[0132] Optionally, in step 406c, the terminal device records the control information. In some possible embodiments, the terminal device can incrementally update the historical control data based on the current control information, so that the historical control data can be updated in a timely manner, and more accurate device control commands can be obtained. In other possible embodiments, the terminal device can also retain a preset period or a preset amount of historical control data, and can delete expired control data in a timely manner, so as to obtain device control commands that are more in line with the user's current behavior habits. In addition, after the terminal device updates the control record, it can also refer to the contents of step 403a and step 403b to synchronize the user control record to the cloud server in a timely manner.
[0133] In some other possible embodiments, the terminal device may also send device control commands to the cloud server via the communication network, as described in steps 407a to 407e below.
[0134] Optionally, in step 407a, the terminal device sends a device control command to the cloud server. In some possible embodiments, when the terminal device and the smart device cannot communicate via short-range communication technology, they can communicate indirectly via the cloud server; or, the terminal device and the smart device may preferentially choose to communicate via the cloud server, which is not limited in this application.
[0135] Optionally, in step 407b, the cloud server receives the device control command sent by the terminal device and sends the device control command to the smart device. In some possible embodiments, when the terminal device generates a device control command, the cloud server can distribute the device control command to the corresponding smart home device. This can be understood as the smart device having completed device registration; it can also be understood as the cloud server being able to perceive the smart device.
[0136] In other possible embodiments, the cloud server may also receive voice control commands or user's original intent sent by the terminal device, analyze user control records and device information, calculate the number of times based on device functions and historical control data, and then generate device control commands based on the user's original intent and the number of times. In this embodiment, the cloud server can directly send the generated device control commands to the corresponding smart device, such as air conditioner B.
[0137] Optionally, in step 407c, the smart device returns a device response result to the cloud server.
[0138] Optionally, in step 407d, the cloud server receives the device response result sent by the smart device and records the control information.
[0139] Optionally, in step 407e, the cloud server returns a device response control command to the terminal device.
[0140] Through the above method, in the smart home control system, it is possible to generate device control commands based on the historical control data of similar devices based on the granularity of device type and device function. In addition, the maximum value of the target functional capability range of the device control command in this method can be determined based on the user's behavioral habits. In this case, the maximum value of the target functional capability range can be different from the maximum value of the actual functional capability range of the device; similarly, the target functional change accuracy value of the device control command can also be determined based on the user's behavioral habits. In this case, the target functional change accuracy value can be greater than the actual functional change accuracy value of the device. In this way, the user's control of the smart home can be adaptively adjusted without being limited to the functional capability range and functional change accuracy of the device in this application, thereby making the control more efficient and more in line with the user's behavioral habits.
[0141] Refer to Figure 6a, which is another flow chart of a control method for a smart scene provided in an embodiment of the present application. This process can be applied to a smart home control system. In some possible embodiments, the smart home control system may include at least a terminal device and a smart device. In other possible embodiments, the smart home control system may also include at least a terminal device, a cloud server, and a smart device. It can be understood that before executing the process shown in Figure 6a, the smart device has completed device registration and account login, or received device sharing, etc. Among them, the implementation method of steps 401 to 402 in Figure 6a can be found in Figure 4a, and will not be repeated in the following embodiments. The process shown in Figure 6a may include the following steps:
[0142] Step 401: The terminal device receives a voice control instruction input by a user.
[0143] Step 402: The terminal device analyzes the user's original intention based on the voice control instruction.
[0144] Optionally, in step 603a, the terminal device synchronizes device information and combined function mode information with the cloud server. The combined function mode indicates a function mode consisting of at least one basic function of the device and its corresponding control value, enabling users to easily adjust the device. For example, an air conditioner can be set to a sleep mode consisting of temperature, wind speed, and wind direction and their corresponding control values, or a desk lamp can be set to a reading mode consisting of brightness and its corresponding control value.
[0145] In some possible embodiments, the terminal device may periodically synchronize device information and combined functional mode information to the cloud server, or may synchronize control records and combined functional mode information to the cloud server in response to a trigger event. The trigger event may be, for example, detection of a new voice control event, manual synchronization triggering by the user, etc. For example, the following Table 2-0 shows an example of a possible combined functional mode information corresponding to air conditioner C and desk lamp A, as follows:
[0146] Table 2-0
[0147] As shown in Table 2-0, air conditioner C offers an air conditioner sleep mode, which combines the three basic functions of temperature, fan speed, and orientation. Furthermore, each basic function corresponding to the air conditioner sleep mode has a set control value. Desk lamp A offers a desk lamp reading mode, which indicates the state when the control value of the basic brightness function is set to 65.
[0148] Optionally, in step 603b, the cloud server returns device information and combined functional mode information to the terminal device. In some possible embodiments, the cloud server may return device information and combined functional mode information for the same user account to the terminal device. In this scenario, the cloud server may also return device information and combined functional mode information for the same user account on other terminal devices, thereby achieving data synchronization across multiple devices.
[0149] In some optional embodiments, when the terminal device has processing capabilities, the following step 604 may be executed, or steps 605 to 606 shown in Figure 6b below may be executed. In other optional embodiments, when the terminal device does not have processing capabilities or has weak processing capabilities, the user's original intention may be sent to the cloud server, which then executes the following step 604, or steps 605 to 606 shown in Figure 6b below. In the embodiments of the present application, the generation of device control commands by a terminal device is used as an example for description, as described in the following step 604 and steps 605 to 606 shown in Figure 6b.
[0150] Step 604: The terminal device obtains basic functions and corresponding control values according to the user's original intention, device type, and combined function mode name.
[0151] In some possible embodiments, the data source of the user control record may include but is not limited to: historical control data of old functionally similar devices of the same type, historical control data of old functionally different devices of the same type, historical control data of currently controlled smart devices, etc. In one possible scenario, the user has an old air-conditioning device (air-conditioning C), and a new air-conditioning device (air-conditioning D), wherein air-conditioning C has an air-conditioning sleep mode as shown in Table 2-0, while air-conditioning D does not support the air-conditioning sleep mode or the air-conditioning sleep mode is different from the air-conditioning sleep mode shown in Table 2-0; and the user has an old desk lamp device (desk lamp A), and a new desk lamp device (desk lamp B); wherein desk lamp A has a desk lamp reading mode as shown in Table 2-0, while desk lamp B does not have a desk lamp reading mode as shown in Table 2-0 or the control value of the desk lamp reading mode setting is different from the control value shown in Table 2-0. In order to facilitate the user to realize voice control of the new device through the historical control records of the old device, the method provided in the embodiment of the present application can simulate and generate the combined functional mode of the new device based on the combined functional mode information of the old device. The following Table 2-1 is an example of the basic functional information of air-conditioning D and desk lamp B, as follows:
[0152] Table 2-1
[0153] As can be seen from Table 2-1, air conditioner D has three basic functions: temperature, wind speed, and placement direction, and the desk lamp has the basic function of brightness.
[0154] It can be understood that through the process shown in Figure 6a, it is possible to implement the process of data collection and data analysis in response to user voice control commands, thereby providing reference data information for controlling smart devices. It should be noted that the embodiments of the present application do not limit the method of obtaining reference data information. For example, it is also possible to download data sets from the Internet to statistically analyze the combined functional mode information of similar devices.
[0155] Refer to Figure 6b, which is another flow diagram of a smart scene control method provided in an embodiment of the present application; wherein, the implementation of steps 406a to 407e in Figure 6b can be referred to as shown in Figure 4b, and will not be repeated in the following embodiments. This process can realize the control process of the smart device and may include the following process:
[0156] Step 605: Compare the smart device capabilities with the basic functions and corresponding control values of the combined function mode to determine the target control value.
[0157] In some possible embodiments, taking an air conditioner as an example, the following possible scenarios may be included in the scenario of controlling the combined function modes of the air conditioner:
[0158] Scenario 1: Air conditioner D does not support one or more basic functions included in the combined function mode of air conditioner C. In this case, the device control command generated for air conditioner D can omit control of these basic functions. For example, if air conditioner D does not support the basic left and right airflow direction function supported by air conditioner C, the device control command generated for the voice control scenario in which air conditioner D is set to air conditioner sleep mode may not control airflow direction. Furthermore, in this scenario, reminders can be sent to the user through voice reminders and / or interface reminders to help the user accurately understand the specific functions of the combined function mode.
[0159] In scenario 2, if the control value set for air conditioner C in sleep mode is within the adjustment range of air conditioner D, the target control value of air conditioner D can be directly referenced by the control value of air conditioner C. For example, if the temperature control value set for air conditioner C in sleep mode is 26 degrees, the generated device control command for the voice control scenario in which air conditioner D is set to sleep mode will include control information to set the temperature to 26 degrees.
[0160] In scenario 3, if the control value set for air conditioner C in sleep mode is outside the adjustment range of air conditioner D, the control value closest to air conditioner C's control value can be used to obtain the target control value for air conditioner D. For example, if the wind speed control value set for air conditioner C in sleep mode is set to level 4, then for the voice control scenario in which air conditioner D is set to sleep mode, the wind speed levels only include level 1, level 2, and level 3. The generated device control command will include setting the wind speed to level 3, which is closest to level 4.
[0161] Similarly, by using the method provided in the embodiment of the present application, it is possible to set the control value of the desk lamp sleep mode of desk lamp B with reference to the desk lamp sleep mode of desk lamp A, that is, to set it to 65.
[0162] Step 606: Generate device control commands based on the multiple functions and their corresponding target control values. Based on the information provided in step 605, the device control commands generated in this scenario can be understood as a combination of at least one basic function. For example, if the voice control command is "Set air conditioner D to sleep mode," the generated device control commands might include: setting the temperature to 26 degrees Celsius and the wind speed to level 3.
[0163] In some possible embodiments, the terminal device can directly send device control commands to the smart device via short-range communication technology, as described in steps 406a to 406c. Examples of short-range communication technologies include, but are not limited to, Wi-Fi, Bluetooth, and NFC.
[0164] Step 406a: The terminal device sends a device control command to the smart device.
[0165] Step 406b: The smart device returns a device response result to the terminal device.
[0166] Optionally, in step 406c, the terminal device records the control information.
[0167] In some other possible embodiments, the terminal device may also send device control commands to the cloud server via the communication network, as described in steps 407a to 407e below.
[0168] Optionally, in step 407a, the terminal device sends a device control command to the cloud server.
[0169] Optionally, in step 407b, the cloud server receives the device control command sent by the terminal device, and sends the device control command to the smart device.
[0170] Optionally, in step 407c, the smart device returns a device response result to the cloud server.
[0171] Optionally, in step 407d, the cloud server receives the device response result sent by the smart device and records the control information.
[0172] Optionally, in step 407e, the cloud server returns a device response control command to the terminal device.
[0173] Through the above method, in a smart home control system, not only can a function of a new device or a device shared by others be controlled based on historical control data of devices of the same or similar type, but a combination of functional modes consisting of at least one basic function can also be controlled, thereby simulating the existing combination functional modes of older devices. In this way, the user's control of the smart home can be adaptively adjusted without being limited to the functional capabilities and functional change accuracy of the device in this application, making the control more efficient and more in line with the user's behavioral habits.
[0174] In some possible embodiments, for the embodiments described in Figures 4a and 4b, or the embodiments described in Figures 6a and 6b, the embodiments of the present application may also provide the user with a switch control for turning on adaptive voice control through an interface. It is understood that when the user turns on the switch control for adaptive control, the smart home control system can use the embodiments described in Figures 4a and 4b, or the embodiments described in Figures 6a and 6b, to implement the smart scene control method provided in this application; when the user turns off the switch control for adaptive control, the smart home control system can implement voice control of the smart device based on the device's original functional capability range, function change accuracy, and combined function mode. In some possible embodiments, the switch control for adaptive control can act on all devices bound to the terminal device, or one switch control can act on a class of devices, or one switch control can act on one device. Refer to Figure 7 for an interface diagram of a smart scene control method provided in an embodiment of the present application. FIG7 shows an interface 700A, including a switch control 701 for adaptive control. It can be seen that switch control 701 can be applied to all devices in interface 700A, such as air conditioner A, air conditioner B, speaker B, and desk lamp B shown in interface 700A. FIG7 also shows an interface 700B, including multiple switch controls 702 for adaptive control. It can be seen that each device corresponds to a switch control 702. When switch control 702 is turned on, adaptive control can be performed on smart devices, such as air conditioner B, speaker B, and desk lamp B shown in interface 700B.
[0175] Refer to Figure 8, which shows a method for controlling a smart scene according to an embodiment of the present application. The method can be applied to electronic devices or smart home systems, and may include the following steps:
[0176] Step 801: Analyze the voice control command input by the user to determine the controlled smart device and the user's control intention.
[0177] Step 802: Obtain historical control data associated with the controlled smart device by the user. In some possible embodiments, the historical control data associated with the controlled smart device may include, but is not limited to: historical data of the controlled smart device; and historical control data of devices of the same type as the controlled smart device. For example, the controlled smart device may be a user's new air conditioner, and devices of the same type as the new air conditioner may be the user's old air conditioner.
[0178] Step 803: Generate a device control command corresponding to the user's control intent based on the historical control data. In some possible embodiments, the embodiment shown in FIG. 4b or the embodiment shown in FIG. 6b may be executed based on the voice control instruction to obtain the device control command, which will not be further described in this application.
[0179] Step 804: Based on the device control command, the controlled smart device is controlled. In some possible embodiments, when the controlled smart device itself executes step 803, the device control command can be directly executed. In other possible embodiments, when step 803 is executed by a terminal device such as a mobile phone or a tablet computer, and is different from the controlled smart device, the device control command can be sent to the controlled smart device through short-range communication technology or wired methods to achieve control of the controlled smart device. In other possible embodiments, when step 803 is executed by a cloud server, the device control command can be sent to the controlled smart device through a communication network or other methods to achieve control of the controlled smart device.
[0180] Based on the above embodiments, the present application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation. For example, execute steps 401 to 404 executed by the terminal device in the embodiment shown in Figure 4a; or execute steps 405 to 407e executed by the terminal device in the embodiment shown in Figure 4b, or execute steps 401 to 604 executed by the terminal device in the embodiment shown in Figure 6a, or execute steps 605 to 407e executed by the terminal device in the embodiment shown in Figure 6b, or execute steps 801 to 804 executed by the electronic device in the embodiment shown in Figure 8.
[0181] Based on the above embodiments, the present application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor performs the functions performed by the electronic device in each method described in the embodiments of the present application. For example, steps 401 to 404 performed by the terminal device in the embodiment shown in Figure 4a are executed; or steps 405 to 407e performed by the terminal device in the embodiment shown in Figure 4b are executed, or steps 401 to 604 performed by the terminal device in the embodiment shown in Figure 6a are executed, or steps 605 to 407e performed by the terminal device in the embodiment shown in Figure 6b are executed, or steps 801 to 804 performed by the electronic device in the embodiment shown in Figure 8 are executed.
[0182] Based on the above embodiments, the present application further provides a control system for a smart scene, which may include the electronic device and the controlled smart device as described in the above embodiments. Optionally, the system may also include a cloud server, or at least one other electronic device, or at least one other smart device.
[0183] Based on the above embodiments, the present application also provides a computer program product, which includes: a computer program (also called code, or instructions), which, when executed, enables a computer to execute the methods described in the embodiments of the present application.
[0184] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.
[0185] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the various methods described in the embodiments of the present application.
[0186] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the various methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. It should be understood by those skilled in the art that the embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0187] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.
[0188] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0189] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0190] Obviously, those skilled in the art may make various modifications and variations to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A method for controlling a smart scene, characterized in that: include: Analyze the voice control commands input by the user to determine the controlled smart device and the user's control intention; Acquire historical control data associated with the controlled smart device by the user; generating a device control command corresponding to the user control intention according to the historical control data; Based on the device control command, the controlled intelligent device is controlled.
2. The method according to claim 1, characterized in that: The controlling the controlled intelligent device based on the device control command includes: The controlled smart device is controlled based on a first control mode indicated by the device control command; wherein the first control mode is different from a second control mode specified by the factory for the controlled smart device.
3. The method according to claim 1 or 2, characterized in that: The user control intention is used to indicate the control of the basic functions of the controlled smart device; The generating, according to the historical control data, a device control command corresponding to the user intention comprises: From the historical control data, N pieces of data information corresponding to N control values are counted, where N is a positive integer; Determining a target control value from the N control values according to the N pieces of data information; The device control command is generated according to the target control value.
4. The method according to claim 3, characterized in that The controlled smart device is an air conditioner, the basic function includes temperature, and the target control value is a maximum temperature, a minimum temperature, or a temperature adjustment step; or, The controlled smart device is a speaker, the basic function includes sound, and the target control value is the maximum sound value, mute, or sound adjustment step.
5. The method according to claim 4, characterized in that The controlled smart device is an air conditioner, the basic function includes temperature, the maximum temperature is different from the nominal maximum temperature of the air conditioner, the minimum temperature is different from the nominal minimum temperature of the air conditioner, and the temperature adjustment step is different from the nominal temperature adjustment step of the air conditioner; The controlled smart device is a speaker, the basic functions include sound, the maximum sound value is different from the nominal maximum sound value of the speaker, and the sound adjustment step is different from the nominal sound adjustment step of the speaker.
6. The method according to claim 1 or 2, characterized in that: The user control intention is used to indicate the control of the combined function of the controlled smart device; the combined function is composed of M basic functions and corresponding M control values, where M is a positive integer; The generating, according to the historical control data, a device control command corresponding to the user intention comprises: From the historical control data, obtain L basic functions and corresponding L control values of the combined function of at least one similar device, where L is a positive integer; Determine the first basic function and the first control value corresponding to it in the device control command according to the first basic function in the L basic functions and the first control value corresponding to it; wherein the first control value is included in the factory nominal function range of the first basic function of the controlled smart device; According to the second basic function among the L basic functions and its corresponding second control value, the second basic function in the device control command and its corresponding third control value are determined; wherein the second control value is not included in the factory nominal functional range of the second basic function of the controlled intelligent device, and the first absolute difference between the third control value and the second control value is less than the second absolute difference; the second absolute difference is the absolute difference between the fourth control value and the second control value, and the fourth control value is any control value within the factory nominal functional range of the second basic function except the third control value.
7. The method according to claim 6, characterized in that The controlled smart device is an air conditioner, and the combined function includes at least one of temperature and its corresponding temperature value, wind speed and its corresponding wind speed gear, wind swing direction and its set placement direction.
8. The method according to claim 7, characterized in that The combination function indicated by the device control command is different from the nominal combination function of the air conditioner; or, the air conditioner does not have the combination function when leaving the factory.
9. The method according to any one of claims 1 to 8, characterized in that Before analyzing the voice control command input by the user to determine the controlled smart device and the user's control intention, the method further includes: The function of turning on adaptive control is detected.
10. The method according to claim 9, characterized in that The function of detecting the start of adaptive control includes: A switch control for turning on adaptive control is detected on the first interface.
11. The method according to any one of claims 1 to 10, characterized in that The associated historical control data includes: historical control data of the controlled smart device and historical control data of devices of the same type as the controlled smart device.
12. A control system for a smart scene, characterized in that: The system includes an electronic device and a controlled intelligent device; The electronic device is used to receive a voice control instruction input by a user; The electronic device is further used to analyze the voice control instruction to determine the controlled smart device and the user's control intention; obtain the historical control data associated with the controlled smart device by the user; and generate a device control command corresponding to the user's control intention based on the historical control data; Sending the device control command to the controlled smart device; The controlled smart device is used to receive the device control command; Control is performed according to the device control command.
13. An electronic device, characterized in that: The system comprises at least one processor coupled to at least one memory, wherein the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 11.
14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 11.
15. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Humidity control method and device for smart home, electronic equipment and storage medium
CN110413016A
Volume adjustment method and device based on voice control, equipment and medium
CN112185369A
Intelligent equipment and voice command self-establishing method and device of intelligent equipment
CN112331190A
Control instruction prediction method and device, storage medium and electronic device
CN114755931A
Voice response interfacing with multiple smart devices of different types
US20200380968A1
Cited By
Equipment control method and device, storage medium and electronic device
CN120895031A
