Device control method and apparatus, electronic device, and storage medium
By detecting the motion data of the remote control to wake it up and obtain working data, the problem of poor remote control operation in dark environments is solved, achieving greater device convenience and ease of function activation.
Patent Information
- Application Number
- CN202411447213.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-16
- Publication Date
- 2025-12-26
- Estimated Expiration
- 2044-10-16
AI Technical Summary
Existing remote controls are difficult to locate specific buttons in dark environments, resulting in reduced ease of operation.
By detecting the action data of the control device, the control device is woken up and working data is obtained. The controlled device or function is controlled according to the action type, eliminating the dependence on buttons.
It improves the ease of operation and function activation of the remote control in dark environments, and enhances the ease of waking up and operating the device.
Smart Images

Figure CN119472376B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of intelligent control, in particular, to a device control method and device, an electronic device and a storage medium. BACKGROUND
[0002] Intelligent devices are generally divided into control devices and controlled devices, and users control the controlled devices through the control devices. The whole control process includes two parts, the first part is that the user controls the control device, so that the control device transmits corresponding instructions to the controlled device, and the second part is that the controlled device executes corresponding actions according to the instructions. With the development of science and technology, users have multiple ways to control the control device, such as pressing the keys of the control device, voice input, etc. Taking a remote controller as an example, most of the current remote controllers have voice recognition function, so that users can control the remote controller through conversation.
[0003] However, the current remote controller needs the user to press a specific key on the remote controller first, so that the remote controller enters the voice recognition mode, and then the user can control the remote controller through conversation. For dark environment, the user is difficult to find the specific key, resulting in the decline of the convenience of the user to control the remote controller. SUMMARY
[0004] The present application provides a device control method and device, an electronic device and a storage medium, to at least solve the technical problem of poor control convenience of the device.
[0005] According to a first aspect of the embodiments of the present application, a device control method is provided, comprising:
[0006] obtaining first action data of a control device, the first action data representing the amplitude of the action of the control device and / or the type of the action;
[0007] According to the first action data, the control device is woken up and working data of the control device is obtained, wherein the working data is the data received or generated by the control device within a preset first target period after the control device performs the action corresponding to the first action data;
[0008] According to the data type of the working data, the first controlled device associated with the control device is controlled, so that the first controlled device acts.
[0009] Or, according to the data type of the working data, the control device is controlled to execute a target function.
[0010] According to a second aspect of the embodiments of the present application, a control device is provided, comprising a processing unit, an action recognition unit and a voice recognition unit; the action recognition unit and the voice recognition unit are electrically connected with the processing unit.
[0011] The action recognition unit is configured to recognize an action of the control device and generate corresponding action data, the action data including first action data and work data of an action class generated in sequence.
[0012] The processing unit is configured to wake up the action recognition unit and / or the voice recognition unit according to the first action data, wherein the wake-up includes at least one of switching from an off state to an on state and switching from a low-power state to a high-power state.
[0013] The action recognition unit is configured to recognize an action type of the work data of the action class, and control a first controlled device associated with the control device according to the action type corresponding to the work data, or start the voice recognition unit according to the action type corresponding to the work data.
[0014] The voice recognition unit is configured to collect voice data, so that the processing unit performs a corresponding action according to the voice data.
[0015] According to a third aspect of the embodiments of the present application, a control device is provided, which includes a sleep mode, an identification mode, a voice collection mode and an action control mode, and an action recognition function, a voice collection function and a communication function.
[0016] The control device is configured to:
[0017] If in the sleep mode, the action recognition function is in a low-power mode, and at least one of the voice collection function and the communication function is in an off or low-power mode, wherein the action recognition function in the low-power mode generates first action data when the control device generates an action, and the control device switches to the identification mode according to an amplitude of the action represented by the first action data or switches to the voice collection mode according to a type of the action represented by the first action data.
[0018] If in the identification mode, the action recognition function is in a high-power mode, wherein the action recognition function in the high-power mode generates work data of an action class when the control device generates an action, and the control device switches to the voice collection mode or the action control mode according to an action type of the work data of the action class; wherein the high-power mode refers to a mode in which the power consumption of the control device is greater than the power consumption in the low-power mode; the amount of data and / or the number of data types of the action data generated by the action recognition function in the high-power mode is greater than that in the low-power mode.
[0019] According to a fourth aspect of the embodiments of the present application, a device control system is provided, comprising a control device and a controlled device, the controlled device comprising a second controlled device and a first controlled device pre-connected in communication with the control device;
[0020] The control device operates according to the device control method described above, wherein the first controlled device and the second controlled device comprise controllable devices.
[0021] According to a fifth aspect of the embodiments of the present application, a device control apparatus is provided, comprising:
[0022] A first acquisition module is configured to acquire first action data of a control device, the first action data representing a magnitude of an action of the control device and / or a type of the action;
[0023] A wake-up module is configured to wake up the control device according to the first action data and acquire working data of the control device, wherein the working data is data received or generated by the control device within a preset first target time period after the control device performs an action corresponding to the first action data;
[0024] An execution module is configured to control a first controlled device associated with the control device to perform an action according to a data type of the working data.
[0025] Or, control the control device to perform a target function according to the data type of the working data.
[0026] According to a sixth aspect of the embodiments of the present application, an electronic device is provided, comprising a memory and a processor, the memory storing a device control method, and the processor being configured to execute the device control method using the device control method described above.
[0027] According to a seventh aspect of the embodiments of the present application, a computer readable storage medium is provided, storing a computer program capable of being loaded and executed by a processor to perform the method described above.
[0028] In the embodiments of the present application, the first action data represents the magnitude of the action of the control device and / or the type of the action, so that the user can wake up the control device by manipulating the action of the control device, thereby improving the convenience of waking up the control device. Similarly, the working data is data received or generated by the control device after the control device performs an action corresponding to the first action data, so that the user can generate the first action data and the working data by manipulating the action of the control device twice, thereby controlling the control device and improving the convenience of manipulating the control device.
[0029] In addition, different action types correspond to different functions performed by the control device, and specifically, under a certain action type, the control device performs a communication function, thereby controlling the first controlled device, so that the user directly controls the first controlled device by moving the control device, thereby improving the control convenience of the first controlled device; and specifically, under a certain action type, the control device performs a target function, thereby improving the convenience of starting the target function of the control device.
[0030] In summary, the first action data generated when the control device is moved and the working data received or generated thereafter are used to improve the convenience of waking up the control device, the convenience of operating the control device, the convenience of starting the function of the control device, and the convenience of controlling the first controlled device, i.e., the convenience of controlling the device. BRIEF DESCRIPTION OF DRAWINGS
[0031] Figure 1 FIG. 1 is a schematic diagram of an application environment of a device control method in an embodiment.
[0032] Figure 2 FIG. 2 is a flowchart of a device control method in an embodiment.
[0033] Figure 3 FIG. 3 is a flowchart of the control device performing a voice function in the device control method in an embodiment.
[0034] Figure 4 FIG. 4 is a structural block diagram of a control device in an embodiment.
[0035] Figure 5 FIG. 5 is a structural block diagram of a control device in another embodiment.
[0036] Figure 6 FIG. 6 is a structural block diagram of a wireless remote control device in an embodiment.
[0037] Figure 7 FIG. 7 is a mode switching schematic diagram of a wireless remote control device in an embodiment.
[0038] Figure 8 FIG. 8 is a control flowchart of a wireless remote control device in an embodiment.
[0039] Figure 9 FIG. 9 is a structural block diagram of a device control apparatus in an embodiment.
[0040] Figure 10 FIG. 10 is a structural block diagram of an electronic device in an embodiment. DETAILED DESCRIPTION
[0041] In order to better understand the technical scheme of the present application, the technical scheme in the embodiments of the present application will be clearly and completely described in the following with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of the present application.
[0042] It should be noted that the terms "first", "second", and the like in the description and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product or device.
[0043] According to an embodiment of the present application, an embodiment of a device control method is provided. It should be noted that the steps shown in the flowchart of the drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein.
[0044] Smart devices are generally divided into control devices and controlled devices, and users control the controlled devices by manipulating the control devices. The entire control process includes two parts, the first part is that the user manipulates the control device, so that the control device transmits corresponding instructions to the controlled device, and the second part is that the controlled device executes corresponding actions according to the instructions. With the development of technology, users have multiple ways to manipulate control devices, such as pressing the keys of the control device, voice input, etc. Taking a remote controller as an example, most of the current remote controllers have voice recognition function, so that users can manipulate the remote controller through dialogue.
[0045] However, the current remote controller requires the user to press a specific key on the remote controller first, so that the remote controller enters the voice recognition mode through the key, and then the user can manipulate the remote controller through dialogue. For dark environments, it is difficult for users to find the specific key, resulting in a decrease in the convenience of users manipulating the remote controller.
[0046] Based on this, the device control method provided in the embodiments of the present application detects the action of the control device itself to obtain the action data about the control device itself, and then causes the control device to selectively perform an action according to the action type of the action data. For example, the control device selectively performs an action such as starting a certain function (such as a voice detection function, a voice recognition function, and a communication function) of itself, sending a preset instruction (such as a start instruction for starting a controlled device or a close instruction for closing a controlled device) to a certain controlled device, and transmitting data (such as voice data received by the control device or action data) to a certain target device. Therefore, when a user wants to control the control device or a certain controlled device, the user only needs to control the control device to perform an action of a different action type, thereby improving the control convenience.
[0047] It should be noted that in some embodiments hereinafter, the action data includes first action data and action type working data, the controlled device includes a first controlled device and a second controlled device, and the action type includes picking up, shaking, rotating, tapping, pushing, and vibrating. The shaking and swinging belong to the action type of shaking.
[0048] The device control method provided in the present application can be applied to an application environment as shown in Figure 1 The application environment includes a smart device 10, a gateway 20, a router 30, a server 40, and a user terminal 50.
[0049] Specifically, the user terminal 50, which can also be referred to as a user end or a terminal, can be deployed (or installed) as a client associated with the smart device 10. The user terminal 50 can be a smartphone, a notebook computer, a personal computer, a tablet computer, a smart control panel, or other electronic devices that can implement network connection, which are not limited herein.
[0050] The user terminal 50 is associated with the smart device 10. In other words, the user registers an account in the user terminal 50 and configures the smart device 10 in the user terminal 50. For example, the configuration includes adding a device identifier to the smart device 10, so that when the user terminal 50 is running, the user terminal 50 can provide the user with device display and device control functions related to the smart device 10. The user terminal 50 can be in the form of an application program or a web page. Accordingly, the interface of the user terminal 50 for device display can be in the form of a program window or a web page, which is not limited herein.
[0051] The smart device 10 is deployed in the gateway 20 and communicates with the gateway 20 through a communication module configured by itself, and is controlled by the gateway 20. It should be understood that the smart device 10 generally refers to one of a plurality of smart devices 10, and the embodiments of the present application are only exemplified by the smart device 10, that is, the number and type of the smart device 10 deployed in the gateway 20 are not limited in the embodiments of the present application. In one application scenario, the smart device 10 accesses the gateway 20 through a local area network, so as to be deployed in the gateway 20. The process of the smart device 10 accessing the gateway 20 through the local area network includes that the gateway 20 first establishes a local area network, and the smart device 10 connects the gateway 20 to join the local area network established by the gateway 20. The local area network includes but is not limited to ZigBee or Bluetooth. The smart device 10 can be a smart printer, a smart fax machine, a smart camera, a smart air conditioner, a smart door lock, a smart lamp, a smart curtain, or an electronic device such as a remote controller, a human body sensor, a door and window sensor, a temperature and humidity sensor, a water immersion sensor, a natural gas alarm, a smoke alarm, a wall switch, a wall socket, a wireless switch, a wireless wall-mounted switch, a magic cube controller, and a curtain motor configured with a communication module.
[0052] The interaction between the user terminal 50 and the smart device 10 can be realized through a local area network, and can also be realized through a wide area network. In one application scenario, the user terminal 50 establishes a wired or wireless communication connection between the router 30 and the gateway 20, for example, the wired or wireless communication connection includes but is not limited to WiFi, so that the user terminal 50 and the gateway 20 are deployed in the same local area network, and then the user terminal 50 can realize the interaction with the smart device 10 through a local area network path. In another application scenario, the user terminal 50 establishes a wired or wireless communication connection between the server 40 and the gateway 20, for example, the wired or wireless communication connection includes but is not limited to 2G, 3G, 4G, 5G, WiFi, etc., so that the user terminal 50 and the gateway 20 are deployed in the same wide area network, and then the user terminal 50 can realize the interaction with the smart device 10 through a wide area network path.
[0053] The server 40 can also be referred to as a cloud, a cloud platform, a platform end, a server end, etc. The server 40 can be a server 40, a server 40 cluster composed of a plurality of servers 40, or a cloud computing center composed of a plurality of servers 40, so as to better provide background services to a large number of user terminals 50. For example, the background services include smart device 10 control services.
[0054] In one application scenario, server 40 acquires the first action data of smart device 10 as the control device and wakes up smart device 10 as the control device; server 40 then acquires the working data of smart device 10 as the control device and controls the actions of smart device 10 as the controlled device according to the data type of the working data or controls smart device 10 as the control device to perform the target function according to the data type of the working data.
[0055] In another application scenario, the intelligent device 10, acting as a control device, acquires its own first action data and wakes itself up. Then, it acquires its own working data and controls the actions of the intelligent device 10, acting as a controlled device, based on the data type of the working data, or runs its own target function based on the data type of the working data.
[0056] Based on this, the present application provides a device control method, such as... Figure 2 As shown, this method is applicable to electronic devices, which may specifically be... Figure 1 The server 40 in the application environment shown can also be Figure 1 The user terminal 50 in the application environment shown can also be Figure 1 The smart device 10 in the application environment shown.
[0057] In the following method embodiments, for ease of description, the execution subject of each step of the method is an electronic device, but this does not constitute a specific limitation.
[0058] like Figure 2 As shown, the method may include the following steps:
[0059] S100: Obtain the first action data of the control device.
[0060] Understandably, when a control device performs an action, the electronic device acquires the first action data corresponding to that action. When the electronic device is the control device itself, such as the main control chip, the main control chip acquires the action data transmitted by the detectors within the control device that detect its own actions and generate action data, using this as the first action data. When the electronic device is a user terminal or server, the user terminal or server acquires the action data transmitted by the detectors via communication technology as the first action data. Here, a detector refers to a detection device capable of detecting and generating action data, such as a six-axis sensor.
[0061] The control device refers to a device with a control function, i.e., a device capable of controlling the action of a controlled device, such as a remote controller, a temperature controller, and the like. It should be noted that if a smart device can both control a controlled device and be controlled by other smart devices, the smart device can act as a control device and as a controlled device of other control devices, which is not limited in the embodiment.
[0062] The controlled device refers to a device with a controlled function, i.e., a device capable of being controlled by a control device, such as a lamp, a curtain, an air conditioner, a refrigerator, and the like, which is not limited in the embodiment.
[0063] The first action data represents the amplitude of the action of the control device and / or the type of the action. Specifically, in an application scenario, the object that generates the first action data is the entire control device, which is different from the pressing of a key on the control device. That is, when the entire control device acts, the corresponding action data can be the first action data. If only one or more keys on the control device are pressed, the data generated thereby cannot be the first action data. In another application scenario, in addition to the corresponding action data of the entire control device acting as the first action data, the corresponding action data generated when one or more keys are pressed can also be the first action data.
[0064] In S102, the control device is woken up according to the first action data, and working data of the control device is obtained.
[0065] After the electronic device obtains the first action data, the control device is woken up according to the first action data. It should be noted that in an embodiment, waking up the control device includes two cases. The first case is to enable the woken-up control device to generate corresponding data after the control device itself acts. The second case is to enable the woken-up control device to receive voice data.
[0066] Therefore, when the content represented by the first action data is different, the wake-up result of the control device is also different. For example, when the type of the action represented by the first action data does not belong to the preset characteristic type but the amplitude of the action meets the requirement, the control device is woken up in the first case. When the type of the action represented by the first action data belongs to the preset characteristic type, the control device is woken up in the second case.
[0067] It can be understood that whether the electronic device wakes up the control device and what condition the woken-up control device is in need to be determined according to the amplitude and / or type of the action of the control device, which can be distinguished by preset wake-up conditions, which is not limited in the embodiment.
[0068] After the control device is woken up, the electronic device acquires working data of the control device. It can be seen that the working data refers to data obtained by the control device after the first action data. Different from the first action data, the working data can be data received by the control device or data generated by the control device. Specifically, the working data can be data such as voice and face recognition received by the control device, or data generated by the control device in action.
[0069] It should be noted that when the working data includes data generated by the control device in action, the working data is not only concerned with the amplitude of the action of the control device, but can also include data such as the action direction, action speed, and action frequency of the control device, which are not limited in the embodiment.
[0070] If the working data includes data generated by the control device in action, in an embodiment, the electronic device can distinguish the first action data and the working data by a preset time threshold when identifying the first action data and the working data. For example, it is preset that data obtained 100 ms after the first action data is generated can be used as the working data. This makes the action data generated by the control device in a continuous period of time all be determined as the first action data, which helps to improve the identification accuracy of the first action data and the working data.
[0071] In another embodiment, the first action data and the working data can be continuous action data. For example, in the process of picking up the control device, the control device generates continuous action data for 5 s, the electronic device continuously receives the action data generated by the control device, and at the 2nd second, the electronic device determines the action data in the first 2 s as the first action data and satisfies the condition of waking up the control device. At this time, the electronic device wakes up the control device and automatically uses the action data after 2 s as the working data, so that the user does not need to intentionally interrupt the action of the control device when controlling the control device, which helps to improve the control convenience of the control device.
[0072] It should be noted that the action type represented by the working data can be the same as or different from the action type represented by the first action data, which is not limited in the embodiment. For example, the action types represented by the first action data and the working data can both be rotation. When the control device is not woken up, the user rotates the control device, and the electronic device receives the action data as the first action data and wakes up the control device according to the first action data; when the control device is woken up, the user still rotates the control device, and the control device generates data related to the action, which is used as the working data by the electronic device.
[0073] In an embodiment, the working data is data of an action of the control device again occurring within a preset first target time period after the control device performs the action corresponding to the first action data. Specifically, the first target time period represents a length of time, which can be set according to actual needs. The first target time period is used to constrain a maximum time interval between the first action data and the working data, so as to avoid the electronic device continuously being in a state of obtaining working data after obtaining the first action data. For example, the first target time period can be 100 ms, 200 ms, or 250 ms. Taking 100 ms as an example, if the electronic device obtains action data within 100 ms after obtaining the first action data, the action data is taken as the working data, and if the 100 ms is exceeded, the electronic device will not take the obtained action data as the working data.
[0074] In S104, the first controlled device associated with the control device is controlled according to the data type of the working data, so that the first controlled device performs an action, or the control device performs a target function according to the data type of the working data.
[0075] After the electronic device obtains the working data, it can be known whether the working data is formed by data received by the control device or data generated by the control device. Based on this, the working data includes multiple data types. For example, when the working data is formed by voice received by the control device, the data type of the working data can be determined as voice type, and when the working data is data generated by an action of the control device, the data type of the working data can be determined as action type. When the data types are different, the subsequent execution actions of the electronic device are also different. Preferably, the subsequent execution actions of the electronic device specifically include controlling the first controlled device associated with the control device to perform an action or controlling the control device to perform a target function.
[0076] In an embodiment, the working data can represent an action type of the action of the control device, such as picking up, shaking, rotating, tapping, pushing, and vibrating, which are not specifically limited in the embodiment. How to distinguish the action type according to the working data is still not specifically limited in the embodiment, and the identification of the action type can be specifically implemented according to the specific content of the working data, for example, according to the action direction and action acceleration of the control device in the working data.
[0077] In an embodiment, the first controlled device refers to a controlled device pre-associated with the control device, and the action of the first controlled device is related to the first controlled device. For example, when the first controlled device is an air conditioner, the action of the first controlled device can include turning on, turning off, increasing temperature, decreasing temperature, and changing operation mode; when the first controlled device is a fan, the action of the first controlled device can include turning on, turning off, forward rotation, reverse rotation, acceleration, and deceleration, which are not specifically limited in the embodiment.
[0078] It should be noted that when there are multiple first controlled devices, different action types can be used to control different first controlled devices. For example, the first controlled devices include a living room air conditioner, a living room refrigerator, a bedroom air conditioner, and a kitchen refrigerator, and rotation is previously associated with the living room air conditioner, knocking is previously associated with the living room refrigerator, pushing is previously associated with the bedroom air conditioner, and shaking is previously associated with the kitchen refrigerator. When the action type of the work data is rotation, the living room air conditioner is controlled to act, and so on.
[0079] Since the first controlled device can include multiple actions, the action that the first controlled device needs to perform can also be set in a pre-configuration manner. For example, rotation is associated with the action of turning on the living room air conditioner, so that after the user rotates the control device, the living room air conditioner performs the turning-on action.
[0080] Similarly, different action types correspond to different target functions of the control device. For example, picking up or shaking corresponds to a voice recognition function, so that when the user picks up or shakes the control device, the electronic device controls the control device to perform the voice recognition function.
[0081] Through the above, the first action data represents the amplitude of the action of the control device and / or the type of the action, so that the user can wake up the control device by manipulating the action of the control device, thereby improving the convenience of waking up the control device. Similarly, the work data is data received or generated by the control device after the control device performs the action corresponding to the first action data, so that the user can generate the first action data and the work data by manipulating the action of the control device twice, thereby controlling the control device and improving the convenience of manipulating the control device.
[0082] In addition, different action types correspond to different functions of the control device, specifically including that under a certain action type, such as rotation, knocking, pushing, or shaking, the control device performs a communication function, thereby controlling the action of the first controlled device associated with the control device, so that the user only needs to make the control device act to directly control the first controlled device, without the need for the user to press a key or input a voice, thereby improving the convenience of controlling the first controlled device; specifically, it also includes that under a certain action type, such as picking up or shaking, the control device performs a target function, so that the user does not need to press a key to start the function (such as a voice function) of the control device, thereby improving the convenience of starting the target function of the control device.
[0083] In summary, by using the first action data generated when the control device acts and the work data received or generated thereafter, the convenience of waking up the control device, the convenience of manipulating the control device, the convenience of starting the function of the control device, and the convenience of controlling the first controlled device are improved, that is, the convenience of controlling the device is improved.
[0084] In another embodiment of the present application, the data type of the working data includes voice data;
[0085] As shown in Figure 3 controlling the control device to perform a target function according to the data type of the working data, including:
[0086] If the data type of the working data is voice data, S200 is performed to collect voice data.
[0087] That is, when the first action data directly wakes up the voice function of the control device, the data type of the working data is voice data. At this time, the electronic device collects voice data.
[0088] controlling the control device to perform one of the following target functions according to the voice data;
[0089] S202, transmitting the voice data to a preset target device, so that the target device controls the corresponding second controlled device according to the voice data.
[0090] The target device refers to a device with voice processing function, such as a gateway, a server, etc. Specifically, the target device can identify the controlled device, i.e. the second controlled device, that needs to be controlled according to the voice data, and can identify the specific action that the second controlled device needs to perform according to the voice data. For example, the control device is a voice remote controller. After the electronic device controls the voice remote controller to start the voice function, the voice remote controller can collect the user's voice and generate voice data. In the voice data, there is an object (second controlled device) that needs to be controlled, i.e. an air conditioner, and an action that needs to be controlled, i.e. turning on. Therefore, after the target device (gateway or server) obtains the voice data, it will take the air conditioner as the second controlled device and control the air conditioner to perform the turning on action.
[0091] S204, controlling the action of the corresponding second controlled device according to the voice data.
[0092] In an embodiment, the control device has a voice processing function, i.e. it can analyze the voice data to determine the controlled device that needs to be controlled, and take the control device as the second controlled device, and determine the action that the second controlled device needs to perform according to the voice data. For example, the voice data is "turn on the air conditioner" spoken by the user, and the control device is a voice remote controller. After the voice remote controller obtains the voice data, it processes the voice data to determine the object that needs to be controlled, i.e. the air conditioner, and the action that needs to be controlled, i.e. turning on, and then sends relevant instructions to the air conditioner, so that the air conditioner receives the relevant instructions and performs the turning on action.
[0093] S206, determining the second controlled device or determining the operating parameter that the second controlled device needs to adjust according to the voice data.
[0094] In an embodiment, the voice data can only contain the controlled device that needs to be controlled, and does not contain the action that the controlled device needs to perform, for example, the voice data is that the user says "adjust the bedroom lamp", at this time the control device takes the bedroom lamp as the second controlled device, and as for how the second controlled device performs the action, it can be determined according to subsequent control, which is not specifically limited in this embodiment. For ease of understanding, for example, the user shakes the control device subsequently, according to the preconfigured data, shaking 2 times means controlling the bedroom lamp to turn on, and shaking 4 times means controlling the bedroom lamp to turn off.
[0095] In an embodiment, the voice data contains the controlled device that needs to be controlled, and also contains the operating parameter that needs to be controlled, for example, the voice data is that the user says "air conditioner up 2 degrees", at this time it can be determined that the second controlled device is the air conditioner, and the operating parameter that needs to be adjusted is up 2 degrees.
[0096] It should be noted that which of steps S202-S206 is specifically executed needs to be determined according to specific voice data, that is, needs to be determined according to the content of what the user says.
[0097] Through the above content, the control control device to execute the voice function, can be according to the specific content of the voice data, realize different way control, improve the convenience of the control device voice control.
[0098] In another embodiment of the present application, after determining the second controlled device or determining the operating parameter that the second controlled device needs to adjust according to the voice data, the method further comprises:
[0099] Obtaining second action data of the control device.
[0100] The second action data is the data of the action that occurs again in the control device within a preset second target period after the control device receives the working data.
[0101] Specifically, the second target period is the same as the first target period, which will not be repeated here.
[0102] Controlling the second controlled device to adjust the operating parameter in the corresponding direction according to the action feature of the second action data.
[0103] If only the second controlled device or only the operating parameter is determined according to the voice data, and it is not possible to determine how to adjust the operating parameter, at this time the second action data is obtained, and the direction of the operating parameter adjustment is determined according to the action feature of the second action data.
[0104] The action feature is determined by the second action data, and the action feature includes at least one of a rotation direction, a knocking frequency, a knocking rhythm, a vibration frequency, and a pushing distance.
[0105] For example, when the rotating direction is clockwise, it indicates adjustment in the direction of increasing the operation parameter, and when the rotating direction is counterclockwise, it indicates adjustment in the direction of decreasing the operation parameter. Similarly, when the knocking times are odd, adjustment is in the direction of increasing the operation parameter, and when the knocking times are even, adjustment is in the direction of decreasing the operation parameter, which is not limited in the embodiment.
[0106] Through the above, after the voice function is executed, the second controlled device can be controlled according to the overall action of the control device, i.e., the second action data, which improves the convenience of device control.
[0107] In another embodiment of the present application, after the voice data is collected, the method further comprises:
[0108] If the control device stops collecting voice data or the operation condition of the control device meets the condition of stopping collecting voice data, the control device enters a sleep mode.
[0109] When the control device stops collecting voice data or meets the condition of stopping collecting voice data, the electronic device controls the control device to enter a sleep mode.
[0110] The control device stopping collecting voice data means that the control device actively stops collecting voice data, for example, a user presses a key for stopping collecting voice data. The condition of stopping collecting voice data is, for example, no voice of the user is detected within 10s, which is not limited in the embodiment.
[0111] The sleep mode means that the control device is in a state of lower power consumption relative to the wake-up state. The power consumption can be reduced by, for example, turning off some functions or hardware of the control device, which is not limited in the embodiment. For example, the display screen of the control device is turned off or the brightness of the display screen is reduced.
[0112] Through the above, the control device enters the sleep mode in time, which helps to reduce the power consumption of the control device.
[0113] In another embodiment of the present application, the data type of the work data includes an action class, and the action class includes at least one action type.
[0114] According to the data type of the work data, the first controlled device associated with the control device is controlled to make the first controlled device act, which comprises:
[0115] The first controlled device for communication is determined according to the action type and the preset first relationship, or the action performed by the first controlled device is determined according to the action type and the preset second relationship.
[0116] In the control of the first controlled device, there are two cases. One is that the first controlled device has only one, and the other is that the first controlled device has multiple. Since the first controlled device is a controlled device pre-associated with the control device, the number of the first controlled device is determined and known. When the first controlled device has multiple, the first controlled device to be communicated is determined according to the action type and the first relationship; when the first controlled device has only one, the action to be performed is determined according to the action type and the second relationship.
[0117] The first relationship includes the correspondence between different action types and corresponding first controlled devices, and the second relationship includes the correspondence between different action types and actions of the first controlled device.
[0118] If the first controlled device is determined, the working data is sent to the first controlled device, so that the first controlled device acts according to the working data.
[0119] That is, the control device is pre-associated with multiple first controlled devices. In the first relationship, different action types correspond to corresponding first controlled devices, so that the electronic device sends the working data to the determined first controlled device after determining the first controlled device according to the first relationship, and the first controlled device will perform the corresponding action according to the working data. For example, the first controlled device includes a living room air conditioner and a bedroom air conditioner. The first relationship includes vibration associated with the living room air conditioner and push associated with the bedroom air conditioner. If the action type of the working data is vibration, the working data is transmitted to the living room air conditioner, so that the living room air conditioner acts according to the working data. Wherein, the first controlled device performs what action according to the working data can be realized by pre-configuring the corresponding data, which is not limited in the embodiment. For example, the living room air conditioner is pre-configured to start when the received working data is vibration.
[0120] If the action performed by the first controlled device is determined, the control instruction is sent to the first controlled device after the control instruction is determined according to the working data, so that the first controlled device acts according to the control instruction.
[0121] That is, the control device is only associated with one first controlled device. At this time, the electronic device determines the control instruction according to the working data, so that the first controlled device performs a corresponding action according to the control instruction. In other words, the first controlled device includes a plurality of actions, the action types of the working data are different, and the actions performed by the first controlled device are different. For example, the voice remote controller is used as the control device, the control chip in the voice remote controller is used as the electronic device, and the first controlled device is the living room air conditioner. The actions that can be performed by the living room air conditioner include turning on / off, increasing temperature, decreasing temperature, increasing air volume, and decreasing air volume. The shaking is associated with turning on / off, the knocking is associated with increasing temperature, the rotating is associated with decreasing temperature, the vibration is associated with increasing air volume, and the translation is associated with decreasing air volume. The voice remote controller is only pre-associated with the living room air conditioner. Therefore, when the voice remote controller generates working data, the control chip in the voice remote controller identifies the action type of the working data. If the action type of the working data is shaking, the control chip generates a control instruction that can control the living room air conditioner to turn on or off. If the action type of the working data is vibration, the control chip generates a control instruction that can control the living room air conditioner to increase air volume.
[0122] Through the above, in the control, the working data of different action types correspond to different actions of the first controlled device, different situations are distinguished, the user can more flexibly control the first controlled device, and the convenience of device control is improved.
[0123] In another embodiment of the present application, the actions of the first controlled device include at least one of a device state adjustment action and a running parameter adjustment action.
[0124] The device state adjustment action refers to an action of changing the device state, for example, turning on, turning off, different modes, etc. The running parameter adjustment action refers to an action of changing the running parameter of the device, for example, a parameter in a certain mode. Taking the air conditioner as an example, the device state includes turning on, turning off, cooling, dehumidifying, etc. of the air conditioner, and the running parameter includes the running time, the running temperature, etc.
[0125] Through the above, the device state and the running parameter of the first controlled device can be adjusted, and the flexibility of device control is improved.
[0126] In another embodiment of the present application, the data type of the working data includes an action class, and the action class includes a first type of action and a second type of action.
[0127] The method includes:
[0128] If the data type of the working data is the action class and belongs to the first type, the control device is controlled to start the target function,
[0129] If the data type of the work data is the action type and belongs to the second type, the execution control controls the first controlled device associated with the control device to make the first controlled device act.
[0130] That is, for the case that the work data belongs to the action type, the type of the action represented by the work data is further distinguished into the first type and the second type. It should be noted that the first type and the second type correspond to different execution schemes, and therefore the actions of the first type and the second type cannot be the same.
[0131] The first type can be one or more of all action types, such as picking up, shaking, etc. Shaking is one of the cases of shaking, which is not limited in the embodiment.
[0132] The second type refers to an action type different from the first type, and the specific type is not limited in the embodiment. For example, when the first type is picking up, the second type can include other actions in addition to picking up.
[0133] For ease of understanding, the above scheme is illustrated with an example as follows.
[0134] When the user picks up the control device, the control device generates first action data. Since the wake-up condition of the control device is pre-configured, the control device determines which function of the control device to wake up according to the amplitude and type of the action. The pre-configured wake-up condition is: if the type of the action is picking up and the amplitude of the action exceeds 10, the voice function of the control device is directly woken up, so that the control device can collect voice; if the type of the action is not picking up and the amplitude of the action exceeds 10, the action recognition function of the control device is woken up.
[0135] As can be seen, since the user picks up the control device and the amplitude exceeds 10, the voice function of the control device is woken up and the data type of the work data is determined to be the voice type. Then, the control device collects voice and takes the voice data as the work data. Conversely, if the user rotates the control device and the amplitude exceeds 10, because the type of the action is not picking up, the action recognition function of the control device is woken up and the data type of the work data is determined to be the action type. Then, the control device generates action data when the control device acts again and takes the action data as the work data.
[0136] Based on this, the user pre-configures that the work data is the voice type, and controls the corresponding controlled device according to the specific voice meaning of the work data; when the work data is the action type, if the action type is rotation, the control device controls the curtain to open, if the action type is translation, the control device controls the lamp to open, and if the action type is tapping, the control device starts the voice function.
[0137] In the example, the user says "turn on the air conditioner", and the control device controls the air conditioner to turn on according to the voice meaning.
[0138] In other examples, if the user first rotates the control device so that the control device is woken up, and then translates the control device, the control device controls the light to turn on.
[0139] It can be seen that, in the above examples, the first action data is data generated during the user picking up the control device; the action type includes rotation and translation, wherein rotation and translation belong to the second type, and the tapping belongs to the first type.
[0140] That is, the embodiment includes three main control modes,
[0141] The first mode: the user manipulates the control device to make the voice function of the control device start, and then the user inputs the voice to control the controlled device;
[0142] The second mode: the user manipulates the control device to make the action recognition function of the control device start, and then the user manipulates the control device to make the first type of action, so that the voice function starts, and the user inputs the voice to control the controlled device;
[0143] The third mode: the user manipulates the control device to make the action recognition function of the control device start, and then the user manipulates the control device to make the second type of action, so that the control device controls the pre-associated controlled device.
[0144] Through the above, the control mode of the device is various, which is easy to improve the flexibility and convenience of device control.
[0145] In another embodiment of the present application, the working data includes the acceleration and / or angular velocity of the control device during the action;
[0146] The method further includes:
[0147] The action type represented by the working data is determined according to the acceleration and / or angular velocity of the control device during the action.
[0148] Through the above, the acceleration and / or angular velocity are easy to obtain and calculate, which is beneficial to reduce the calculation difficulty and reduce the occupation of calculation resources.
[0149] In another embodiment of the present application, the control device is woken up according to the first action data, including:
[0150] If the feature value representing the amplitude of the control device action of the first action data exceeds the preset amplitude threshold, the control device is woken up to obtain the working data generated by the control device receiving or generating.
[0151] a pre-set magnitude threshold, when the first motion data represents a magnitude of the motion of the control device exceeding the magnitude threshold, the control device is woken up, otherwise the control device is not woken up and remains in the sleep mode.
[0152] The first motion data comprises an acceleration and / or an angular velocity of the motion of the control device.
[0153] It can be understood that the magnitude of the motion of the control device can be calculated according to the acceleration and / or the angular velocity, and thus compared with the magnitude threshold, or the acceleration or the angular velocity can be directly used as the data representing the magnitude of the motion of the control device, and thus the magnitude threshold is also the acceleration value or the angular velocity value.
[0154] If the first motion data represents that the type of the motion of the control device is a pre-set characteristic type, the voice function of the control device is woken up to obtain working data generated by the control device receiving a voice.
[0155] That is, a specified motion type is pre-set as the characteristic type, for example, picking up, shaking, etc. When the type of the motion represented by the first motion data is the same as the characteristic type, the voice function of the control device is woken up, so that the control device can collect a voice and generate voice data, and thus the voice data is the working data received by the control device.
[0156] According to the above, by setting the magnitude threshold, the misjudgment rate can be reduced. Meanwhile, when the magnitude of the motion and / or the type of the motion of the first motion data are different, the wake-up of the control device is different, and thus the data type of the working data is different, which is helpful to improve the convenience and diversity of the device control.
[0157] In another embodiment of the present application, the first motion data and the working data are generated by one motion of the control device.
[0158] That is, in an embodiment, the first motion data and the working data are generated by one continuous motion, for example, a picking-up motion. For example, a user picks up the control device from a table, and the whole process lasts for 4 seconds. From the beginning to the end of the second second, the first motion data is generated, and the data generated thereafter is the working data.
[0159] According to the above, the complexity of the user operating the control device can be reduced, and thus the convenience of the device control is improved.
[0160] In another embodiment of the present application, the first type comprises at least one of picking up and shaking, and the second type comprises at least one of rotating, tapping, pushing and vibrating.
[0161] That is, in an application scenario, the actions corresponding to the first type and the second type are different, so that the action performed by the control device after being woken up is obviously distinguished. Specifically, when the user picks up the control device, since the action of picking up is not included in the second type, the control device will not be triggered to perform actions such as starting a voice function, communicating with a target device or a controlled device, and the like.
[0162] Through the above, the picking up, shaking, rotating, tapping, pushing and vibrating are convenient to be recognized according to the acceleration and / or angular velocity, which is conducive to improving the recognition accuracy of the action type.
[0163] The embodiments of the present application also provide a control device, as shown in Figure 4 The control device comprises a processing unit 1, an action recognition unit 2 and a voice recognition unit 3; the action recognition unit 2 and the voice recognition unit 3 are electrically connected with the processing unit 1.
[0164] The electrical connection refers to signal connection, which can be wireless connection realized by a wireless module, using electromagnetic wave to transmit signals, or wired connection realized by a physical cable, using electrical signals to transmit signals. The wireless module is, for example, a Bluetooth module, and the wired cable is, for example, an electric wire.
[0165] The action recognition unit 2 is configured to recognize the action of the control device and generate corresponding action data, wherein the action data comprises first action data and action class working data generated in sequence.
[0166] The action recognition unit 2 generates the action data when the control device as a whole generates the action. The first action data and the action class working data have a sequence, and only when the first action data is obtained first, the action of the control device generated again is determined as the action class working data.
[0167] The processing unit 1 is configured to wake up the action recognition unit 2 and / or the voice recognition unit 3 according to the first action data.
[0168] In an embodiment, an amplitude threshold is set in advance, and the first action data is used to represent the amplitude of the action of the control device. When the amplitude of the action of the control device exceeds the amplitude threshold, the processing unit 1 wakes up the action recognition unit 2 and / or the voice recognition unit 3. Preferably, when the control device generates the action, the acceleration and the angular velocity of the control device will change. The first action data is obtained by collecting the acceleration and / or the angular velocity of the control device, and the amplitude of the action of the control device is determined by the acceleration and / or the angular velocity.
[0169] The wake-up includes at least one of switching from a closed state to an open state and switching from a low-power consumption state to a high-power consumption state.
[0170] Specifically, the closed state refers to a state in which the action recognition unit and the voice recognition unit are in a closed state, i.e., an unopened state. Correspondingly, the opened state refers to a state in which the action recognition unit and the voice recognition unit are in an opened state. The low power consumption in the low power consumption state is compared with the high power consumption in the high power consumption state, i.e., the energy consumption of the action recognition unit or the voice recognition unit in the low power consumption state is lower than that in the high power consumption state.
[0171] The action recognition unit 2 is configured to recognize a type of action corresponding to working data of the action, and control a first controlled device associated with the control device according to the type of the action corresponding to the working data of the action, or start the voice recognition unit 3 according to the type of the action corresponding to the working data of the action.
[0172] The voice recognition unit 3 is configured to collect voice data, so that the processing unit 1 performs a corresponding action according to the voice data.
[0173] Through the above, the processing unit 1 can wake up the action recognition unit 2 and / or the voice recognition unit 3 according to the first action data, so that when the user needs to start the action recognition function and / or the voice recognition function of the control device, the user does not need to press the key at a specific position of the control device, thereby improving the convenience of the user in operating the control device. The processing unit 1 can also control the first controlled device or start the voice recognition unit 3 according to the working data, thereby improving the convenience of the control device.
[0174] In another embodiment of the present application, the action recognition unit includes a six-axis sensor, and the voice recognition unit includes a microphone.
[0175] In an embodiment, the six-axis sensor is always in an activated state, and when the control device moves, corresponding action data is generated. The control device determines the action data generated by the six-axis sensor as the first action data or the working data according to the mode in which the control device is located. When the control device is in a voice collection mode or performs a voice collection function, the microphone is activated, sound is collected by the microphone, and voice data is generated.
[0176] Through the above, the six-axis sensor can detect the acceleration when the control device moves and the angular velocity when the control device moves, which is beneficial to improve the data quantity and data coverage of the first action data and the working data, and is also beneficial to reduce the number of hardware in the control device, thereby reducing the cost of the control device.
[0177] In another embodiment of the present application, the control device further includes an indicator light and a buzzer, the indicator light and the buzzer are electrically connected to the processing unit, and the processing unit is configured to control the indicator light and / or the buzzer to be activated when the device state and / or the device data of the control device meet a preset prompting condition.
[0178] It should be noted that the prompting condition is not specifically limited in the embodiment, and the prompting condition can be set according to actual conditions. For example, the prompting can be performed when the voice recognition unit 3 or the action recognition unit 2 cannot be woken up; for another example, the prompting can be performed when the action type of the working data cannot be recognized.
[0179] Through the above, by setting the prompting condition, the prompting can be performed, and the use experience of the user is improved.
[0180] The embodiment of the application further provides a control device, as shown in the figure, comprising a sleep mode, a recognition mode, a voice collection mode and an action control mode, and an action recognition function, a voice collection function and a communication function. Figure 5
[0181] The control device is configured to:
[0182] If in the sleep mode, the action recognition function is in a low-power consumption mode, and at least one of the voice collection function and the communication function is in a closed or low-power consumption mode, wherein the action recognition function in the low-power consumption mode generates first action data when the control device has an action, and the control device switches to the recognition mode according to the amplitude of the action represented by the first action data or switches to the voice collection mode according to the type of the action represented by the first action data.
[0183] If in the recognition mode, the action recognition function is in a high-power consumption mode, wherein the action recognition function in the high-power consumption mode generates working data of an action class when the control device has an action, and the control device switches to the voice collection mode or the action control mode according to the action type of the working data of the action class; wherein the high-power consumption mode refers to a mode in which the power consumption of the control device is greater than the power consumption in the low-power consumption mode; the amount of data and / or the number of data types of the action data generated when the action recognition function is in the high-power consumption mode are greater than those when the action recognition function is in the low-power consumption mode.
[0184] It can be understood that the control device is in the sleep mode when the control device has no action. The overall power consumption of the control device in the sleep mode is low, which is specifically realized by reducing the power consumption of the action recognition function and closing the voice collection function and the communication function.
[0185] The switching between the sleep mode and the recognition mode is realized by the first action data generated by the action of the control device. Specifically, whether to switch from the sleep mode to the recognition mode is determined according to the amplitude of the action represented by the first action data. In the recognition mode, the overall power consumption of the control device is increased, which is specifically realized by increasing the power consumption of the action recognition function and opening the voice collection function and / or the action recognition function.
[0186] In the identification mode, the control device generates the action class work data when the control device is in action, and switches to the corresponding mode according to the action type of the action class work data. Specifically, if the action type of the action class work data is the first type, the control device switches to the voice collection mode, and if the action type of the action class work data is the second type, the control device switches to the action control mode.
[0187] For ease of understanding, the remote controller is taken as the control device, and the washing machine is taken as the first controlled device. When the user picks up the remote controller, the remote controller generates the first action data and determines that the amplitude of the action meets the condition of switching to the identification mode, so the remote controller switches from the sleep mode to the identification mode. Then the user rotates the remote controller, the remote controller generates the work data and identifies that the action type is the second type (rotation). The remote controller enters the action control mode according to the pre-configured data that the action type is the second type (rotation). After the remote controller enters the action control mode, the work data is sent to the washing machine, so that the washing machine performs actions such as turning on, turning off, and warming up according to the work data. Similarly, if the user translates the remote controller, the remote controller generates the work data and identifies that the action type is the first type (translation).
[0188] Through the above, when the control device is in the sleep mode, it is in the low-power-consumption mode and can switch to the identification mode according to the first action data. Since the first action data is the data generated when the control device is in action, it is convenient and fast for the user to switch the control device from the sleep mode to the identification mode, thereby improving the control convenience of the control device.
[0189] Similarly, when the control device switches from the identification mode to the voice collection mode or the action control mode, it is according to the work data, which also improves the control convenience of the control device.
[0190] In another embodiment of the present application, when the control device is in the sleep mode, if the feature value of the amplitude of the action represented by the first action data exceeds the preset amplitude threshold, the control device switches to the identification mode,
[0191] Or, when the control device is in the sleep mode, if the type of the action represented by the first action data is a preset feature type, the control device switches to the voice collection mode.
[0192] It can be understood that in an embodiment, the amplitude threshold is pre-set, and when the amplitude of the action of the control device represented by the first action data exceeds the amplitude threshold, the control device switches to the identification mode, otherwise the control device remains in the sleep mode. In another embodiment, the feature type is pre-set, and when the type of the action of the control device represented by the first action data is the same as the feature type, the control device switches to the voice collection mode.
[0193] The first action data includes the acceleration and / or angular velocity when the control device is in action.
[0194] It can be understood that the amplitude of the action of the control device can be calculated according to the acceleration and / or angular velocity as a characteristic value, and then compared with the amplitude threshold value in size, or the acceleration or angular velocity can be directly used as the characteristic value representing the amplitude of the action of the control device, and the amplitude threshold value at this time is also an acceleration value or an angular velocity value.
[0195] Through the above, by setting the amplitude threshold value, it is beneficial to reduce the error probability of switching from the sleep mode to the recognition mode, and improve the use experience of the control device.
[0196] In another embodiment of the present application, when in the recognition mode, if the data amount of the work data of the action class meets the preset data amount threshold value, the action recognition function is switched to the low-power mode.
[0197] In an embodiment, the control device continuously generates work data from the start to the end of the action, and when the data amount of the work data reaches the data amount threshold value, the action recognition function is switched to the low-power mode. For example, the user controls the control device to rotate, and the sensors such as acceleration and / or angular velocity in the control device generate corresponding data as work data when the control device starts to rotate. As the control device rotates, the acceleration and / or angular velocity of the control device changes (may not change), and the sensors continuously generate corresponding data, so that the data amount of the work data increases, until the data amount threshold value is reached, and the action recognition function is switched to the low-power mode and switched to the voice collection mode or the action control mode according to the action type of the work data.
[0198] Through the above, when the data amount meets the data amount threshold value, the low-power mode is switched, which is beneficial to reduce the power consumption of the control device.
[0199] In another embodiment of the present application, when in the voice collection mode, if the voice signal is transmitted to the target device or it is determined that the voice signal cannot be transmitted to the target device, the sleep mode is entered.
[0200] When in the action control mode, if the work data of the action class is transmitted to the pre-associated first controlled device or it is determined that the work data of the action class cannot be transmitted to the first controlled device, the sleep mode is entered.
[0201] It can be understood that the control device switches from the voice collection mode to the sleep mode once the voice signal is transmitted to the target device, or the control device switches from the voice collection mode to the sleep mode once it is determined that the voice signal cannot be transmitted to the target device. In this embodiment, the specific determination manner of determining that the voice signal cannot be transmitted to the target device is not limited, for example, the time threshold or the number threshold can be set to achieve this, for example, if the control device does not receive the feedback signal of the target device after transmitting the voice signal to the target device, the number is counted once and the voice signal is transmitted to the target device again, and the cycle is repeated until the accumulated number reaches the number threshold, and it is determined that the voice signal cannot be transmitted to the target device. In addition, it should be noted that for the case that the control device cannot establish a communication connection with the target device (for example, the target device or the control device is in a network drop state), it can be directly determined that the voice signal cannot be transmitted to the target device.
[0202] Similarly, in the action control mode, the control device switches from the action control mode to the sleep mode after transmitting the working data to the target device, or the control device switches from the action control mode to the sleep mode after determining that the working data cannot be transmitted to the target device. In this embodiment, the specific determination manner of determining that the working data cannot be transmitted to the target device is not limited, for example, the time threshold or the number threshold can be set to achieve this, for example, if the control device does not receive the feedback signal of the target device after transmitting the working data to the target device, the time is started to be counted and the working data is transmitted to the target device again, and the cycle is repeated until the accumulated time reaches the time threshold, and it is determined that the working data cannot be transmitted to the target device. In addition, it should be noted that for the case that the control device cannot establish a communication connection with the target device (for example, the target device or the control device is in a network drop state), it can be directly determined that the working data cannot be transmitted to the target device.
[0203] Through the above, when the voice signal is successfully transmitted to the target device or cannot be transmitted to the target device, the sleep mode is entered, which is beneficial to reduce the power consumption of the control device.
[0204] The embodiment of the present application also provides a device control system, which comprises a control device and a controlled device, and the controlled device comprises a second controlled device and a first controlled device which is in a pre-communication connection with the control device.
[0205] The control device operates according to the device control method described above, and the first controlled device and the second controlled device comprise controllable devices.
[0206] Through the above, the control device operates according to the device control method described above, so that the control device is easy to control, and the control convenience of the control device is improved.
[0207] In another embodiment of the present application, the control device is the control device described above.
[0208] Specifically, the device control method described above is applied to the smart home field.
[0209] In the traditional way, a user controls a controlled device such as an air conditioner, a lamp, a curtain, etc. by pressing a physical button on a remote controller (i.e. a control device).
[0210] With the development of science and technology, the emergence of speech recognition technology promotes the development of artificial intelligence. Through the speech recognition function, the machine can understand the human voice and complete the corresponding operation according to the human oral command, realizing the direct language exchange and control between man and machine. For example, a wireless remote control device realizes the effect of voice control of the controlled device through the speech recognition function of the remote controller.
[0211] The wireless remote control device technology is mainly based on speech recognition technology, speech synthesis technology and intelligent control technology. These technologies together provide users with a more convenient and humanized operation mode.
[0212] In the field of smart home, the voice control function has been widely used. For example, a user can turn on the light, adjust the light brightness, start a home theater, control the air conditioner, switch the audio / video channel, etc. through voice, which makes the function of home automation take a big step forward.
[0213] However, in the existing scheme, some remote controllers for controlling the controlled device through speech recognition need to press a physical button to enable the voice wake-up function, and can only send instructions through voice. Therefore, the existing remote control scheme uses physical buttons to directly control the controlled device, and one button can only correspond to one instruction. Some remote controllers for controlling the controlled device through speech recognition need to pick up the remote controller and press the physical button to enable the voice wake-up function, which reduces the convenience of device control.
[0214] Therefore, the device control method provided in the present embodiment is applied to a wireless remote control device, which can send wireless signals to remotely control the controlled device and can control the controlled device through a combination of voice and action. When a user picks up the wireless remote control device, the voice recognition of the wireless remote control device is triggered. At this time, the user issues an instruction through voice to control a specified controlled device, and then continues to rotate the action (or other actions) to adjust the state of the specified controlled device.
[0215] For example, the following scenarios:
[0216] Scene 1, after picking up the wireless remote control device, the voice recognition of the wireless remote control device is triggered, the user says "adjust the brightness of the lamp", and then rotates the wireless remote control device to adjust the brightness of the lamp, right rotation to brighten, left rotation to dim. That is, through the user's "pick up" action, the voice recognition function of the wireless remote control device is first awakened, and then the specified device is controlled through voice control.
[0217] It can be understood that scene 1 is to wake up the voice function by first manipulating the control device (i.e. the wireless remote control device) action (i.e. picking up), then determining the second controlled device (i.e. the lamp) according to the work data (i.e. adjusting the brightness of the lamp), and finally adjusting the operating parameter (i.e. brightness) of the lamp according to the second action data (i.e. right rotation / left rotation). Make the second controlled device (i.e. the lamp) execute the action of brightness adjustment.
[0218] Scene 2, after picking up the wireless remote control device, the voice recognition is triggered, and "adjust the volume size" is said, and then the wireless remote control device is rotated to adjust the size of the sound played by the sound box, the right rotation increases the volume, and the left rotation reduces the volume. That is, through the user's "pick up" action, the voice recognition of the wireless remote control device is first awakened, and then the specified device is controlled through voice control.
[0219] It can be understood that scene 2 is to wake up the voice function by first manipulating the control device (i.e. the wireless remote control device) action (i.e. picking up), then determining the operating parameter (i.e. volume) that needs to be adjusted according to the work data (i.e. adjusting the volume size), and finally adjusting the operating parameter (i.e. brightness) of the corresponding second controlled device (i.e. the sound box) according to the second action data (i.e. right rotation / left rotation). Make the second controlled device (i.e. the sound box) execute the action of volume adjustment.
[0220] The difference between scene 1 and scene 2 is that the second controlled device in scene 1 is determined according to the work data, and the second controlled device in scene 2 is pre-set.
[0221] Scene 3, after picking up the wireless remote control device, the voice recognition is triggered, and "adjust the window curtain" is said, and then the wireless remote control device is rotated to adjust the opening degree of the window curtain, the right rotation gradually opens the window curtain, and the left rotation gradually closes the window curtain. That is, through the user's "pick up" action, the voice recognition of the wireless remote control device is first awakened, and then the specified device is controlled through voice control.
[0222] It can be understood that scene 3 is to wake up the voice function by first manipulating the control device (i.e. the wireless remote control device) action (i.e. picking up), then determining the second controlled device (i.e. the window curtain) that needs to be adjusted according to the work data (i.e. adjusting the window curtain), and finally adjusting the operating parameter (i.e. opening degree) according to the second action data (i.e. right rotation / left rotation). Make the second controlled device (i.e. the window curtain) execute the action of opening and closing adjustment.
[0223] The difference from scenario 1 is that the running parameter in scenario 1 is determined according to the working data, and the running parameter in scenario 3 is preset. For example, the running parameter of the curtain is configured in advance as the opening and closing degree, so when the second controlled device is determined as the curtain, the opening and closing degree is adjusted.
[0224] Scenario 4, after picking up the wireless remote control device, triggering voice recognition, and saying "turn on the light", the light can be turned on. That is, the specified device can be directly controlled by voice, without subsequent actions, that is, only the voice function is used.
[0225] It can be understood that scenario 4 is to wake up the voice function by first manipulating the control device (i.e. the wireless remote control device) action (i.e. picking up), and then determining the second controlled device (i.e. the light) and the running parameter (i.e. the on-off state) that needs to be adjusted according to the working data (i.e. turning on the light). So that the second controlled device (i.e. the light) performs the action of adjusting the on-off state.
[0226] The difference from scenarios 1-3 is that in scenario 4, after obtaining the working data, the second controlled device and the running parameter that needs to be adjusted can be determined at the same time, so the user does not need to manipulate the control device again, that is, the second action data does not need to be generated.
[0227] Scenario 5, after configuring the automation, rotating the wireless remote control device to shake (or other actions such as reversing, pushing, etc.), the light can be turned on. That is, the state of the specified device can be directly adjusted only by action, that is, only the action control is used.
[0228] It can be understood that scenario 5 is to wake up the action recognition function by first manipulating the control device (i.e. the wireless remote control device) action (i.e. rotation), and then determining the first controlled device (i.e. the light) and the running parameter (i.e. the on-off state) that needs to be adjusted according to the type of working data (i.e. shaking). So that the first controlled device (i.e. the light) performs the action of adjusting the on-off state. It should be noted that if the action recognition function is woken up, the user taps the wireless remote control device, and the air conditioner is controlled to be turned on. That is, the action type of the working data is different, and the first controlled device is different. The running parameter that needs to be adjusted for the different first controlled device is determined according to the data of the automation configured in advance.
[0229] The difference from scenarios 1-4 is that in scenario 5, the wireless remote control device is no longer started by different action types to execute the action recognition function, and then the action is manipulated to control the specified first controlled device.
[0230] The above scenarios are merely examples; specific control can be implemented based on the user's actual automation configuration. In other words, if the wireless remote control device is pre-configured with automation data between the action and the controlled device, then the wireless remote control device can perform the action according to the configured automation data after the corresponding action occurs. For example, in scenario 5 above, because the automation data is pre-configured, when the user shakes the wireless remote control device, the wireless remote control device will control the light to turn on. Conversely, if the automation data associates shaking with air conditioning, then when the user shakes the wireless remote control device, it will turn on the air conditioner, not the light.
[0231] like Figure 6 The diagram shown is a structural block diagram of a wireless remote control device. The device includes a microphone, a main controller, a memory, a six-axis sensor, a battery, and a voice recognition unit. The battery can be a button cell, which powers the entire device. The main controller manages the communication, computation, and control functions of the device. The six-axis sensor communicates with the main controller via an I2C interface, and the sensor's signals are used for motion recognition. Typically, the six-axis sensor operates in a low-power mode. The voice recognition unit is used to collect voice signals. There can be one or more voice recognition units; this embodiment does not limit the number.
[0232] like Figure 7 As shown, the wireless remote control device includes four working modes:
[0233] (1) Under normal circumstances, the wireless remote control device is in sleep mode; sleep mode means that the main controller enters a sleep state, the microphone power is turned off, and the memory is disabled; only the six-axis sensor measures at a low rate. The six-axis sensor includes a three-axis accelerometer and a gyroscope. In sleep mode, the three-axis accelerometer works in a low-power mode, and the gyroscope is powered off.
[0234] (2) When the wireless remote control device is moved, if the measured value of the 3-axis accelerometer is greater than the threshold, the main controller is woken up and the wireless remote control device enters the recognition mode. The recognition mode refers to the working mode in which the main controller reads the measured value of the six-axis sensor and performs calculations and recognition actions. The specific workflow is as follows.
[0235] First, the six-axis sensor turns on the power to the internal gyroscope, which then starts working and increases the sampling rate of the three-axis accelerometer.
[0236] Secondly, the six-axis sensor samples the values of the 3-axis acceleration sensor and the gyroscope at the same time and writes the sampled values into the built-in memory of the six-axis sensor. When the built-in memory of the six-axis sensor is full, an interrupt is output to the master control. The master control reads the measurement data of the 3-axis acceleration sensor and the gyroscope in the built-in memory of the six-axis sensor until enough data are read (how much data need to be read is defined when the software and algorithm are written) and then the master control notifies the six-axis sensor to enter the sleep mode.
[0237] After that, the master control chip calculates and identifies the motion type using the read data. There are six motion types in total, which are picking up, shaking, rotating, tapping, pushing and vibrating. Finally, the device enters the sleep mode, the thread mode or the voice collection mode according to the identified motion.
[0238] (3) If the "picking up" or "shaking" motion is identified, the device enters the voice collection mode. The voice collection mode refers to the working mode in which the audio data is sent to the gateway.
[0239] 1. The master control is started and tries to connect to the gateway.
[0240] 2. The voice recognition unit starts to sample the audio and transmits the audio data to the master control.
[0241] 3. The master control determines whether the gateway has been connected. If the gateway is connected, the audio data is sent to the gateway. If the gateway is not connected, the audio data is stored in the chip. After the device is connected to the gateway, all the data is sent to the gateway. If the master control cannot connect to the gateway within 3 seconds, the data sampled and stored this time is discarded and the device directly enters the sleep mode.
[0242] 4. If the device receives the identification success flag bit sent by the gateway device, the power of the voice recognition unit is turned off and the reading and sending of the audio data are stopped. The device enters the sleep mode. If the identification success flag bit sent by the gateway device is not received, the reading, compression and sending of the audio data to the gateway are continued for 10 seconds (the duration can be adjusted as needed). After that, the device automatically enters the sleep mode.
[0243] It can be understood that after the "picking up" or "shaking" motion is identified, the type of the motion can be further judged. If one of the rotating, tapping, pushing and vibrating motions is identified, the controlled device is directly controlled to perform the motion.
[0244] (4) If one of the rotating, tapping, pushing and vibrating motions is identified, the device enters the thread mode. The thread mode refers to the working mode in which the identified motion data is sent to the gateway.
[0245] The master initiates a protocol, connects a gateway supporting the protocol and transmits the identified action to the bound device through the protocol;
[0246] If an undefined action is identified, the device reverts to the sleep mode.
[0247] The working process of the wireless remote control device is shown in Figure 8 .
[0248] In the first step, the wireless remote control device is initially in a sleep state and the six-axis sensor measures the amplitude of the device motion in a low-power mode;
[0249] In the second step, if the measured amplitude of motion does not exceed a preset threshold, the device remains in the sleep state; when the amplitude of motion exceeds the threshold, the master is woken up and the six-axis sensor is configured to turn on the power of the gyroscope and the acceleration sensor for high-speed measurement and read their values to calculate the type of action.
[0250] In the third step, if the type of action is one of "shake", "tap (two times)", "push" and "rotate", the master initiates a protocol to start connecting a gateway (a bound gateway or parent node, supporting the protocol): if the gateway is connected, the master sends the identified type of action to the gateway (the gateway performs a corresponding action according to preset operation rules) and automatically enters the first step; if the gateway is not connected, the master is prompted and automatically enters the first step;
[0251] In the fourth step, if the type of action is "pick up" or "swing", the master initiates a protocol to start connecting a gateway (a bound gateway or parent node, supporting the protocol), turns on the power of two voice recognition units and reads audio data, and compresses the audio data.
[0252] If the gateway is connected, the master sends the compressed audio data to the gateway through wireless communication, reads the audio data of the two voice recognition units, compresses the audio data, and stops reading, compressing and wirelessly sending the audio data immediately after receiving the "successful recognition" flag bit returned by the gateway, and automatically enters the first step; otherwise, the master continuously reads, compresses and wirelessly sends the audio data, and automatically stops reading, compressing and wirelessly sending the audio data after 10 seconds without receiving the "successful recognition" flag bit returned by the gateway, and automatically enters the first step.
[0253] The application also provides a device control apparatus, as shown in Figure 9 , which comprises a first acquisition module 11 configured to acquire first action data of a control device, the first action data representing the amplitude of the action of the control device.
[0254] The wake-up module 12 is used to wake up the control device according to the first action data and obtain the working data of the control device. The working data is the data of the action that the control device performs again within a preset first target time period after the control device performs the action corresponding to the first action data.
[0255] Execution module 13 is used to control the first controlled device associated with the control device according to the action type of the work data, so as to make the first controlled device act.
[0256] Alternatively, control the equipment to perform the target function based on the action type of the work data.
[0257] Based on the above, the wake-up module 12 can wake up the control device according to the first action data. Since the first action data is generated based on the overall action of the control device, the user does not need to press a button at a specific location on the control device, thus improving the convenience of waking up the control device. The execution module 13 can control the first controlled device or control the device to perform a target function based on the working data. Since the working data is generated based on the overall action of the control device, the user does not need to press a button at a specific location on the control device, thus improving the convenience of controlling the first controlled device or the control device itself.
[0258] This application also provides an electronic device, including a memory and a processor. The memory stores a device control method, and the processor is used to employ the device control method described above when executing the device control method.
[0259] Specifically, such as Figure 10 As shown, the electronic device includes a processor 100, at least one communication bus 200, a user interface 300, at least one external communication interface 400, and a memory 500. The communication bus 200 is configured to enable communication between these components. The user interface 300 may include a display screen, and the external communication interface 400 may include standard wired and wireless interfaces. The memory 500 stores device control methods. The processor 100 is used to employ the aforementioned methods when executing the device control methods stored in the memory 500.
[0260] This application also provides a computer-readable storage medium storing a computer program that can be loaded by a processor and execute the above-described methods.
[0261] The above description of the embodiments applied to electronic devices and storage media is similar to the description of the method embodiments described above, and has similar beneficial effects. For technical details not disclosed in the embodiments of electronic devices and storage media of this application, please refer to the description of the method embodiments of this application for understanding.
[0262] The above embodiment numbers of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.
[0263] In the above embodiments of the present application, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.
[0264] In the several embodiments provided by the present application, it should be understood that the disclosed technology can be implemented in other ways. Of course, the embodiment described above is only illustrative, and the division of units can be a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, unit or module, which can be electrical or other forms.
[0265] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on multiple units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0266] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The above integrated unit can be realized in the form of hardware or in the form of software functional unit.
[0267] When the integrated unit is realized in the form of software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of software product, which is stored in a storage medium and includes a plurality of instructions to make a computer device (which can be a personal computer, a server or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and various program code storage media.
[0268] The above merely describes the preferred embodiments of the present application, and it should be pointed out that, for those skilled in the art, some improvements and refinements can be made without departing from the principles of the present application, and these improvements and refinements should also be considered as the protection scope of the present application.
Claims
1. A device control method characterized by, The method comprises: acquiring first action data of a control device, the first action data representing the amplitude of the action of the control device and / or the type of the action; awakening the control device according to the first action data and acquiring working data of the control device, wherein the working data is the data received or generated by the control device within a preset first target period after the control device performs the action corresponding to the first action data; controlling a first controlled device associated with the control device according to the data type of the working data, so that the first controlled device performs an action; or, if the data type of the working data is voice, collecting voice data; determining a second controlled device or determining the operating parameter of the second controlled device that needs to be adjusted according to the voice data; acquiring second action data of the control device, wherein the second action data is the data of the action of the control device again within a preset second target period after the control device receives the working data; controlling the second controlled device to adjust the operating parameter in a corresponding direction according to the action feature of the second action data.
2. The device control method according to claim 1, characterized by, After collecting the voice data, the method further comprises: controlling the control device to perform one of the following target functions according to the voice data; transmitting the voice data to a preset target device, so that the target device controls a corresponding second controlled device to perform an action according to the voice data; controlling the action of the corresponding second controlled device according to the voice data.
3. The device control method according to claim 2, wherein The action feature is determined by the second action data, and the action feature includes at least one of the rotating direction, the number of taps, the tap rhythm, the shaking frequency and the pushing distance.
4. The device control method according to any one of claims 2-3, wherein, After collecting the voice data, the method further comprises: if the control device stops collecting voice data or the operating condition of the control device meets the condition of stopping collecting voice data, controlling the control device to enter a sleep mode.
5. The device control method according to claim 1, wherein The data type of the working data includes an action type, and the action type includes at least one action type; controlling the first controlled device associated with the control device to perform an action according to the data type of the working data, comprising: determining the first controlled device to communicate according to the action type and a preset first relationship, or determining the action performed by the first controlled device according to the action type and a preset second relationship, wherein the first relationship includes the correspondence between different action types and corresponding first controlled devices, and the second relationship includes the correspondence between different action types and the action of the first controlled device; if the first controlled device is determined, the working data is sent to the first controlled device, so that the first controlled device performs an action according to the working data, if the action performed by the first controlled device is determined, the control instruction is determined according to the working data, and then the control instruction is sent to the first controlled device, so that the first controlled device performs an action according to the control instruction.
6. The device control method according to claim 5, wherein The action of the first controlled device comprises at least one of a device state adjustment action and a running parameter adjustment action.
7. The device control method according to claim 1, wherein The data type of the working data comprises an action class, and the action class comprises a first type of action and a second type of action. The method comprises: If the data type of the working data is the action class and belongs to the first type, the control device is controlled to start a target function; If the data type of the working data is the action class and belongs to the second type, the first controlled device associated with the control device is controlled to make the first controlled device act.
8. The device control method according to claim 7, wherein The first type comprises at least one of picking up and shaking, and the second type comprises at least one of rotating, knocking, pushing and vibrating.
9. The device control method according to any one of claims 1-3, 5-8, wherein, The working data comprises acceleration and / or angular velocity when the control device acts; The method further comprises: The type of the action represented by the working data is determined according to the acceleration and / or angular velocity when the control device acts.
10. The device control method according to any one of claims 1-3, 5-8, wherein, The control device is woken up according to the first action data, comprising: If a characteristic value representing the amplitude of the action of the control device exceeds a preset amplitude threshold, the control device is woken up to obtain the working data generated by the control device receiving or generating, wherein the first action data comprises acceleration and / or angular velocity when the control device acts; If the type of the action of the control device represented by the first action data is a preset characteristic type, the voice function of the control device is woken up to obtain the working data generated by the control device receiving voice.
11. The device control method according to any one of claims 1 to 3, 5 to 8, wherein The working data comprises data generated by the action of the control device; The first action data and the working data are generated by the same action of the control device.
12. A control device, characterized by The device comprises a processing unit, an action recognition unit and a voice recognition unit; the action recognition unit and the voice recognition unit are electrically connected to the processing unit; The action recognition unit is configured to recognize the action of the control device and generate corresponding action data, wherein the action data comprises first action data and working data of an action class generated in sequence; The processing unit is configured to wake up the action recognition unit and / or the voice recognition unit according to the first action data, wherein the waking up comprises at least one of switching from a closed state to an open state and switching from a low-power consumption state to a high-power consumption state; The action recognition unit is configured to recognize the type of the action corresponding to the working data of the action class, so that the processing unit controls the first controlled device associated with the control device according to the type of the action corresponding to the working data, or, if the data type of the working data is a voice class, the voice recognition unit is started to collect voice data. The processing unit is further configured to determine a second controlled device or a running parameter that needs to be adjusted of the second controlled device according to the voice data, and obtain second action data of the control device, wherein the second action data is data generated by the action recognition unit in a preset second target period after the control device receives the working data, and the second action data is data generated by the action recognition unit when the control device generates the action again; and control the second controlled device to adjust the running parameter in a corresponding direction according to the action feature of the second action data.
13. The control device according to claim 12, characterized by The action recognition unit comprises a six-axis sensor, and the voice recognition unit comprises a microphone.
14. The control device according to claim 12, characterized by The control device further comprises an indicator light and a buzzer, both of which are electrically connected to the processing unit, and the processing unit is configured to control the indicator light and / or the buzzer to start when the device state and / or device data of the control device meet a preset prompt condition.
15. A control device, characterized by The control device comprises a sleep mode, an identification mode, a voice collection mode and an action control mode, and an action recognition function, a voice collection function and a communication function; The control device is configured to: If in the sleep mode, the action recognition function is in a low-power mode, and at least one of the voice collection function and the communication function is in an off or low-power mode, wherein the action recognition function in the low-power mode generates first action data when the control device generates an action, and the control device switches to the identification mode according to the amplitude of the action represented by the first action data or switches to the voice collection mode according to the type of the action represented by the first action data; If in the identification mode, the action recognition function is in a high-power mode, wherein the action recognition function in the high-power mode generates working data of an action class when the control device generates an action, and the control device switches to the voice collection mode or the action control mode according to the action type of the working data of the action class; wherein the high-power mode refers to a mode in which the power consumption of the control device is greater than the power consumption in the low-power mode; the amount of data and / or the number of data types of the action data generated by the action recognition function in the high-power mode are greater than those in the low-power mode.
16. The control device according to claim 15, characterized by The control device switches to the voice collection mode or the action control mode according to the action type of the working data of the action class, comprising: If the action type of the working data of the action class is a first type, the control device enters the voice collection mode, wherein the voice collection function is turned on and collects voice data when the control device is in the voice collection mode, and the voice data is sent to a preset target device; If the action type of the working data is a second type, the control device enters the action control mode, wherein the communication function is turned on, and the control device sends the working data to an associated first controlled device, so that the first controlled device performs an action according to the working data, Or, when in the action control mode, the communication function is turned on, and the control device sends a control instruction to the first controlled device according to the working data, so that the first controlled device acts according to the control instruction.
17. The control device according to claim 15, characterized by When in the sleep mode, if the characteristic value of the amplitude of the action represented by the first action data exceeds a preset amplitude threshold, the sleep mode is switched to the recognition mode, Or, when in the sleep mode, if the type of the action represented by the first action data is a preset characteristic type, the sleep mode is switched to the voice collection mode.
18. The control device according to claim 15, characterized by When in the recognition mode, if the data amount of the working data of the action class meets a preset data amount threshold, the action recognition function is switched to the low-power-consumption mode.
19. The control device of claim 16, wherein When in the voice collection mode, if the voice data is transmitted to the target device or it is determined that the voice data cannot be transmitted to the target device, the sleep mode is entered; When in the action control mode, if the working data of the action class is transmitted to the first controlled device or it is determined that the working data of the action class cannot be transmitted to the first controlled device, the sleep mode is entered.
20. An apparatus control system characterized by, The control device and the controlled device, the controlled device comprising a second controlled device and a first controlled device pre-communicatively connected with the control device; The control device operates according to the device control method in any one of claims 1-11, wherein the first controlled device and the second controlled device comprise controllable devices.
21. The equipment control system of claim 20, wherein, The control device is the control device in any one of claims 12-19.
22. An apparatus control device, characterized by comprising: Comprise: The first acquisition module is used for acquiring the first action data of the control device, and the first action data represents the amplitude of the action of the control device and / or the type of the action; The wake-up module is used for waking up the control device according to the first action data and acquiring the working data of the control device, wherein the working data is the data received or generated by the control device within a preset first target period after the action corresponding to the first action data occurs in the control device; The execution module is used for controlling the first controlled device associated with the control device according to the data type of the working data, so that the first controlled device acts; Or, if the data type of the working data is voice, voice data is collected; According to the voice data, a second controlled device is determined or a running parameter of the second controlled device that needs to be adjusted is determined; The second action data of the control device is acquired, wherein the second action data is the data of the action that occurs again in the control device within a preset second target period after the control device receives the working data; According to the action characteristics of the second action data, the second controlled device is controlled to adjust the running parameter in a corresponding direction.
23. An electronic device, comprising: Comprise a memory and a processor, the memory stores a device control method, and the processor is used for executing the device control method by using the device control method in any one of claims 1-11.
24. A computer-readable storage medium, characterized in that, A computer program is stored which can be loaded by a processor and perform the method according to any one of claims 1-11.
Citation Information
Patent Citations
Starting method, device and system and remote controller of voice recognition function
CN106251605A
Equipment control method and device, electronic equipment and medium
CN114613362A