Device control method, device and system, and device controller

Abstract

Disclosed are a device control method, apparatus, system and device controller. The system includes one or more devices, at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system. The device information of these devices is obtained, and corresponding output rules are configured for the input modules. In response to the input from the input module, an output module for executing the corresponding output is determined based on the output rule. The external input received by the input module of one device can be output through the output module of another device. In this way, multi-device linkage in a smart scene can be easily realized.

Description

Technical Field

[0001] The present disclosure relates to the Internet of Things, and more particularly to a method, device, and system for controlling one or more devices in the Internet of Things. Background Art

[0002] With the development of Internet of Things technology, smart home systems have been widely used and developed.

[0003] In the current smart home scenario, the intelligent control of a single device is relatively simple. For example, if you want to turn on or off a light or a camera, after setting the corresponding command, you can control the device such as a camera by issuing and transmitting the command.

[0004] However, it is still difficult to link multiple smart devices to achieve control in smart scenarios.

[0005] At present, the common practice is to realize the linkage of multiple smart devices through the mobile client. For example, you can set on the mobile client: "When the door is opened, turn on the porch light." This operation is more complicated. In addition, during development, each scene in various scenes such as turning on the light, drawing the curtains, turning on the TV, etc. needs to be developed, set up, and implemented separately, which is difficult.

[0006] Therefore, there is still a need for a device control solution that can easily realize the linkage of multiple devices in smart scenarios. Summary of the invention

[0007] A technical problem to be solved by the present disclosure is to provide a device control solution that can conveniently realize the linkage of multiple devices in a smart scene.

[0008] According to a first aspect of the present disclosure, there is provided a device control method, comprising: acquiring device information of one or more devices within a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; and configuring corresponding output rules for the input modules, so as to determine, in response to input from the input module, an output module for executing corresponding output based on the output rules.

[0009] Optionally, the method may further include: receiving input from an input module; determining a corresponding output module based on an output rule; and sending a message to the output module to execute an output corresponding to the input.

[0010] Optionally, the method may also include: sending a message to the device to which the input module belongs to inform the output rules configured for the input module, so that the device to which the input module belongs records the output rules, and in response to the input of the input module, sends a message to the device to which the output module belongs determined based on the output rules to execute the corresponding output.

[0011] Optionally, the method may further include: storing information of each device in a device list; and / or storing output rules configured for an input module in a rule list; and / or storing information of a configurator authorized to perform rule configuration in a configurator list.

[0012] Optionally, the device information stored in the device list includes at least one of the following: device identification information; information of the input module of the device, including input type information and / or corresponding output type information and / or transmission protocol information; information of the output module of the device, including output type information and / or corresponding input type information and / or transmission protocol information.

[0013] Optionally, the output modules allocated to the input modules based on the output rules include output modules of devices different from the device to which the input modules belong.

[0014] Optionally, the output rules include information of one or more output modules that meet the output requirements corresponding to the input module. When there are multiple output modules that meet the output requirements, the output rules also include a priority order of the multiple output modules, wherein, in response to the input of the input module, a currently available output module is selected based on the priority order.

[0015] Optionally, the step of configuring corresponding output rules for the input module includes: determining one or more output modules that meet the output requirements corresponding to the input module based on information of the input module and information of output modules possessed by each device in the system; and selecting an output module for executing corresponding output from one or more output modules, or determining a priority order of multiple output modules.

[0016] Optionally, the step of configuring corresponding output rules for the input module includes: receiving and recording the output rules configured and / or adjusted by the configurator for the input module.

[0017] Optionally, the method may also include: receiving device information of a new device newly added to the system, the device information including input module information and / or output module information thereof; and configuring output rules for the input module of the new device based on the device information of the new device and the device information of existing devices in the system, and / or adding the output module of the new device to the output rules of the output modules of the existing devices.

[0018] Optionally, a device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or an input module has two or more corresponding output types, and output rules are configured for each corresponding output type of an input module respectively.

[0019] Optionally, the method may further include: updating the output rule in response to a rule update instruction.

[0020] Optionally, the step of updating the output rule includes at least one of the following: adding an output rule; deleting an output rule; and adjusting the output rule.

[0021] Optionally, the method may further include: maintaining a policy for configuring output rules, wherein, in the step of configuring corresponding output rules for the input module, the output rules are configured according to the policy.

[0022] Optionally, the strategy includes at least one of the following: an output module selection strategy; an output module priority determination strategy; an output module scheduling strategy when multiple input modules simultaneously require the same type of output; a strategy for configuring output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living body; a rescheduling strategy for adjusting the output module selection in response to changes in the position of the input module and / or the position of the output module and / or the position of the living body; and a processing strategy for the case where there is no matching output module.

[0023] Optionally, the method may further include: updating the policy in response to a policy update instruction.

[0024] Optionally, the policy update instruction comes from a server and / or a configurator.

[0025] Optionally, the method may further include: adjusting corresponding output rules in response to a change in the state of the device in the system.

[0026] Optionally, the step of adjusting the corresponding output rules in response to the state change of the device in the system includes: adjusting the corresponding output rules for the input module of the device; and / or scheduling among the output modules in the system that have the same output function as the output module of the device to adjust the corresponding output rules.

[0027] Optionally, the state change of the device in the system includes at least one of the following: opening, closing, adding, deleting, and replacing.

[0028] Optionally, the method may further include: providing online status information of input modules and / or output modules of each device in the system, wherein the input modules and / or output modules turned on in the devices that have joined the system and are online are in an online state.

[0029] Optionally, input received from outside the system is an input with a corresponding output.

[0030] Optionally, the step of configuring corresponding output rules for the input module includes: configuring the output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living body.

[0031] Optionally, the method may also include: sensing a position change of an input module and / or a position change of an output module, and adjusting corresponding output rules in response to the position change of the input module and / or the position change of the output module; and / or sensing a position change of a living body, and adjusting corresponding output rules in response to the position change of the living body.

[0032] Optionally, the step of adjusting the corresponding output rules in response to the change in the position of the living body includes: in response to the living body being near the first input module, using the first input module to receive the input of the living body, and executing the corresponding output based on the output rules corresponding to the first input module; in response to the living body moving from the vicinity of the first input module to the vicinity of the second input module, turning on the second input module, turning off the first input module, using the second input module to receive the input of the living body, and executing the corresponding output based on the output rules corresponding to the second input module.

[0033] Optionally, the first input module and the second input module have the same input type; and / or the first input module and the second input module include a microphone and / or a camera.

[0034] Optionally, the step of adjusting the corresponding output rules in response to the change in the position of the living body includes: in response to the living body being near a first output module, using the first output module to execute the output corresponding to the input module; in response to the living body moving from the vicinity of the first output module to the vicinity of a second output module, turning on the second output module, turning off the first output module, and adjusting the output rules of the input module to use the second output module to execute the output corresponding to the input module.

[0035] Optionally, the first output module and the second output module have the same output type; and / or the first output module and the second output module include a speaker and / or a display.

[0036] Optionally, the step of configuring corresponding output rules for the input module includes: setting output rules applicable to at least one mode respectively, and the method also includes: determining the input module currently used to receive input based on the current mode; and / or determining the output module used to execute corresponding output based on the output rules applicable to the current mode.

[0037] Optionally, the mode includes at least one of the following: at least one mode set based on life form type; at least one mode set based on user age and / or role; at least one mode set based on time and / or environmental parameters.

[0038] Optionally, the step of configuring corresponding output rules for the input module includes: setting output rules that are respectively applicable to at least one scenario, and the method also includes: determining the input module currently used to receive input based on the current scenario; and / or determining the output module used to execute corresponding output based on the output rules applicable to the current scenario.

[0039] Optionally, the method may further include: identifying the current scene based on at least one of time, environmental parameters, the number of life forms, life form identity information, life form position, and life form movement trajectory.

[0040] Optionally, setting output rules that are respectively applicable to at least one scenario includes: based on the user's historical behavior with respect to the input module and / or the output module, combined with at least one of the time, environmental parameters, number of life forms, identity information of life forms, position of life forms, and movement trajectory of life forms corresponding to the historical behavior, identifying new scenarios and setting output rules that are applicable to the new scenarios.

[0041] Optionally, the method may also include: training a rule setting model based on the user's historical behavior with respect to the input module and / or output module, combined with at least one of the time, environmental parameters, number of life forms, life form identity information, life form position, and life form movement trajectory corresponding to the historical behavior; using the rule setting model to identify the current scene based on at least one of the current time, environmental parameters, number of life forms, life form identity information, life form position, and life form movement trajectory, and setting output rules applicable to the current scene.

[0042] Optionally, the method may further include: in response to the input module receiving input from outside the system, determining an output module for executing a corresponding output based on an output rule determined for the input module; and waking up the output module to execute the corresponding output.

[0043] According to a second aspect of the present disclosure, there is provided a device control method, comprising: acquiring device information of one or more devices within a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; maintaining a policy for configuring output rules; and configuring corresponding output rules for the input modules according to the policy, so as to determine, in response to input from the input module, an output module for executing corresponding output based on the output rule.

[0044] Optionally, the strategy includes at least one of the following: an output module selection strategy; an output module priority determination strategy; an output module scheduling strategy when multiple input modules simultaneously require the same type of output; a strategy for configuring output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living body; a rescheduling strategy for adjusting the output module selection in response to changes in the position of the input module and / or the position of the output module and / or the position of the living body; and a processing strategy for the case where there is no matching output module.

[0045] Optionally, the method may further include: updating the policy in response to a policy update instruction.

[0046] Optionally, the policy update instruction comes from a server and / or a configurator.

[0047] According to a third aspect of the present disclosure, there is provided a device management method, comprising: obtaining device information of one or more devices in a system and / or requesting to join the system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; configuring corresponding output rules for the input modules, so as to determine, in response to input from the input module, an output module for executing corresponding output based on the output rules; and adjusting the corresponding output rules in response to a change in the state of the device in the system.

[0048] Optionally, the step of adjusting the corresponding output rules in response to the state change of the device in the system includes: adjusting the corresponding output rules for the input module of the device; and / or scheduling among the output modules in the system that have the same output function as the output module of the device to adjust the corresponding output rules.

[0049] Optionally, the state change of the device in the system includes at least one of the following: opening, closing, adding, deleting, and replacing.

[0050] Optionally, the method may further include: providing online status information of input modules and / or output modules of each device in the system, wherein the input modules and / or output modules turned on in the devices that have joined the system and are online are in an online state.

[0051] According to a fourth aspect of the present disclosure, there is provided a device control method, comprising: acquiring device information of one or more devices within a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; and configuring corresponding output rules for the input module with reference to the position of the input module and / or the position of the output module and / or the position of the living body, so as to determine, in response to the input from the input module, an output module for executing the corresponding output based on the output rule.

[0052] Optionally, the method may also include: sensing a position change of an input module and / or a position change of an output module, and adjusting corresponding output rules in response to the position change of the input module and / or the position change of the output module; and / or sensing a position change of a living body, and adjusting corresponding output rules in response to the position change of the living body.

[0053] Optionally, the step of adjusting the corresponding output rules in response to the change in the position of the living body includes: in response to the living body being near the first input module, using the first input module to receive the input of the living body, and executing the corresponding output based on the output rules corresponding to the first input module; in response to the living body moving from the vicinity of the first input module to the vicinity of the second input module, turning on the second input module, turning off the first input module, using the second input module to receive the input of the living body, and executing the corresponding output based on the output rules corresponding to the second input module.

[0054] Optionally, the first input module and the second input module have the same input type; and / or the first input module and the second input module include a microphone and / or a camera.

[0055] Optionally, the step of adjusting the corresponding output rules in response to the change in the position of the living body includes: in response to the living body being near a first output module, using the first output module to execute the output corresponding to the input module; in response to the living body moving from the vicinity of the first output module to the vicinity of a second output module, turning on the second output module, turning off the first output module, and adjusting the output rules of the input module to use the second output module to execute the output corresponding to the input module.

[0056] Optionally, the first output module and the second output module have the same output type; and / or the first output module and the second output module include a speaker and / or a display.

[0057] According to a fifth aspect of the present disclosure, a device control method is provided, comprising: obtaining device information of one or more devices in a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; and configuring output rules applicable to at least one mode for the input modules, so as to determine an output module for executing a corresponding output based on the output rule in response to input from the input module. The method further comprises: determining an input module currently used to receive input based on a current mode; and / or determining an output module for executing a corresponding output based on an output rule applicable to the current mode.

[0058] Optionally, the mode includes at least one of the following: at least one mode set based on life form type; at least one mode set based on user age and / or role; at least one mode set based on time and / or environmental parameters.

[0059] According to a sixth aspect of the present disclosure, a device control method is provided, comprising: obtaining device information of one or more devices in a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; and configuring output rules applicable to at least one scenario for the input modules, so as to determine an output module for executing a corresponding output based on the output rule in response to input from the input module. The method further comprises: determining an input module currently used to receive input based on a current scenario; and / or determining an output module for executing a corresponding output based on an output rule applicable to the current scenario.

[0060] Optionally, the method may further include: identifying the current scene based on at least one of time, environmental parameters, the number of life forms, life form identity information, life form position, and life form movement trajectory.

[0061] Optionally, setting output rules that are respectively applicable to at least one scenario includes: based on the user's historical behavior with respect to the input module and / or the output module, combined with at least one of the time, environmental parameters, number of life forms, identity information of life forms, position of life forms, and movement trajectory of life forms corresponding to the historical behavior, identifying new scenarios and setting output rules that are applicable to the new scenarios.

[0062] Optionally, the method may also include: training a rule setting model based on the user's historical behavior with respect to the input module and / or output module, combined with at least one of the time, environmental parameters, number of life forms, life form identity information, life form position, and life form movement trajectory corresponding to the historical behavior; using the rule setting model to identify the current scene based on at least one of the current time, environmental parameters, number of life forms, life form identity information, life form position, and life form movement trajectory, and setting output rules applicable to the current scene.

[0063] According to a seventh aspect of the present disclosure, there is provided a device control method, comprising: acquiring device information of one or more devices within a system, wherein at least one device has an input module for receiving input from outside the system, and at least one device has an output module for outputting to outside the system; configuring corresponding output rules for the input module, so as to determine, based on the output rules, an output module for executing corresponding output in response to input from the input module; determining, in response to the input module receiving input from outside the system, an output module for executing corresponding output based on the output rules determined for the input module; and waking up the output module to execute the corresponding output.

[0064] According to an eighth aspect of the present disclosure, an input system is provided, comprising: a plurality of devices each having an input module; and a positioning device for determining a position of a living being; wherein, in response to the living being being near a first input module, the first input module is used to receive input from the living being, and a corresponding output is performed based on an output rule corresponding to the first input module; in response to the living being moving from the vicinity of the first input module to the vicinity of a second input module, the second input module is turned on, the first input module is turned off, the second input module is used to receive input from the living being, and a corresponding output is performed based on an output rule corresponding to the second input module.

[0065] According to a ninth aspect of the present disclosure, there is provided an output system, comprising: a plurality of devices respectively having output modules; and a positioning device for determining the position of a living being; wherein, in response to the living being being near a first output module, the first output module is used to execute an output corresponding to an input module; and in response to the living being moving from the vicinity of the first output module to the vicinity of a second output module, the second output module is turned on, the first output module is turned off, and the output rules of the input modules are adjusted so as to use the second output module to execute an output corresponding to the input module.

[0066] According to a tenth aspect of the present disclosure, a device controller is provided, comprising: a memory, storing device information of one or more devices added to the system in a device list on the memory, wherein at least one device has an input module and at least one device has an output module; and a processor, configured to configure corresponding output rules for the input modules and store the output rules configured for the input modules in a rule list on the memory, so as to determine, in response to an input from the input module, an output module for executing the corresponding output based on the output rules.

[0067] Optionally, the device controller may further include: a communication module for communicating with one or more devices so that the processor can execute the step of configuring corresponding output rules and enable data flow from the input module to the output module based on the output rules.

[0068] Optionally, the communication module receives device information of a new device newly added to the system, the device information including input module information and / or output module information thereof; and the processor configures output rules for the input module of the new device based on the device information of the new device and the device information of existing devices in the system, and / or adds the output module of the new device to the output rules of the output modules of the existing devices.

[0069] Optionally, the communication module further receives a rule update instruction, and the processor updates the output rule in the rule list in the memory in response to the rule update instruction.

[0070] Optionally, the memory is further used to store a policy for configuring the output rule, wherein the processor configures the output rule according to the policy.

[0071] Optionally, the communication module further receives a policy update instruction, and the processor updates the policy stored in the memory in response to the policy update instruction.

[0072] Optionally, the communication module further receives device state change information, where the device state change information indicates a state change of the device in the system, and the processor adjusts a corresponding output rule in response to the device state change information.

[0073] Optionally, the device controller may also include: a positioning device for determining the position of the input module and / or the position of the output module and / or the position of the living body, and the processor configures the output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living body.

[0074] Optionally, the device controller may further include a positioning device. The positioning device senses a position change of the input module and / or a position change of the output module, and the processor adjusts the corresponding output rule in response to the position change of the input module and / or the position change of the output module; and / or the positioning device senses a position change of the living body, and the processor adjusts the corresponding output rule in response to the position change of the living body.

[0075] Optionally, the processor sets output rules applicable to at least one mode for the input module. The processor determines the input module currently used to receive input based on the current mode; and / or the processor determines the output module used to perform the corresponding output based on the output rules applicable to the current mode.

[0076] Optionally, the processor sets output rules applicable to at least one scenario for the input module. The processor determines the input module currently used to receive the input based on the current scenario; and / or the processor determines the output module used to execute the corresponding output based on the output rules applicable to the current scenario.

[0077] Optionally, in response to the input module receiving input from outside the system, the processor determines an output module for executing corresponding output based on an output rule determined for the input module; and the processor wakes up the output module to execute the corresponding output.

[0078] According to the eleventh aspect of the present disclosure, there is provided a device control apparatus, comprising: an information acquisition apparatus for acquiring device information of one or more devices added to the system, wherein at least one device has an input module and at least one device has an output module; and a rule configuration apparatus for configuring corresponding output rules for the input module, so as to determine an output module for executing corresponding output based on the output rules in response to input from the input module.

[0079] According to the twelfth aspect of the present disclosure, there is provided a device control system, comprising: one or more devices, at least one device having an input module, and at least one device having an output module; a device controller, configuring a corresponding output module for the input module, so that in response to an input from the input module, a corresponding output is executed through the output module.

[0080] Optionally, the device control system may further include: a configurator, configured to configure and / or adjust output rules for the input module, and send the configured and / or adjusted output rules to the device controller.

[0081] Optionally, the device controller is one of the one or more devices.

[0082] According to the thirteenth aspect of the present disclosure, a computing device is provided, comprising: a processor; and a memory on which executable codes are stored, and when the executable codes are executed by the processor, the processor executes the methods described in the first to seventh aspects above.

[0083] According to the fourteenth aspect of the present disclosure, a non-temporary machine-readable storage medium is provided, on which executable code is stored. When the executable code is executed by a processor of an electronic device, the processor executes the method described in the first to seventh aspects above.

[0084] In this way, multi-device linkage can be easily realized in smart scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0085] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components in the exemplary embodiments of the present disclosure.

[0086] Figure 1 An application scenario of a device control system according to the present disclosure is schematically illustrated.

[0087] Figure 2 The block diagram of the device management system according to the present disclosure is schematically shown.

[0088] Figure 3 The data flow between devices in the device management system according to the present disclosure is schematically shown.

[0089] Figure 4 A schematic block diagram of the core part of a device manager according to the present disclosure is shown.

[0090] Figure 5 A schematic flow chart of a device management method according to the present disclosure is shown.

[0091] Figure 6 A schematic block diagram of a device management apparatus that can be used to implement the device management method according to the present disclosure is shown.

[0092] Figure 7 A schematic diagram of the structure of a computing device that can be used to implement the device management method according to the present disclosure is shown. DETAILED DESCRIPTION

[0093] The preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0094] Figure 1 A smart home application scenario of a device control system according to the present disclosure is schematically illustrated.

[0095] Visitor 1 outside (can be outside the door of the house or outside the door of the apartment building) presses the button 120 of the outdoor part 100 of the video doorbell system next to the outer door 10, and the indoor part 100' of the video doorbell system next to the inner door 10' will respond and play the doorbell sound on the speaker at the call device 150. By using the device control scheme according to the present disclosure, the doorbell sound originally played on the speaker at the call device 150 of the indoor part 100' can be transferred to, for example, the speaker 20. In other words, when visitor 1 outside presses the button 120, the speaker 20 indoors sounds the doorbell sound.

[0096] The outdoor part 100 of the video doorbell system may include a camera 110, a button 120, and a communication device 130. The communication device 130 may include a microphone for receiving sound and a speaker for outputting sound to the outside.

[0097] Under normal circumstances, for example, after an indoor person operates, the visitor image captured by the camera 110 can be displayed on the display screen 140 of the indoor part 100' of the video doorbell system, and a conversation can be made between the conversation device 130 and the conversation device 150 of the indoor part 100' of the video doorbell system.

[0098] In addition, a television 30 may be installed indoors, for example, on the wall opposite the sofa in the living room, and may be used to output video images and sounds.

[0099] A smart speaker 20 may also be placed on the living room table 2. The smart speaker 20 has a speaker that can play audio sounds. In addition, the smart speaker 20 may also have a microphone to receive the voice of the indoor user in order to achieve voice control, human-computer dialogue or dialogue with others.

[0100] According to the device control scheme disclosed in the present invention, the sound from the call device 130 can be transmitted to the smart speaker 20 for playback, and the video image from the camera 110 can be transmitted to the TV 30 for playback. In this way, the indoor user (not shown) does not need to get up and go to the door to operate the indoor part 100' of the video doorbell system, but can conveniently see the video image of the outdoor visitor 1 on the sofa facing the TV 30 and clearly hear the voice of the outdoor visitor 1 from the smart speaker 20. In addition, the indoor user can also communicate with the outdoor visitor 1 through the smart speaker 20.

[0101] In addition, various sensors 40 may be provided indoors, such as temperature and humidity sensors, optical sensors for sensing the opening / closing of doors, etc. The sensors 40 sense the environment accordingly and obtain corresponding sensing results, such as temperature and humidity, or instructions and signals triggered when sensing the opening / closing of doors, etc.

[0102] Likewise, the data from the sensor 40 may be presented (output) in text / digital form on the television 30 , or output in voice form on the speaker 20 .

[0103] Alternatively, the instructions, signals, etc. triggered by the sensor 40 can be sent to the device it controls, such as a light, to control the operation of the device, such as turning the light on or off.

[0104] The device control system may include a device controller, which may also be one of the devices with input and output functions in the system. Figure 1 In the embodiment, the speaker 20 can be used as a device controller to automatically configure the data flow between devices.

[0105] In addition, the user's electronic device 50, such as a mobile phone, pad, computer, etc., can also be used as an external configurator (i.e., a configurator outside the device controller as a default configurator) to configure, adjust / modify the data flow between the devices in the system. For example, configuration software or configuration APP can be installed on the electronic device 50 or the cloud server to perform corresponding configuration operations.

[0106] Reference below Figure 2 An equipment control system according to the present disclosure is described.

[0107] For example, devices connected to the same local area network or Internet of Things can be considered as a system. When a new device is connected to the local area network or Internet of Things, the device can be registered.

[0108] like Figure 2 As shown, one or more devices 220 may be included in the system.

[0109] At least one device 220 has an input module, and at least one device 220 has an output module.

[0110] The input module here refers to an input module that obtains input from outside the system. For example, the input module can be an input module that obtains input by sensing physical quantities in the environment.

[0111] For example, the camera senses the light in the environment to obtain static image or dynamic video input; the microphone senses the sound wave vibration in the environment to obtain audio input; the sensor senses the light, motion, temperature, and humidity in the environment to obtain corresponding physical values, or trigger corresponding instructions or signals; the button senses the external force and triggers corresponding instructions or signals.

[0112] These input modules may belong to different devices 220 in the system, but can be regarded as inputs to the entire system, introducing external inputs such as data, information, and instructions into the entire system.

[0113] The output module here refers to an output module that outputs to the outside of the system. For example, the output module can be an output module that outputs in a way that can be physically perceived by humans based on corresponding data, information, instructions, etc.

[0114] For example, a display screen can output static images or dynamic videos in an optical manner; a speaker can output sound in the form of sound waves; and a lamp can emit light.

[0115] Here, the input received / obtained from outside the system may be an input with a corresponding output. For example, the input received / obtained from outside the system by the input module may be output in some form through the output module, or may trigger the output of the output module. For example, audio or video input may be output in audio or video form, and the command input of a button such as a doorbell may be output in audio or video form.

[0116] In the system, there may be multiple devices 220 with input modules having the same or similar input functions. For example, there may be multiple devices 220 with microphones and multiple devices 220 with cameras.

[0117] Likewise, there may be multiple devices 220 in the system that have output modules with the same or similar output functions. For example, there may be multiple devices 220 that have speakers, and multiple devices 220 that have display screens.

[0118] In the device control scheme of the present invention, these input modules and output modules can all serve as input / output modules shared by the entire system, and the response mode from input to output can be uniformly coordinated according to the device control scheme of the present invention.

[0119] Here, the input module and the output module of each device 220 can be abstracted as an endpoint 240 .

[0120] Thus, it can be considered that the entire system includes a number of endpoints 240, which respectively have various input or output functions, namely, input endpoints and output endpoints. In the present disclosure, it can be considered that "input endpoint" and "input module" have the same meaning, and "output endpoint" and "output module" have the same meaning.

[0121] The "endpoint" or "module" here can be an independent component or module on the device 220, or multiple components or modules on the device 220 can cooperate with corresponding software to jointly realize the corresponding input or output function. In some cases, the corresponding input or output capabilities or functions of the device 220 can be abstracted as corresponding input endpoints (modules) or output endpoints (modules).

[0122] By scheduling these endpoints 240, input and output can be controlled at the level of the entire system.

[0123] The device controller 210, which may also be referred to as a "control center", controls the data flow between the input endpoints and the output endpoints.

[0124] For an input module, a corresponding output module is configured so that in response to an input from the input module, a corresponding output is performed by the output module.

[0125] It should be understood that the device 220 may also have a communication module (not shown) to communicate with other devices 220 and the device controller 212 to receive instructions or data, send data, etc. Data, information, and instructions input from the input endpoint 240 on the device 220 may also be sent out through the communication module, and received by the communication module of another device 220 and output through its output endpoint 240.

[0126] The device controller 210, which can also be called a "control center", controls each device in the system, thereby eliminating barriers between devices 220, configuring data flows across devices within the entire system, and enabling data, information, and instructions input by an input endpoint 2040 on one device 220 to be output from an output endpoint 240 on another device 220. Multiple devices 220 in the system cooperate with each other to implement input and output processing in various scenarios.

[0127] The device controller 210 configures the corresponding output module / output endpoint 240 for the input module / input endpoint 240 on each device 220. The configured output module / output endpoint 240 may belong to a different device 220 from the input module / input endpoint 240. Through the configuration of the device controller 210, in response to the input from the input module / input endpoint 240, the corresponding output is performed through the output module / output endpoint 240.

[0128] The device controller 210 may also be one of the one or more devices 220. In other words, the device controller 210 may also have an endpoint 240, which may be an input endpoint, an output endpoint, or both an input endpoint and an output endpoint. The endpoint 240 on the device controller 210 may also participate in the input and output function coordination between endpoints across devices in the entire system.

[0129] The device controller 210 may also have a memory 214 and a processor 212. The processor 212 may also serve as a default configurator.

[0130] Figure 4 2 shows a schematic block diagram of the core parts (ie, processor 212 and memory 214) of the device manager 210 according to the disclosure.

[0131] like Figure 4 As shown, in the device management solution of the present disclosure, the processor 212 on the device controller 210 is mainly used as a default configurator 430 to perform default configuration on the devices 240 in the system.

[0132] The device list 410 , the configurator list 420 , and the rule list 440 may all be on the memory 214 .

[0133] The device list 410 on the memory 214 stores device information of one or more devices 220 added to the system. The device information of the device 220 may include device identification information and information of each endpoint 240 possessed by the device, ie, input module information and / or output module information.

[0134] The information of the input module possessed by the device may include at least one of input type information, corresponding output type information, transmission protocol information, and the like.

[0135] The information of the output module of the device may include at least one of output type information, corresponding input type information, transmission protocol information, etc.

[0136] An endpoint can have properties such as:

[0137] IO type: output / input;

[0138] Data type: audio / video / data;

[0139] Protocol: RTP / UDP / DLNA / Miracast / A2DP;

[0140] IP address;

[0141] Wifi mac address;

[0142] Bluetooth MAC address.

[0143] The processor 212 configures corresponding output rules for the input module / input endpoint 240, and stores the output rules configured for the input module / input endpoint 240 in the rule list 440 on the memory 214, so as to determine the output module / output endpoint 240 for executing the corresponding output based on the output rules in response to the input from the input module / input endpoint 240.

[0144] The output rules may include information of one or more output modules that meet the output requirements corresponding to the input modules. The output requirements here may include the output form, output format, transmission protocol, etc. of the required output modules.

[0145] In the case where there are multiple output modules that meet the output requirements, the output rule may also include the priority order of the multiple output modules. In this way, in response to the input of the input module, the currently available output module may be selected based on the priority order.

[0146] In addition, one device 220 may include two or more input modules corresponding to different output types. For example, the outdoor part 100 of the video doorbell system may have a video input module, i.e., a camera 110, an audio input module, i.e., a call device 130, and a command input module, i.e., a button 120. Output rules may be configured for the two or more input modules respectively.

[0147] In addition, an input module may have two or more corresponding output types. For example, the temperature and humidity data sensed by the temperature and humidity sensor can be converted into voice and output in audio form, or converted into digital images and output in video form.

[0148] In this way, output rules can be configured for each corresponding output type of an input module, so that one or more output types can be used for output.

[0149] like Figure 2As shown, the system may also have one or more configurators 230. To distinguish from the default configurator 430 in the device controller 210, the configurator 230 may also be referred to as an "external configurator", that is, a configurator different from the default configurator 430 outside the device controller 210.

[0150] The configurator 230 may configure and / or adjust output rules for the input module / input endpoint 240 , and send the configured and / or adjusted output rules to the device controller 210 .

[0151] The configurator 230 may be, for example, a server (not shown), or may be a user's electronic device 50, such as a mobile phone, a pad, a computer, and the like.

[0152] The information of the authorized configurator 230 may be recorded in the configurator list 420 on the memory 214 of the device controller 210. The authorized configurator 230 is allowed to configure the data flow between the endpoints across the devices 220 in the system. In this way, the configurator 230 may configure the data flow between the endpoints and / or adjust the output rules recorded in the rule list 440. The configured and / or adjusted output rules may be further stored in the rule list 440.

[0153] like Figure 2 As shown, the device controller 210 may also include a communication module 216 that communicates with the device 220 so that the processor 212 can perform operations to configure corresponding output rules and enable data flow from the input module (of one device 220) to the output module (of another device 220) based on the configured output rules.

[0154] The device controller 210 can receive device information from the server or each device 220 in the system through the communication module 216, and store it in the device list 410 of the memory 214. The processor 210 (default configurator 430) can configure based on the input endpoint / output endpoint information of each device in the device list 410 to obtain output rules, which are stored in the rule list 440.

[0155] In addition, when a new device joins the system, the new device may broadcast its device information or send its device information to the server or device controller 210. Alternatively, the new device sends a request to join the system, and the server or device controller 210 identifies the device and obtains the device information of the new device through user settings or database query or pre-registration.

[0156] Likewise, the device information of the new device may also include the input module information and / or output module information thereof.

[0157] Through the communication module 216 , device information of the new device may be received from the server or the new device.

[0158] The processor 212 can configure the input module / input endpoint and / or output module / output endpoint of the new device according to the device information of the new device and the device information of the existing device 220 in the system. The corresponding output rules are configured for the input module / input endpoint of the new device, and the corresponding output module / output endpoint 240 (or list) is set. In addition, the output module of the new device can also be added to the output rules of the output module of the existing device, and the corresponding priority can be set when necessary.

[0159] In this way, the device controller 210 can realize automatic configuration of the device newly added to the system, so that its input module / input endpoint and output module / output endpoint can be integrated and participate in the input and output of the entire system.

[0160] After the output rules are configured, data transmission between the device 220 having the input module and the device 220 having the corresponding output module can be implemented through the device controller 210. For example, the input from the input module can be received through the communication module 216. The processor 212 determines the corresponding output module based on the output rules corresponding to the input module. A message is sent to the determined output module to perform the output corresponding to the input from the input module.

[0161] Alternatively, after configuring the output rule, a message may be sent to the device 220 to which the input module belongs to inform the output rule configured for its input module. In this way, the device 220 to which the input module belongs may record the output rule configured for it. In response to the input of its input module, the device 220 may determine the corresponding output module based on the output rule, and send a message to the device 220 to which the determined output module belongs to execute the output corresponding to the input from the input module.

[0162] In some embodiments, the device controller 210 may also receive a rule update instruction from a server or a configurator, for example, through the communication module 216. The processor 212 may update the output rule in the rule list on the memory in response to the rule update instruction.

[0163] The updating of the output rules may include, for example: adding an output rule; deleting an output rule; adjusting an output rule, etc.

[0164] In addition, in some embodiments, policies for configuring output rules may also be stored in the memory 214. Thus, for an input module, the processor 212 may configure the output rules according to the stored policies, so as to determine an output module for executing a corresponding output based on the output rules in response to an input from the input module.

[0165] The configuration strategy may include, for example, at least one of the following:

[0166] - Output module selection strategy, i.e., the strategy for selecting an output module when there are multiple output modules available to perform the same type of output;

[0167] - Output module priority determination strategy, that is, when there are multiple output modules that can be used to perform the same type of output, the strategy for determining the priority of each output module;

[0168] - Output module scheduling strategy when multiple input modules require the same type of output at the same time, such as scheduling the outputs corresponding to multiple input modules to one or more output modules respectively;

[0169] - a policy for configuring output rules with reference to the position of the input module and / or the position of the output module and / or the position of the user;

[0170] - adjusting a rescheduling strategy for output module selection in response to a position change of an input module and / or a position change of an output module and / or a position change of a living being;

[0171] -Strategy for handling situations where there is no matching output module.

[0172] The communication module 216 may also receive a policy update instruction. The policy update instruction may come from a server and / or a configurator. Alternatively, the policy update instruction may also come from an input unit of the device controller 210 itself.

[0173] The processor 212 may update the policy stored in the memory 214 in response to the policy update instruction.

[0174] In addition, in some embodiments, the managed devices may include devices already in the system, or devices requesting to join the system. The communication module may also receive device status change information, which indicates a status change of the device in the system.

[0175] The state change of the device in the system may include, for example, opening, closing, adding, deleting, replacing, etc. The device may, for example, send device state change information to the device controller 210 or the server when the state changes. Alternatively, the device may also periodically send a heartbeat signal to the device controller 210 or the server after joining the system and starting to work, so as to provide device state information. The device state change information is generated by the change of the device state information.

[0176] In this way, the online status information of the input modules and / or output modules of each device in the system can also be provided to the user's mobile phone or other configurator, for example. Here, it can be considered that the input modules and / or output modules that are turned on in the devices that have joined the system and are online are in the online state. Correspondingly, the input modules and / or output modules of the devices that are not online (turned off), the input modules and / or output modules that are turned off or disabled can be considered to be in the offline state.

[0177] The processor 212 may adjust corresponding output rules in response to the device state change information.

[0178] On the one hand, for the input module of the device whose state changes occur, the corresponding output rules can be adjusted.

[0179] For example, when a device is turned on or added to the system, its input devices can be assigned output modules.

[0180] For another example, when a device is deleted, the output rule set for the input module of the device in the rule list may be deleted.

[0181] For another example, when a device is turned off, the output rules set for the input module of the device in the rule list may be suspended.

[0182] For another example, when the first device is replaced by the second device, the output rules corresponding to the input module of the second device are set based on the output rules originally corresponding to the input module of the first device. For example, the output module originally corresponding to the input module of the first device can be used as the output module corresponding to the input module of the second device. Alternatively, the output module priority configuration originally corresponding to the input module of the first device can be used as the output module priority configuration corresponding to the input module of the second device.

[0183] On the other hand, for the output module of the device whose state changes, scheduling can be performed among the output modules in the system that have the same output function as the output module to adjust the corresponding output rules.

[0184] For example, when a device is turned on or newly added to the system, some output rules corresponding to output modules of other devices having the same output function as the output module may be dispatched to the output module of the device.

[0185] For another example, when a device is shut down or deleted, the output rule originally pointing to the output module of the device may be adjusted to point to the output module of another device having the same output function.

[0186] For another example, when the first device is replaced by the second device, the output rules pointing to the output module of the second device are set based on the output rules originally pointing to the output module of the first device. For example, the input module originally corresponding to the output module of the first device can be used as the input module corresponding to the output module of the second device. Alternatively, the input module priority configuration originally corresponding to the output module of the first device can be used as the input module priority configuration corresponding to the output module of the second device.

[0187] In addition, in some embodiments, the device controller 210 may further include a positioning device (not shown in the figure). The positioning device may be a positioning device based on various positioning principles, and is used to determine the position of the input module and / or the output module and / or the living being.

[0188] In this way, for the input module, the processor 212 can further configure corresponding output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living body.

[0189] In other words, the processor 212 may set different output rules for the input module (or the device to which it belongs) according to the different locations of the input module.

[0190] Alternatively, when configuring output rules for an input device, the processor 212 may also consider the location of the output module (or the device to which it belongs) to make selections or settings.

[0191] Alternatively, the processor 212 may also select an input module, for example, close to the living body, according to the position of the living body, or configure output rules for the input modules, thereby selecting an output module, for example, close to the living body.

[0192] Here, the living being can be a person, a pet, or a wild animal. A person can be a known user or an unknown stranger.

[0193] In addition, the positioning device can also sense the position change of the input module and / or the position change of the output module. In this way, the processor 212 can adjust the corresponding output rules in response to the position change of the input module and / or the position change of the output module.

[0194] On the other hand, the positioning device can also sense the position change of the living body. In this way, the processor 212 can adjust the corresponding output rules in response to the position change of the living body.

[0195] For example, initially, the life form is near the first input module. Accordingly, the first input module is used to receive the life form's input (eg, the sound emitted by the life form, or the image of the life form), and corresponding output is performed based on the output rule corresponding to the first input module.

[0196] Then, the life form moves from the vicinity of the first input module to the vicinity of the second input module. In response, the second input module can be turned on and the first input module can be turned off. Thus, the second input module can be used to receive the life form's input and perform corresponding output based on the output rule corresponding to the second input module.

[0197] Here, the first input module and the second input module may have the same input type. For example, the first input module and the second input module may include a microphone and / or a camera.

[0198] For another example, the life form is initially located near the first output module. Accordingly, the first output module is used to perform output corresponding to the input module.

[0199] Then, the living being moves from the vicinity of the first output module to the vicinity of the second output module. In response, the second output module can be turned on and the first output module can be turned off. Then, the output rule of the input module can be adjusted to use the second output module to perform the output corresponding to the input module.

[0200] Here, the first output module and the second output module may have the same output type. For example, the first output module and the second output module may include a speaker and / or a display.

[0201] Based on this, the present disclosure proposes an input system. The input system may include a plurality of devices each having an input module. In addition, the input system may also include a positioning device for determining the position of a living being.

[0202] Initially, in response to a living being being near a first input module, the first input module is used to receive an input of the living being, and a corresponding output is performed based on an output rule corresponding to the first input module.

[0203] Then, in response to the life form moving from the vicinity of the first input module to the vicinity of the second input module, the second input module is turned on, the first input module is turned off, the second input module is used to receive the input of the life form, and corresponding output is performed based on the output rule corresponding to the second input module.

[0204] Similarly, the present disclosure also proposes an output system. The output system may include a plurality of devices each having an output module. In addition, the input system may also include a positioning device for determining the position of a living being.

[0205] Initially, in response to a living being being near a first output module, the first output module is used to perform an output corresponding to an input module.

[0206] Then, in response to the life form moving from the vicinity of the first output module to the vicinity of the second output module, the second output module is turned on, the first output module is turned off, and the output rule of the input module is adjusted to use the second output module to execute the output corresponding to the input module.

[0207] The following returns to continue describing the device management / control solution according to the present disclosure.

[0208] In some embodiments, the processor 212 may set output rules respectively applicable to at least one mode for the input module, so as to determine an output module for executing corresponding output based on the output rules in response to input from the input module.

[0209] Here, the mode may include, for example, at least one of the following:

[0210] At least one mode set based on the life form type, such as human mode, pet mode, wild animal mode, etc.;

[0211] At least one mode set based on the user's age and / or role, such as child mode, student mode, youth mode, middle-aged mode, elderly mode, kid mode, parent mode, student mode, teacher mode, worker mode, inspector mode, etc.;

[0212] At least one mode set based on time and / or environmental parameters, such as morning mode, noon mode, afternoon mode, evening mode, weekday mode, weekend mode, sunny mode, rainy mode, high temperature mode, low temperature mode, dry mode, wet mode, comfortable mode, etc.

[0213] The processor may identify the current mode based on user input and / or life form recognition and / or environment recognition.

[0214] In this way, the processor 212 can determine the input module currently used to receive input based on the current mode, or determine the output rules applicable (corresponding) to the current mode based on the current mode, and determine the input module currently used to receive input based on the output rules applicable to the current mode.

[0215] In addition, in some embodiments, the processor 212 may further set output rules applicable to at least one scenario for the input module, so as to determine an output module for executing the corresponding output based on the output rules in response to the input from the input module.

[0216] Here, the scenes may include, for example: going out to work scene, going home from work scene, leisure scene at home, working scene at home, doing housework scene at home, courier delivering goods to door scene, security alert scene, factory work scene, factory getting off work scene, office building personnel monitoring scene, telephone scene, voice call scene, video call scene, meeting scene, etc.

[0217] The current scene may be identified based on at least one of time, environmental parameters, the number of life forms, life form identity information, life form location, and life form movement trajectory.

[0218] In addition to manually setting scenarios and their corresponding output rules, new scenarios can also be identified by analyzing user behavior history.

[0219] For example, based on the user's historical behavior towards input modules and / or output modules, such as under what circumstances which input module or modules were enabled and / or disabled, combined with at least one of the time, environmental parameters, number of life forms, identity information of life forms, location of life forms, movement trajectory of life forms, etc. corresponding to the historical behavior, new scenarios can be identified and output rules applicable to new scenarios can be set.

[0220] For another example, a machine learning model (which may be referred to as a "rule setting model") may be used to discover new scenarios and set corresponding output rules. The rule setting model may be any machine learning model.

[0221] For example, the rule setting model can be trained based on the user's historical behavior on the input module and / or output module, combined with at least one of the time, environmental parameters, number of life forms, life form identity information, life form location, and life form movement trajectory corresponding to the historical behavior.

[0222] The rule setting model is used to identify the current scene based on at least one of the current time, environmental parameters, number of life forms, life form identity information, life form location, and life form movement trajectory. Thus, the output rules applicable to the current scene can be set accordingly.

[0223] In this way, on the one hand, the processor 212 can determine the input module currently used to receive input based on the current scenario.

[0224] On the other hand, the processor 212 may also determine an output module for executing corresponding output based on an output rule applicable to the current scenario.

[0225] In addition, in some embodiments, the processor 212 may also determine an output module for executing a corresponding output based on an output rule determined for the input module in response to the input module receiving an input from outside the system.

[0226] Then, the processor 212 can wake up the output module to perform the corresponding output. Thus, dynamic awakening of the input module and / or the output module is achieved, and it is not necessary to keep all the output modules online and available all the time.

[0227] Reference below Figure 3 The data flow between devices in the device control system according to the present disclosure is described.

[0228] Figure 3 by Figure 1 The scenario shown is taken as an example to show the data flow between the devices according to the set output rules. It should be understood that the arrows here indicate the starting point and end point of the data flow. However, in fact, the data can be sent directly from the starting device to the end device, or from the starting device to the end device through the device controller or router or other transfer device.

[0229] like Figure 3 As shown, the audio and video data collected by the audio / video collection input module of the video doorbell 310 can be sent to the sound box 320 (audio data) and the TV 330 (audio / video data) respectively.

[0230] The indoor part of the video doorbell 310 ( Figure 3 However, preferably, the audio and video from the video doorbell 310 are output by the speaker 320 and the television 330.

[0231] Except for the indoor part of the video doorbell 310, only the TV 330 has a video output function for video data. Therefore, the output module corresponding to the video data can be selected as the video output module of the TV. The video data from the video doorbell 310 can be sent to the TV 330 for video output.

[0232] For audio data, both the speaker 320 and the television 330 have an audio output function. It can be set that the priority of the speaker 320 is higher than the priority of the television 330. In this way, when both the speaker 320 and the television 330 are turned on / available, the audio data from the video doorbell 310 is sent to the speaker 320 for output first.

[0233] In addition, the temperature / humidity data sensed by the sensing input module of the temperature and humidity sensor 340 can be converted into voice data and sent to the speaker 320 for audio output, or sent to the television 330 for digital image display output. In this way, even if the temperature and humidity sensor 340 itself has a display screen, the user can easily obtain the temperature and humidity data sensed by the temperature and humidity sensor 340 through the speaker 320 or the television 330, without having to go to the temperature and humidity sensor 340 to check.

[0234] For example, when the speaker 320 is a smart speaker, the user can send a query request to the speaker 320, "What is the current indoor temperature?" The speaker 320 determines that the user's intention is to query the current indoor temperature through voice recognition and natural language understanding. And the speaker 320 knows that there is a temperature and humidity sensor 340 in the room. So the speaker 320 can send a data request to the temperature and humidity sensor 340 to request to obtain temperature data. The temperature and humidity sensor 340 can send the temperature data to the speaker 320 or the TV 330 according to the pre-set output rules or the current voice command, so as to output the temperature data to the user in the form of audio or digital images.

[0235] In addition, when the data format of the data generated by the device where the input module is located is different from the data format of the data that can be processed by the corresponding output module, data format conversion can also be performed on the device where the input module is located, or the device where the output module is located, or the device controller, or the server, or other digital processing device, so as to provide the corresponding output module with data in a data format that it can process.

[0236] Reference below Figure 5 and Figure 6 The device management method and device management apparatus according to the present disclosure are further described.

[0237] Figure 5 A schematic flow chart of a device management method according to the present disclosure is shown.

[0238] Figure 6 A schematic block diagram of a device management apparatus that can be used to implement the device management method according to the present disclosure is shown.

[0239] like Figure 5 As shown, in step S510, for example, the device information of one or more devices 220 in the system can be obtained through the information acquisition device 610. Among them, at least one device 220 has an input module for receiving input from outside the system, and at least one device 220 has an output module for outputting to the outside of the system.

[0240] In step S520, for example, the rule configuration device 620 may configure corresponding output rules for the input module, so as to determine an output module for executing corresponding output based on the output rules in response to input from the input module.

[0241] Based on the output rule, the output modules assigned to the input modules may include output modules of devices different from the device to which the input modules belong. In other words, the input modules and the output modules assigned to them may belong to different devices.

[0242] Each input module may have its corresponding output type, and each output module may output content of a predetermined output type.

[0243] The control device can configure an output module that matches the corresponding output type for each input module.

[0244] For example, for an input module whose corresponding output type is audio, you can configure the audio output module on a certain device in the system.

[0245] Devices with an output module whose output type is audio may include: speakers, televisions, video doorbell systems, etc.

[0246] Alternatively, for an input module whose corresponding output type is video, a video output module on a device in the system may be configured.

[0247] Devices with an output module whose output type is video may include: televisions, pads, video doorbell systems, etc.

[0248] Furthermore, the input module may be, for example, a key, and the corresponding output type may be audio.

[0249] Alternatively, the input module may be a sensor, and its corresponding output type may be audio or video, so as to output the data sensed by the sensor in the form of audio or video;

[0250] Alternatively, the input module may be a microphone, and its corresponding output type may be audio;

[0251] Alternatively, the input module may be a camera, and its corresponding output type may be a video;

[0252] Alternatively, the input module may be a text input module, and its corresponding output type may be audio or video.

[0253] For the text input module, a video output module may be configured to present the input text in a visual form, or an audio output module may be configured to output the speech obtained based on the text conversion in an audio form.

[0254] As mentioned above, it is also possible to maintain lists of devices, lists of rules, lists of configurators, etc.

[0255] The device list stores the information of each device. The rule list stores the output rules configured for the input module. The configurator list stores the information of the configurator authorized to configure the rules.

[0256] The device information stored in the device list includes at least one of the following:

[0257] Device identification information;

[0258] Information about the input modules of the device, including input type information and / or corresponding output type information and / or transmission protocol information; and

[0259] The information of the output module of the device includes output type information and / or corresponding input type information and / or transmission protocol information.

[0260] The output rule may include information of one or more output modules that meet the output requirements corresponding to the input modules.

[0261] In the case where there are multiple output modules that meet the output requirements, the output rule may also include a priority order of the multiple output modules. In this way, in response to the input of the input module, a currently available output module is selected based on the priority order.

[0262] When configuring corresponding output rules for an input module, one or more output modules that meet the output requirements corresponding to the input module may be determined based on information of the input module and information of output modules of each device in the system.

[0263] Then, an output module for performing the corresponding output may be selected from one or more output modules, or a priority order of the plurality of output modules may be determined.

[0264] When a new device is added to the system, the device information of the new device can be received. Similarly, in addition to the device identification information, the device information can also include the input module information and / or output module information it has.

[0265] Therefore, output rules can be configured for the input module of the new device according to the device information of the new device and the device information of the existing devices in the system.

[0266] For example, if a user newly adds a microphone to the system, the audio input module of the microphone can be assigned to the audio output module of the speaker so that the sound collected by the microphone can be output through the speaker. In this way, the user can sing into the microphone and the user's singing voice can be played in the speaker.

[0267] In addition, you can add the output module of a new device to the output rules of the output module of an existing device.

[0268] For example, if a user has newly added a pad to the system, the user can add its video output module (display screen) to the rule list of the input module that needs to be configured with the corresponding video output. For example, the newly added pad can be added to the output rules configured for the input module of the video doorbell. If there are other video output modules, the priorities of these video output modules can be set separately.

[0269] In addition, as described above, after or in addition to the default configuration of the device controller, the corresponding output rules can be configured for the input module through an external configurator 230 other than the device controller 210, such as a mobile phone or a server. In this way, the device controller 210 can receive and record the output rules configured and / or adjusted by the configurator for the input module.

[0270] A device may include two or more input modules corresponding to different output types, and output rules may be configured for the two or more input modules respectively.

[0271] An input module may have two or more corresponding output types, and output rules may be configured for each corresponding output type of an input module.

[0272] After the output rules are configured, they can be centrally controlled by a device controller (control center) or in a distributed manner.

[0273] For example, the control center can receive input from an input module, determine the corresponding output module based on the output rule, and send a message to the output module to execute the output corresponding to the input. In this way, the data input by the input module is transmitted to the corresponding output module through the control and transfer of the control center.

[0274] Alternatively, a message may be sent to the device to which the input module belongs to inform the output rule configured for the input module. The device to which the input module belongs may record the output rule. In this way, in response to the input of the input module, the device to which it belongs may send a message to the device to which the output module belongs determined based on the output rule so as to execute the corresponding output. In this case, the control center does not need to participate in the subsequent data transmission process.

[0275] Below, taking the use of a smart speaker as a device controller or control center as an example, an embodiment of the device control solution according to the present disclosure is described.

[0276] There is only one smart speaker in the initial network. The smart speaker can add other devices to the network through various protocols such as Bluetooth mesh, WiFi, or other device discovery protocols.

[0277] For example, let's add a video doorbell. After the video doorbell is connected to the network, the default configurator on the smart speaker uses the doorbell button data as a trigger. The trigger of this event is automatically bound to the ringtone of the smart speaker. When the visitor presses the doorbell, the smart speaker plays the ringtone.

[0278] Then, add a smart TV. The default configurator of the smart speaker will update this configuration. When the video doorbell is pressed, the smart speaker will ring, and the image collected by the video doorbell's camera will be transmitted to the smart TV for display.

[0279] In this way, the input and output capabilities of smart devices in the network are abstracted. For example, a speaker has audio output capabilities (speakers), audio input capabilities (microphones), and data input capabilities (data processing); a TV has video output capabilities (screen display) and audio output capabilities (speakers).

[0280] The various input / output capabilities of each smart device in the network no longer belong to itself alone, but to the entire network.

[0281] In a scenario, the input capability of device A and the output capability of device B can be used to complete data transmission in a scenario and implement user-perceived functions. For example, when the video doorbell at the door rings, the ringtone is transmitted from the doorbell to the speaker and played through the speaker, and the video is transmitted from the camera of the video doorbell to the TV for display.

[0282] The device capabilities can be negotiated between devices through a unified protocol. When a device joins the network, it can broadcast the input and output capabilities it supports to the network.

[0283] The speaker acts as the control center. When the device is added to the network, it calculates the possible transmission paths (audio, video). That is, the content input by the input module of each device can be transmitted to the output module of that device for output.

[0284] When the user's action triggers the start of data transmission, the speaker makes a decision on the transmission path, such as transmitting audio data from device A to device B.

[0285] In addition, it can also receive user-defined preferences through external configurators such as mobile phone apps. The speaker can combine the calculated path and the path of the preference settings to determine the final path, thereby performing input / output data transmission across devices.

[0286] In an embodiment according to the present disclosure, the input and output capabilities of a device are abstracted into modules / endpoints with corresponding functions, and the input / output capabilities of each device are assigned to the devices in the entire network.

[0287] Automated decision making is achieved through default configurations of device controllers, while external configurators such as apps on mobile phones can support user preferences.

[0288] In addition, the technical solution disclosed in the present invention realizes the decision of data transmission path through a unified application framework. After the device joins the network, the intelligent scene can be automatically realized.

[0289] Figure 7 A schematic diagram of the structure of a computing device that can be used to implement the above-mentioned device management method according to an embodiment of the present disclosure is shown.

[0290] See also Figure 7 , the computing device 700 includes a memory 710 and a processor 720 .

[0291] The processor 720 may be a multi-core processor or may include multiple processors. In some embodiments, the processor 720 may include a general-purpose main processor and one or more special coprocessors, such as a graphics processing unit (GPU), a digital signal processor (DSP), etc. In some embodiments, the processor 720 may be implemented using a customized circuit, such as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0292] The memory 710 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 720 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at run time. In addition, the memory 710 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 710 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0293] The memory 710 stores executable codes, and when the executable codes are processed by the processor 720 , the processor 720 can execute the device control method mentioned above.

[0294] The device control scheme according to the present disclosure has been described above in detail with reference to the accompanying drawings.

[0295] In addition, the method according to the present disclosure may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing the above steps defined in the above method of the present disclosure.

[0296] Alternatively, the present disclosure may also be implemented as a non-temporary machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), the processor executes the various steps of the above-mentioned method according to the present disclosure.

[0297] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or a combination of both.

[0298] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the system and method according to multiple embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0299] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A device control method, comprising: Acquire device information of multiple devices in the system, wherein at least one device has an input module for receiving input from outside the system, and at least two devices have output modules for outputting to outside the system; Maintain policies for configuring output rules; For the input module, a corresponding output rule is configured according to the strategy, so that in response to the input from the input module, an output module for performing corresponding output is determined from the output modules of the at least two devices based on the output rule; Receive input from the input module; Based on the output rule, determining a corresponding output module from the output modules of the at least two devices; and Sending a message to the determined output module to execute the output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

2. The method according to claim 1, further comprising: A message is sent to the device to which the input module belongs to inform the output rule configured for the input module, so that the device to which the input module belongs records the output rule, and in response to the input of the input module, a message is sent to the device to which the output module belongs determined based on the output rule to execute the corresponding output.

3. The method according to claim 1, further comprising: Store the information of each device in the device list; and / or Stores output rules configured for input modules in a rule list; and / or The configurator list stores information about configurators that are authorized to perform rule configuration.

4. The method according to claim 3, wherein: The device information stored in the device list includes at least one of the following: Device identification information; Information about the input modules of the device, including input type information and / or corresponding output type information and / or transmission protocol information; The information of the output module of the device includes output type information and / or corresponding input type information and / or transmission protocol information.

5. The method according to claim 1, wherein: The output modules assigned to the input modules based on the output rules include output modules possessed by a device different from the device to which the input modules belong.

6. The method according to claim 1, wherein: The output rule includes information of one or more output modules that meet the output requirements corresponding to the input module. In the case that there are multiple output modules that meet the output requirements, the output rule further includes a priority order of the multiple output modules, wherein in response to the input of the input module, a currently available output module is selected based on the priority order.

7. The method according to claim 6, wherein: The step of configuring corresponding output rules for the input module comprises: Based on the information of the input module and the information of the output modules of each device in the system, determining one or more output modules that meet the output requirements corresponding to the input module; and An output module for performing corresponding output is selected from the one or more output modules, or a priority order of the plurality of output modules is determined.

8. The method according to claim 6, wherein: The step of configuring corresponding output rules for the input module comprises: Receive and record output rules configured and / or adjusted by the configurator for the input module.

9. The method according to claim 1, wherein: Also includes: Receiving device information of a new device newly added to the system, the device information including input module information and / or output module information possessed by the new device; as well as According to the device information of the new device and the device information of the existing devices in the system, output rules are configured for the input module of the new device, and / or the output module of the new device is added to the output rules of the output modules of the existing devices.

10. The method according to claim 1, wherein: The strategy includes at least one of the following: Output module selection strategy; Output module priority determination strategy; Output module scheduling strategy when multiple input modules require the same type of output at the same time; A strategy for configuring output rules with reference to the position of the input module and / or the position of the output module and / or the position of the living being; a rescheduling strategy for adjusting output module selection in response to a position change of an input module and / or a position change of an output module and / or a position change of a living being; Strategy for handling when there is no matching output module.

11. A device management method, comprising: Acquire device information of multiple devices in the system and / or requesting to join the system, wherein at least one device has an input module for receiving input from outside the system, and at least two devices have output modules for outputting to outside the system; Maintain policies for configuring output rules; For the input module, a corresponding output rule is configured according to the strategy, so that in response to the input from the input module, an output module for performing corresponding output is determined from the output modules of the at least two devices based on the output rule; In response to the state change of the device in the system, adjust the corresponding output rules; Receive input from the input module; Based on the output rule, determining a corresponding output module from the output modules of the at least two devices; and Sending a message to the determined output module to execute the output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

12. The method according to claim 11, wherein: The step of adjusting the corresponding output rules in response to the state change of the device in the system comprises: Adjusting corresponding output rules for the input module of the device; and / or For the output module of the device, scheduling is performed among output modules in the system that have the same output function as the output module to adjust the corresponding output rules.

13. A device control method, comprising: Acquiring device information of a plurality of devices in the system, wherein at least one device has an input module for receiving input from outside the system, and at least two devices have output modules for outputting to outside the system; and Maintain policies for configuring output rules; For the input module, with reference to the position of the input module and / or the position of the output module and / or the position of the living body, a corresponding output rule is configured according to the strategy, so as to determine, in response to the input from the input module, an output module for performing the corresponding output from the output modules of the at least two devices based on the output rule; Receive input from the input module; Based on the output rule, determining a corresponding output module from the output modules of the at least two devices; and Sending a message to the determined output module to execute the output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

14. The method according to claim 13, further comprising: sensing a position change of an input module and / or a position change of an output module, and adjusting a corresponding output rule in response to the position change of the input module and / or the position change of the output module; and / or The position change of the living body is sensed, and the corresponding output rule is adjusted in response to the position change of the living body.

15. The method according to claim 14, wherein: The step of adjusting the corresponding output rules in response to the position change of the living body comprises: In response to the life form being in the vicinity of the first input module, using the first input module to receive an input from the life form, and performing a corresponding output based on an output rule corresponding to the first input module; and In response to the life form moving from the vicinity of the first input module to the vicinity of the second input module, the second input module is turned on, the first input module is turned off, the second input module is used to receive the input of the life form, and corresponding output is performed based on the output rule corresponding to the second input module.

16. The method according to claim 14, wherein: The step of adjusting the corresponding output rules in response to the position change of the living body comprises: In response to the living being being in the vicinity of the first output module, using the first output module to perform an output corresponding to the input module; and In response to the life form moving from the vicinity of the first output module to the vicinity of the second output module, the second output module is turned on, the first output module is turned off, and the output rule of the input module is adjusted to use the second output module to execute the output corresponding to the input module.

17. A device control method, comprising: Acquiring device information of a plurality of devices in the system, wherein at least two first devices have input modules for receiving input from outside the system, and at least two second devices have output modules for outputting to outside the system; and Maintain policies for configuring output rules; For the input module, output rules respectively applicable to at least one mode are configured according to the strategy, so that in response to the input from the input module, an output module for performing corresponding output is determined from the output modules of the at least two second devices based on the output rule, Furthermore, the method further comprises: Based on the current mode, determining an input module currently used for receiving input from the input modules of the at least two first devices, and receiving input from the determined input module; and / or Based on the output rule applicable to the current mode, determining an output module for executing the corresponding output from the output modules of the at least two second devices, and sending a message to the determined output module to execute the output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

18. A device control method, comprising: Acquiring device information of a plurality of devices in the system, wherein at least two first devices have input modules for receiving input from outside the system, and at least two second devices have output modules for outputting to outside the system; and Maintain policies for configuring output rules; For the input module, output rules respectively applicable to at least one scenario are configured according to the strategy, so that in response to the input from the input module, an output module for performing corresponding output is determined from the output modules of the at least two second devices based on the output rule, Furthermore, the method further comprises: Based on the current scenario, determining an input module currently used for receiving input from the input modules possessed by the at least two first devices, and receiving input from the determined input module; and / or Based on the output rule applicable to the current scenario, determine an output module for executing the corresponding output from the output modules of the at least two second devices, and send a message to the determined output module to execute the output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

19. The method according to claim 18, further comprising: Based on at least one of time, environmental parameters, number of life forms, identity information of life forms, position of life forms, and movement trajectory of life forms, the current scene is identified.

20. The method according to claim 19, wherein: The configuring output rules respectively applicable to at least one scenario according to the strategy includes: Based on the user's historical behavior on the input module and / or output module, combined with at least one of the time, environmental parameters, number of life forms, life form identity information, life form location, and life form movement trajectory corresponding to the historical behavior, new scenes are identified and output rules applicable to the new scenes are set.

21. The method of claim 19, further comprising: Based on the historical behavior of the user on the input module and / or the output module, combined with at least one of the time, environmental parameters, number of life forms, identity information of life forms, location of life forms, and movement trajectory of life forms corresponding to the historical behavior, a rule setting model is trained; The rule setting model is used to identify the current scene based on at least one of the current time, environmental parameters, the number of life forms, life form identity information, life form position, and life form movement trajectory, and to set output rules applicable to the current scene.

22. A device control method, comprising: Acquire device information of multiple devices in the system, wherein at least one device has an input module for receiving input from outside the system, and at least two devices have output modules for outputting to outside the system; Maintain policies for configuring output rules; For the input module, a corresponding output rule is configured according to the strategy, so that in response to the input from the input module, an output module for performing corresponding output is determined from the output modules of the at least two devices based on the output rule; In response to an input module receiving an input from outside the system, determining an output module for performing corresponding output from output modules possessed by the at least two devices based on an output rule determined for the input module; and waking up the output module to execute the corresponding output, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

23. An input system comprising: A plurality of devices each having an input module; as well as Positioning equipment, used to determine the location of living things; wherein, in response to the life form being in the vicinity of the first input module, receiving the input of the life form using the first input module, and selecting an output module from a plurality of output modules to perform a corresponding output based on an output rule corresponding to the first input module, wherein the output rule corresponding to the first input module is configured according to a maintained policy for configuring output rules; In response to the life form moving from the vicinity of the first input module to the vicinity of the second input module, the second input module is turned on, the first input module is turned off, the second input module is used to receive the input of the life form, and an output module is selected from a plurality of output modules based on an output rule corresponding to the second input module to perform a corresponding output, wherein the output rule corresponding to the second input module is configured according to a maintained policy for configuring the output rule, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

24. An output system comprising: A plurality of devices, each of which has an output module; as well as Positioning equipment, used to determine the location of living things; wherein, in response to the life form being in the vicinity of the first output module, using the first output module to perform an output corresponding to the input module; In response to a life form moving from the vicinity of a first output module to the vicinity of a second output module, the second output module is turned on, the first output module is turned off, and an output rule of the input module is adjusted to use the second output module to perform an output corresponding to the input module, wherein the output rule is configured according to a maintained policy for configuring the output rule, and is used to determine an output module for performing the corresponding output from the output modules of the plurality of devices, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

25. A device controller comprising: A memory storing device information of a plurality of devices added to the system in a device list on the memory, wherein at least one device has an input module and at least two devices have output modules; and a processor, configured to maintain a policy for configuring output rules, and for an input module, configure a corresponding output rule according to the policy, and store the output rule configured for the input module in a rule list on a memory, so as to determine an output module for executing a corresponding output from the output modules of the at least two devices based on the output rule in response to an input from the input module, receive an input from the input module, determine a corresponding output module from the output modules of the at least two devices based on the output rule, and send a message to the determined output module to execute an output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

26. The device controller of claim 25, further comprising: The communication module communicates with the one or more devices to enable the processor to execute the step of configuring the corresponding output rule and to implement data flow from the input module to the output module based on the output rule.

27. The device controller of claim 26, wherein: The communication module receives device information of a new device newly added to the system, wherein the device information includes input module information and / or output module information thereof; and The processor configures output rules for the input module of the new device according to the device information of the new device and the device information of the existing devices in the system, and / or adds the output module of the new device to the output rules of the output modules of the existing devices.

28. An equipment control device, comprising: An information acquisition device, used to acquire device information of a plurality of devices added to the system, wherein at least one device has an input module and at least two devices have output modules; means for maintaining a policy for configuring output rules; A rule configuration device, configured to configure a corresponding output rule for an input module according to the strategy, so as to determine an output module for performing a corresponding output from the output modules of the at least two devices based on the output rule in response to an input from the input module; means for receiving input from an input module; means for determining a corresponding output module from the output modules of the at least two devices based on the output rule; and means for sending a message to the determined output module to execute an output corresponding to the input, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

29. An equipment control system, comprising: A plurality of devices, at least one device having an input module and at least two devices having an output module; a configurator, configured to maintain a policy for configuring output rules, and configure and / or adjust the output rules for an input module according to the policy, so as to determine, in response to an input from the input module, an output module for performing corresponding output from the output modules of the at least two devices based on the output rules; The device controller, in response to the input module receiving the input, configures a corresponding output module for the input module according to the output rule so as to perform corresponding output through the output module, in, A device includes two or more input modules corresponding to different output types, and output rules are configured for the two or more input modules respectively; and / or One input module has two or more corresponding output types, and output rules are configured for each corresponding output type of the one input module.

30. A computing device comprising: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to perform the method according to any one of claims 1 to 22.

31. A non-transitory machine-readable storage medium having executable codes stored thereon, which, when executed by a processor of an electronic device, causes the processor to execute the method according to any one of claims 1 to 22.

Images