Control system, control method, and program recording medium

The control system, which uses local networks and internet relays, directly controls local devices and controls remote devices through a control server. This solves the awkwardness caused by time lag in device scene control and achieves fast and seamless scene control.

CN116508308BActive Publication Date: 2026-07-07PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
Filing Date
2021-11-04
Publication Date
2026-07-07

AI Technical Summary

Technical Problem

In existing technologies, there is a time lag between user input and device action in device-based scene control, which makes users feel awkward.

Method used

The control system is used in conjunction with a gateway. The control system is relayed through a local network and the Internet. The control device directly controls local devices and controls remote devices through a control server, reducing latency.

Benefits of technology

It enables rapid scene control, reduces the user's waiting time for device actions, and avoids any awkwardness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116508308B_ABST
    Figure CN116508308B_ABST
Patent Text Reader

Abstract

A control system (100) used with a gateway relaying a local network and the Internet includes a control device (20) that acquires an execution input for executing scenario control with at least one of a first device (40) connected to the local network and a second device (50) different from the first device (40) as a control target, and controls the first device (40) without going through the Internet based on the acquired execution input, and a control server (30) that acquires an execution input, and controls the second device (50) via the gateway and the Internet based on the acquired execution input.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to control systems, control methods, and program recording media. Background Technology

[0002] In recent years, operating systems capable of scene control of at least a portion of equipment within a facility using operating terminals such as portable terminals have been disclosed (Patent Document 1).

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-195132 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] However, for devices that require real-time operation in conjunction with instruction inputs, such as lighting fixtures, if there is a time lag between the user inputting the execution instruction for scene control and the device class performing the action, the user may experience a sense of unease.

[0008] Therefore, this disclosure provides a control system, control method, and program that can quickly control at least a portion of a device class without causing the user any discomfort.

[0009] Methods used to solve problems

[0010] The control system of one technical solution disclosed herein is a control system used together with a gateway that relays a local network and the Internet, comprising: a control device that acquires execution input for performing scenario control with at least one of a first device connected to the local network and a second device different from the first device as the control object, and controls the first device without via the Internet based on the acquired execution input; and a control server that acquires the execution input and controls the second device via the gateway and the Internet based on the acquired execution input.

[0011] A control method for a technical solution disclosed herein includes: a first control step of obtaining execution input for performing scenario control on at least one of a first device connected to a local network and a second device different from the first device, and controlling the first device without via the Internet based on the obtained execution input; and a second control step of obtaining the execution input and controlling the second device via a gateway relaying the local network and the Internet based on the obtained execution input.

[0012] A program recording medium relating to one of the technical solutions of this disclosure is a program recording medium containing a program for causing a computer to execute the above-described control method.

[0013] Invention Effects

[0014] The control system, control method, and program recording medium of the present disclosure enable rapid scene control of at least a portion of a device class without causing discomfort to the user. Attached Figure Description

[0015] Figure 1 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation 1.

[0016] Figure 2 This is a sequence diagram showing the operation of the control system of Implementation 1 as a first example.

[0017] Figure 3 This is a sequence diagram showing the operation of the control system of Implementation 1 as a second example.

[0018] Figure 4 This is a sequence diagram showing the operation of the control system of Implementation 1 as a third example.

[0019] Figure 5 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation Method 2.

[0020] Figure 6 This is a sequence diagram showing the operation of the control system of embodiment 2 as a first example.

[0021] Figure 7 This is a sequence diagram showing the operation of the control system of embodiment 2 as a second example.

[0022] Figure 8 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation Method 3.

[0023] Figure 9 This is a sequence diagram showing the operation of the control system of embodiment 3 as the first example.

[0024] Figure 10 This is a sequence diagram showing the operation of the control system of embodiment 3 as a second example. Detailed Implementation

[0025] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Furthermore, the embodiments described below are inclusive or specific examples. The numerical values, shapes, materials, constituent elements, arrangement and connection methods of constituent elements, steps, and order of steps shown in the following embodiments are examples and are not intended to limit the invention. In addition, any constituent elements in the following embodiments that are not described in the independent claims will be described as arbitrary constituent elements.

[0026] Furthermore, the figures are schematic diagrams and not necessarily rigorous representations. Additionally, in the figures, substantially identical structures are assigned the same labels, and repetitive explanations are sometimes omitted or simplified.

[0027] (Implementation Method 1)

[0028] [structure]

[0029] First, the structure of the control system for Implementation Method 1 will be explained. Figure 1 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation 1.

[0030] The control system 100 of Embodiment 1 is a system capable of rapidly controlling the first device 40 and the second device 50 installed in the building 80 based on the execution input of the scene control by the user, without causing the user any discomfort. "Without causing the user any discomfort" means that the user should not perceive a time lag (i.e., a slow start to the action) from the input of the scene control execution instruction to the start of the device action. In other words, the control system 100 is a system that performs scene control on at least a portion of multiple device classes according to the real-time requirements for the device actions. The building 80 is, for example, a residential unit or detached house, but may also be a facility other than a residential building, such as an office.

[0031] Scene control refers to controlling at least a portion of multiple devices to represent scenes from a user's daily life. Scenes include everyday life scenarios such as waking up, going to bed, returning home, and going out, as well as work scenarios such as meetings, working at a desk, resting, and taking a nap—various scenes from a user's life.

[0032] Users can operate an operating terminal 10, such as a remote control mounted on a wall within the building 80, or an operating terminal 60 held by the user, to perform scene control, with at least one of the first device 40 and the second device 50 as the controlled object. The first device 40 and the second device 50 may each include more than one device. The first device 40 is a device required to have a short time delay from receiving an action instruction from the user to starting the action (in other words, real-time performance). For example, the first device 40 is a lighting device or an electric curtain. The second device 50 is a different device from the first device, and is an appliance that, even with a time delay from receiving an action instruction from the user to starting the action, the user is unlikely to feel any discomfort (in other words, real-time performance is not required). For example, the second device is an air conditioner, a floor heating system, an electronic lock, an electric door opener, a television, an aromatherapy diffuser, or an audio system. Users can establish associations with multiple scenes, such as an outing scene and a homecoming scene, to set the operating states of the first device 40 and the second device 50. Specifically, the operating states include power-on state, power-off state, and setting state (for example, brightness if the first device 40 is a lighting device, and temperature setting if the second device 50 is an air conditioning device).

[0033] like Figure 1 As shown, the control system 100 includes, for example, an operation terminal 10, a control device 20, a control server 30, a first device 40, a second device 50, and an operation terminal 60. The first device 40 and the second device 50 have been described above, so the description will be simplified.

[0034] [Operating Terminal 10]

[0035] The operation terminal 10 is a terminal device that accepts user input and outputs it to the control device 20. More specifically, the operation terminal 10 is a terminal device operated by the user to perform execution input for executing scene control and to input setting information for setting scene control. The operation terminal 10 may be, for example, a remote control or control panel installed on a wall or other surface within the building 80. The operation terminal 10 may also be installed in various rooms within the building 80.

[0036] The operating terminal 10 includes, for example, a communication unit 11, a control unit 12, an input receiving unit 13, and a storage unit 16.

[0037] The communication unit 11 is a communication module (communication circuit) for the operation terminal 10 to communicate with the control device 20, the first device 40, and the operation terminal 60 via a local communication network. The communication unit 11 can be, for example, a wireless communication circuit for wireless communication, but it can also be a wired communication circuit for wired communication. The communication standard used by the communication unit 11 is not particularly limited. Furthermore, in Figure 1The operation terminal 60 is described separately from the operation terminal 10, but if the operation terminal 60 is located inside the building 80, the operation terminal 60 can also be used as the operation terminal 10.

[0038] The control unit 12 performs information processing to control the operation of the operating terminal 10. The control unit 12 is implemented, for example, by a microcomputer, but may also be implemented by a processor or a dedicated circuit.

[0039] The input receiving unit 13 accepts manual input or voice input from the user. The input receiving unit 13 includes, for example, a display unit 14 and a microphone 15. The display unit 14 is a display device that has image display function and the function of accepting manual input from the user. The display unit 14 is implemented using a touch panel, a liquid crystal panel, or an organic EL (Electro Luminescence) panel, etc. The touch panel is, for example, a capacitive touch panel, but it can also be a resistive film touch panel.

[0040] Alternatively, the input receiving unit 13 may also include a speaker (not shown). The speaker may output sound (machine voice) as a response to speech acquired by the microphone 15. Thus, the user can input execution instructions for scene control in a conversational manner.

[0041] The storage unit 16 is a storage device for control programs and the like executed by the storage control unit 12. The storage unit 16 is implemented, for example, by a semiconductor memory.

[0042] [Control device 20]

[0043] The control device 20 is a device that obtains execution input from the operating terminal 10 for performing scene control, and controls the first device 40 based on the obtained execution input without using the Internet. The control device 20 is installed in the building 80, for example, along with the first device 40 and the second device 50 connected to a local network. Furthermore, the control device 20 manages the operating state of the first device 40 and is communicatively connected to the control server 30. In Embodiment 1, the control device 20 is, for example, a gateway device.

[0044] like Figure 1 As shown, the control device 20 includes, for example, a first communication unit 21, a second communication unit 22, a control unit 23, and a storage unit 24.

[0045] The first communication unit 21 is a communication module (communication circuit) for the control device 20 to communicate with the operation terminal 10 and the first device 40 via a local communication network. The first communication unit 21 may be a wireless communication circuit for example, but it may also be a wired communication circuit for wired communication. The communication standard used by the first communication unit 21 is not particularly limited.

[0046] The second communication unit 22 is a communication module (communication circuit) for the control device 20 to communicate with the control server 30, the second device 50, and the operation terminal 60 via the wide area communication network 70. Communication performed by the second communication unit 22 can be wired, but wireless communication is also possible. There are no particular limitations on the communication standards used in the communication.

[0047] The control unit 23 performs information processing related to the control of the first device 40. For example, if the control unit 23 receives execution input for performing scene control, it reads first control information from the storage unit 24 and controls the first device 40 based on the first control information. More specifically, the control unit 23 outputs control signals to the first device 40 via the first communication unit 21. The control unit 23 may be implemented by a microcomputer, for example, but may also be implemented by a processor or dedicated circuitry.

[0048] The storage unit 24 is a storage device for the control program and other data executed by the storage control unit 23. Furthermore, the storage unit 24 stores first control information related to the operation of the first device in scene control. The storage unit 24 is implemented, for example, by a semiconductor memory.

[0049] [Control Server 30]

[0050] The control server 30 is a computer located outside building 80. The control server 30 is a cloud server that receives execution input from the operating terminal 10 for performing scene control, and controls the second device 50 via a gateway and the Internet based on the received execution input. The gateway relays the local network and the Internet connecting the first device 40 and the second device 50.

[0051] like Figure 1 As shown, the control server 30 includes, for example, a communication unit 31, an information processing unit 32, and a storage unit 33.

[0052] The communication unit 31 is a communication module (communication circuit) used to enable the control server 30 to communicate with the control device 20, the second device 50, and the operation terminal 60 via the wide area communication network 70. Communication performed by the communication unit 31 can be wired, but wireless communication is also possible. There are no particular limitations on the communication standards used in the communication.

[0053] The information processing unit 32 performs information processing related to the control of the second device 50. The information processing unit 32 may be implemented by a microcomputer, but it can also be implemented by a processor. The information processing unit 32 has an acquisition unit 34 and an execution unit 35. Details regarding the functions of the acquisition unit 34 and the execution unit 35 will be described later.

[0054] The storage unit 33 is a storage device that stores control information such as the first control information and the second control information in scene control, as well as control programs executed by the information processing unit 32. The storage unit 33 is implemented, for example, by an HDD (Hard Disc Drive).

[0055] [Operating Terminal 60]

[0056] The operating terminal 60 is a portable information terminal operated by the user for performing execution inputs for scene control and for setting setting information for scene control, such as a smartphone or tablet computer.

[0057] The operating terminal 60 includes, for example, a communication unit 61, a control unit 62, an input receiving unit 63, and a storage unit 66. The input receiving unit 63 accepts manual input or voice input from the user. The input receiving unit 63 includes, for example, a display unit 64 and a microphone 65.

[0058] The structure of the operation terminal 60 is the same as that of the operation terminal 10, so the description here is omitted.

[0059] [Equipment 1, 40]

[0060] The first device 40 is, for example, a device requiring real-time operation, controlled by control signals sent from the first communication unit 21 of the control device 20. The first device 40 is connected to a local network. The first device 40 is, for example, a lighting device installed in a building 80, but not limited to inside the building 80; it can also illuminate the exterior of the building 80. Lighting devices include, for example, ceiling lights, downlights, chandeliers, spotlights, or wall lights. Figure 1 As shown, the first device 40 and the second device 50 can also be installed in a building 80.

[0061] [Second Equipment 50]

[0062] The second device 50 is different from the first device 40 and is controlled by control signals sent from the communication unit 31 of the control server 30. The second device 50 is connected to the local network. The second device 50 may be, for example, an air conditioning unit, a floor heating unit, an electronic lock, an electric switch, a television set, an aromatherapy diffuser, or an audio system.

[0063] Air conditioning equipment refers to household air conditioning equipment that uses a heat exchanger (not shown) and other components to regulate the temperature of the air generated. In other words, air conditioning equipment has temperature regulation functions (e.g., air supply and cooling / heating functions). Air conditioning equipment is not limited to household use; it can also be used in industrial settings.

[0064] An electric shutter is installed on the outside (or inside) of a window in building 80 to adjust the amount of outside light entering the building 80. The electric shutter may be, for example, an electric blackout curtain, which has a structure that physically opens and closes a light-blocking device. The electric shutter may also have a structure that incorporates a liquid crystal panel or similar material, where the light transmittance changes physically.

[0065] Electronic locks are security devices that control the locking and unlocking of doors (or windows, etc.) on a building. Electronic locks may include, for example, RFID readers that retrieve key information from cards or keys. Additionally, electronic locks may also include biometric sensors that retrieve biometric information such as fingerprints as key information.

[0066] [action]

[0067] Next, the operation of the control system 100 will be explained.

[0068] [Example 1: Setting and registering control information related to scene control]

[0069] First, an example of the operation of the control system 100 when setting and registering control information related to scene control will be explained. Figure 2 This is a sequence diagram showing the operation of the control system 100 according to Embodiment 1, representing the first example.

[0070] Users can use their smartphones or other operating terminals 60 to set control information related to scene control.

[0071] First, if the input receiving unit 63 of the operation terminal 60 receives an input of a setting instruction related to scene control (step S001), the control unit 62 determines whether the control information in the input of the setting instruction contains first control information related to the control of the first device 40 (step S002).

[0072] When the control unit 62 of the operation terminal 60 determines that the scene control control information that received the setting instruction input in step S001 contains the first control information related to the control of the first device 40 ("Yes" in step S002), it outputs the first control information to the control device 20 via the communication unit 61 (step S003) and outputs the control information to the control server 30 (step S004).

[0073] The control device 20 obtains the first control information (not shown) output from the operation terminal 60 in step S003 via the second communication unit 22, and saves the obtained first control information to the storage unit 24 (step S005). Furthermore, the control server 30 obtains the control information (not shown) output from the operation terminal 60 in step S004, and saves the obtained control information to the storage unit 66 (step S006).

[0074] On the other hand, if in step S002, the control unit 62 of the operation terminal 60 determines that the control information for scene control, which received the setting instruction in step S001, does not contain the first control information (No), then the control unit 62 outputs the control information to the control server 30 via the communication unit 61 (step S007). The control server 30 obtains the control information (not shown) output from the operation terminal 60 in step S007 and saves the obtained control information to the storage unit 66 (step S008).

[0075] As described above, the control system 100 stores first control information related to the control of the first device 40 in the storage unit 24 of the control device 20, and stores second control information (i.e., control information) related to the control of the second device in addition to the first control information in the storage unit 33 of the control server 30. Therefore, when the first device 40 is, for example, a device that requires real-time operation from the user, such as a lighting device, the control device 20 can control the operation of the first device 40 via a local network. As a result, the control of the first device 40 in scene control can be executed quickly without causing the user any discomfort.

[0076] [Example 2: Execution of Scene Control]

[0077] Next, an example of the action of the control system 100 when performing scene control will be described. Figure 3 This is a sequence diagram illustrating a second example of the operation of the control system 100 according to Embodiment 1. In this second example, the operation terminal 10 (e.g., a remote control installed in the building 80) is subject to execution instructions based on scene input by the user, but the operation terminal 60 (e.g., a portable terminal held by the user) may also receive the execution instructions.

[0078] First, if the input receiving unit 13 of the operation terminal 10 receives the input of the scene control execution instruction (also called the execution input) (step S101), the control unit 12 outputs the scene control execution instruction to the control device 20 via the communication unit 11 (step S102).

[0079] If the control unit 23 of the control device 20 obtains the scene control execution instruction (not shown) output from the operation terminal 10 in step S102 via the first communication unit 21, it determines whether the scene control control information in which the execution instruction has been obtained contains first control information related to the control of the first device 40 (step S103).

[0080] In step S103, if the control unit 23 of the control device 20 determines that the control information includes the first control information (yes), the control unit 23 reads the first control information from the storage unit 24 (step S104) and outputs the read first control information to the first device 40 (step S105). Furthermore, the control unit 23 of the control device 20 outputs the scene control execution instruction obtained in step S103 to the control server 30 via the second communication unit 22 (step S106).

[0081] The first device 40 obtains the first control signal output from the control device 20 in step S105 (step S107) and performs an operation according to the obtained first control signal (step S108).

[0082] If the information processing unit 32 of the control server 30 obtains the scene control execution instruction output from the control device 20 in step S106 (step S109), it reads the second control information related to the control of the second device 50 in the scene control from the storage unit 33 based on the obtained execution instruction (step S110).

[0083] Next, the execution unit 35 of the information processing unit 32 of the control server 30 outputs a second control signal, which is used to control the second device 50 based on the second control information read in step S110, to the second device 50 via the second communication unit 22 (step S111).

[0084] The second device 50 obtains the second control signal output from the control server 30 in step S111 (step S112), and performs an action according to the obtained second control signal (step S113).

[0085] On the other hand, in step S103, if the control unit 23 of the control device 20 determines that the first control information is not included in the control information (No), the control unit 23 performs the processing in step S106. Then, the control system 100 performs the above-described steps S109 to S113.

[0086] As described above, during the execution of scene control, the control system 100 uses the local network to control the first device 40, and the control server 30 controls the second device 50 via a gateway that relays the local network and the Internet. This shortens the time lag from the input of the scene control execution instruction to the execution of the action control of the first device 40, thus reducing the user's discomfort with the actions of the first device 40.

[0087] [Example 3: Execution of Scene Control]

[0088] Next, other examples of the actions of the control system 100 during scenario control will be described. Figure 4 This is a sequence diagram illustrating the operation of the control system 100 according to Embodiment 1, as a third example. In the second example, the execution instruction for scene control received by the operation terminal 10 or operation terminal 60 is output to the control device 20. However, in the third example, the output destination of the execution instruction is changed depending on whether the first device 40 is included in the controlled object of the scene control. Here, the explanation will focus on the points that differ from the second example, and repeated explanations will be omitted or simplified.

[0089] First, if the input receiving unit 63 of the operation terminal 60 receives the input of the execution instruction of the scene control (step S201), the control unit 62 reads the control information (not shown) related to the scene control from the storage unit 66 and determines whether the read control information contains the first control information related to the control of the first device 40 (step S202).

[0090] In step S202, if the control unit 62 determines that the control information includes the first control information (yes), it outputs the execution instruction of the scene control to the control device 20 via the communication unit 61 (step S203).

[0091] If the control device 20 obtains the scene control execution instruction output from the operation terminal 60 in step S203 (step S204), it reads the first control information related to the control of the first device 40 in the scene control from the storage unit 24 based on the obtained execution instruction (step S205).

[0092] Next, the control unit 23 of the control device 20 outputs a first control signal, used to control the first device 40 based on the first control information read in step S205, to the first device 40 via the first communication unit 21 (step S206). Furthermore, the control unit 23 of the control device 20 outputs the scene control execution instruction obtained in step S203 to the control server 30 via the second communication unit 22 (step S207).

[0093] The first device 40 obtains the first control signal output from the control device 20 in step S206 (step S208) and performs an operation according to the obtained first control signal (step S209).

[0094] If the information processing unit 32 of the control server 30 obtains the scene control execution instruction output from the control device 20 in step S207 (step S210), it reads the second control information related to the control of the second device 50 in the scene control from the storage unit 33 based on the obtained execution instruction (step S211).

[0095] Next, the execution unit 35 of the information processing unit 32 of the control server 30 outputs a second control signal, which is used to control the second device 50 based on the second control information read in step S211, to the second device 50 via the second communication unit 22 (step S212).

[0096] The second device 50 obtains the second control signal output from the control server 30 in step S212 (step S213), and performs an action according to the obtained second control signal (step S214).

[0097] On the other hand, if in step S202 the control unit 62 of the operating terminal 60 determines that the first control information is not included in the control information read from the storage unit 66 (no), then the control unit 62 outputs the scene control execution instruction to the control server 30 via the communication unit 61 (step S215).

[0098] Next, the information processing unit 32 of the control server 30 executes the above-described steps S210 to S212, and the second device 50 executes the above-described steps S213 and S214.

[0099] As described above, during the execution of scene control, the control system 100 uses the local network to control the first device 40, and the control server 30 controls the second device 50 via a gateway that relays the local network and the Internet. This shortens the time lag from the input of the scene control execution instruction to the execution of the action control of the first device 40, thus reducing the user's discomfort with the actions of the first device 40.

[0100] As described above, when the operating terminal 60 receives a scene control execution instruction input by the user, it changes the output destination of the scene control execution instruction based on whether the first device 40 is included in the controlled object of the scene control (in other words, whether the first control information is included in the control information related to the scene control). Thus, scene control can be performed quickly based on the controlled object.

[0101] [Effects, etc.]

[0102] As explained above, the control system 100 is a control system used in conjunction with a gateway that relays data to a local network and the Internet. It includes: a control device 20 that acquires execution input for performing scene control, and based on the acquired execution input, controls a first device 40 without via the Internet, wherein the scene control is scene control targeting at least one of the first device 40 connected to the local network and a second device 50 different from the first device 40, and is associated with a real-life scene; and a control server 30 that acquires execution input, and based on the acquired execution input, controls the second device 50 via the gateway and the Internet.

[0103] This control system 100 controls the first device 40 via local network communication, and the second device 50 is controlled by the control server 30 (a so-called cloud server). Therefore, the control system 100 can quickly execute control of devices (such as the first device 40) with low latency and high real-time performance, requiring minimal time delay from receiving a scene control instruction to performing device actions. Consequently, the control system 100 can quickly perform scene control without causing discomfort to the user.

[0104] In addition, for example, the control device 20 stores first control information related to the action of the first device 40 in scene control. If an execution input is obtained, the first device 40 is controlled based on the first control information. In addition to the first control information, the control server 30 also stores second control information related to the action of the second device in scene control. If an execution input is obtained, the second device 50 is controlled based on the second control information.

[0105] Such a control system 100 can execute the control of the first device 40 more quickly than the control of the second device 50 in scene control.

[0106] In addition, for example, the control device 20 manages the operating state of the first device 40 and is communicatively connected to the control server 30, which obtains execution inputs via the control device 20.

[0107] According to such a control system 100, the control device 20 is able to relay local networks and wide area communication networks 70.

[0108] In addition, for example, the control system 100 also includes an operation terminal 60 (e.g., a portable terminal held by a user) that accepts execution input. The operation terminal 60 stores first control information and second control information in scene control. If an execution input is accepted, it determines whether the first control information is included in the control information related to scene control. If it is determined that the first control information is included in the control information, the input is executed and output to the control server 30 via the control device 20. If it is determined that the first control information is not included in the control information, the execution input is output to the control server 30 without going through the control device 20.

[0109] According to this control system 100, in addition to the control server 30 that controls the second device 50, control information related to scene control is also stored in the operation terminal 60. Therefore, the output destination of the execution instruction can be appropriately selected based on whether the first device 40 is included in the controlled object of the scene control. Thus, when the first device 40 is not included in the controlled object of the scene control, the control server 30 can obtain the execution instruction without going through the control device 20, thereby enabling more rapid execution of scene control.

[0110] In addition, for example, the first device 40, the second device 50 and the control device 20 are located inside a building 80, and the control server 30 is located outside a building 80.

[0111] According to such a control system 100, the time delay from the execution instruction of the user input action to the control of the action of the first device 40 can be shortened.

[0112] In addition, for example, the first device 40 is a lighting device.

[0113] According to such a control system 100, the operation of equipment such as lighting equipment can be quickly controlled, which can easily cause awkwardness to users if there is a time delay from the input of the action execution instruction to the action.

[0114] Furthermore, the control method executed by the computer of the control system 100 and the like includes: a first control step, obtaining execution input for performing scenario control with at least one of a first device 40 connected to a local network and a second device 50 different from the first device 40 as the control object, and controlling the first device 40 without via the Internet based on the obtained execution input; and a second control step, obtaining execution input, and controlling the second device 50 via a gateway that relays the local network and the Internet based on the obtained execution input.

[0115] This control method controls the first device 40 via local network communication, while the second device 50 is controlled by the control server 30 (a so-called cloud server). Therefore, this control method can rapidly execute control of devices (such as the first device 40) with low latency and high real-time performance, from receiving a scene control instruction to performing the device's action. Consequently, according to this control method, scene control can be performed quickly without causing discomfort to the user.

[0116] (Implementation Method 2)

[0117] [structure]

[0118] Next, the structure of the control system 100a of Embodiment 2 will be described. Figure 5 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation Method 2.

[0119] In Embodiment 1, an example was described where the control device 20 is a gateway device that manages the operating state of the first device 40 and is communicatively connected to the control server 30. In Embodiment 2, the control device 10a is the operation terminal 10 of Embodiment 1, but it differs from Embodiment 1 in that it is connected to the control server 30 via the gateway 20a and a wide area communication network 70 such as the Internet. Hereinafter, the description will focus on the differences from Embodiment 1, and content that is repeated in Embodiment 1 will be omitted or simplified.

[0120] [Control device 10a]

[0121] The control device 10a is, for example, a remote control or control panel installed in the building 80, and includes a communication unit 11, a control unit 12a, an input receiving unit 13, and a storage unit 16a. For example, if the input receiving unit 13 receives an execution input, the control device 10a determines whether the control information related to scene control contains first control information. If it determines that the first control information is included in the control information, it controls the first device 40 based on the first control information and outputs the execution input to the control server 30 via the gateway 20a. If it determines that the first control information is not included in the control information, it outputs the execution input to the control server 30 via the gateway 20a.

[0122] The control unit 12a performs information processing related to controlling the operation of the control device 10a and information processing related to controlling the first device 40. For example, if the control unit 12a obtains execution input for performing scene control, it reads first control information from the storage unit 16a and controls the first device 40 based on the first control information. More specifically, the control unit 12a outputs control signals to the first device 40 via the communication unit 11. The control unit 12a may be implemented by a microcomputer, for example, but may also be implemented by a processor or dedicated circuitry.

[0123] Storage unit 16a is a storage device for control programs and the like executed by storage control unit 12a. Furthermore, storage unit 16a stores first control information related to the operation of the first device in scene control. Storage unit 16a is implemented, for example, by a semiconductor memory.

[0124] [Gateway 20a]

[0125] Gateway 20a relays control signals output from control device 10a. More specifically, gateway 20a relays control signals by outputting control signals such as scene control execution instructions obtained from control device 20 to control server 30 via wide area communication network 70 such as the Internet. Gateway 20a includes a first communication unit 21, a second communication unit 22, a control unit 23a, and a storage unit 24a.

[0126] The first communication unit 21 is a communication circuit (communication module) for wireless communication between the gateway 20a and the control device 10a or the first device 40. The communication standard used in communication via the first communication unit 21 is not particularly limited. Furthermore, the second communication unit 22 is a communication circuit (communication module) for communication with the control server 30, the second device 50, or the operation terminal 60. The communication standard used in communication via the second communication unit 22 is not particularly limited. Additionally, communication between the first communication unit 21 and the first device 40 may be based, for example, on ECHONET Lite (registered trademark).

[0127] The control unit 23a performs control related to the relay of control signals. The control unit 23a is implemented, for example, by a microcomputer, but it can also be implemented by a processor.

[0128] The storage unit 24a is a storage device for computer programs, etc., executed by the storage control unit 23a. The storage unit 24a is implemented, for example, by a semiconductor memory or the like.

[0129] [action]

[0130] Next, the operation of the control system 100a will be explained.

[0131] [Example 1: Setting and registering control information related to scene control]

[0132] First, an example of the operation of the control system 100a when setting and registering control information related to scene control will be explained. Figure 6 This is a sequence diagram showing the operation of the first example of the control system 100a in Implementation 2.

[0133] Users can use their smartphones or other operating terminals 60 to set control information related to scene control.

[0134] First, if the input receiving unit 63 of the operation terminal 60 receives an input of a setting instruction related to scene control (step S301), the control unit 62 determines whether the control information in the input of the setting instruction contains first control information related to the control of the first device 40 (step S302).

[0135] When the control unit 62 of the operation terminal 60 determines that the control information of the scene control that received the setting instruction in step S301 contains the first control information related to the control of the first device 40 ("Yes" in step S302), it outputs the first control information to the control device 10a via the communication unit 61 (step S303) and outputs the control information to the control server 30 (step S304).

[0136] The control device 10a acquires the first control information (not shown) output from the operation terminal 60 in step S303 and saves the acquired first control information to the storage unit 16a (step S305). Furthermore, the control server 30 acquires the control information (not shown) output from the operation terminal 60 in step S304 and saves the acquired control information to the storage unit 33 (step S306).

[0137] On the other hand, if in step S302 the control unit 62 of the operation terminal 60 determines that the first control information is not included in the control information of the scene control input that received the setting instruction in step S301 (No), then the control information is output to the control server 30 via the communication unit 61 (step S307). The control server 30 obtains the control information (not shown) output from the operation terminal 60 in step S307 and saves the obtained control information to the storage unit 33 (step S308).

[0138] As described above, the control system 100a stores first control information related to the control of the first device 40 in the storage unit 16a of the control device 10a, and stores second control information related to the control of the second device in addition to the first control information in the storage unit 33 of the control server 30. Therefore, when the first device 40 is, for example, a lighting device, where the user requires real-time operation, the control device 10a can control the operation of the first device 40 via a local network. This allows for rapid and seamless control of the first device 40 in scene control without causing discomfort to the user.

[0139] [Example 2: Execution of Scene Control]

[0140] Next, an example of the operation of the control system 100a during scene control will be described. Figure 7 This is a sequence diagram illustrating a second example of the operation of the control system 100a according to Embodiment 2. In this second example, the control device 10a (e.g., a remote control installed in the building 80) is subject to execution instructions based on scene input by the user, but the execution instructions may also be received by the operation terminal 60 (e.g., a portable terminal held by the user).

[0141] First, if the input receiving unit 13 of the control device 10a receives an input of the execution instruction of the scene control (also called the execution input) (step S401), it is determined whether the control information of the scene control that received the execution instruction contains the first control information related to the control of the first device 40 (step S402).

[0142] In step S402, the control unit 12a of the control device 10a determines that the control information includes the first control information (yes), and reads the first control information from the storage unit 16a (step S403). Next, the control unit 12a of the control device 10a outputs a first control signal, which is used to control the first device 40 based on the first control information read in step S403, to the first device 40 via the communication unit 11 (step S404).

[0143] The first device 40 obtains the first control signal output from the control device 10a in step S404 (step S405) and performs an operation according to the obtained first control signal (step S406).

[0144] Furthermore, the control unit 12a of the control device 10a outputs the scene control execution instruction received in step S401 to the gateway 20a via the communication unit 11 (step S407), and the gateway 20a outputs the obtained scene control execution instruction to the control server 30 via the second communication unit 22 (step S408).

[0145] If the information processing unit 32 of the control server 30 obtains the execution instruction of the scene control relayed by the gateway 20a in step S408 (step S409) by the acquisition unit 34, then based on the obtained execution instruction, it reads the second control information related to the control of the second device 50 in the scene control from the storage unit 33 (step S410).

[0146] Next, the execution unit 35 of the information processing unit 32 of the control server 30 outputs a second control signal, which is used to control the second device 50 based on the second control information read in step S410, to the second device 50 via the communication unit 31 (step S411).

[0147] The second device 50 obtains the second control signal output from the control server 30 in step S411 (step S412), and performs an action according to the obtained second control signal (step S413).

[0148] On the other hand, in step S402, if the control unit 12a of the control device 10a determines that the first control information is not included in the control information (No), the processing in step S407 is performed. Then, the control system 100a performs the above-described steps S408 to S413.

[0149] As described above, during the execution of scene control, the control system 100a uses the local network to control the first device 40, and controls the second device 50 via a gateway and the Internet through the control server 30. This shortens the time lag from the input of the scene control execution instruction to the execution of the action control of the first device 40, thus reducing the likelihood of users experiencing discomfort with the actions of the first device 40.

[0150] [A variation of example 2]

[0151] In the second example, the control device 10a is a remote control or controller installed on the wall or other surface of the building 80, and the user operates the remote control to receive execution instructions for scene control. In a variation of the second example, an operation terminal 60 may be used instead of the control device 10a.

[0152] Therefore, the user's portable terminal can be used to perform scene control, thus improving the convenience of the control system 100a.

[0153] [Effects, etc.]

[0154] For example, the control device 10a also includes an input receiving unit 13 for receiving execution input. If the input receiving unit 13 receives the execution input, it determines whether the first control information is included in the control information related to scene control. If it is determined that the first control information is included in the control information, the first device 40 is controlled based on the first control information, and the execution input is output to the control server 30 via the gateway 20a. If it is determined that the first control information is not included in the control information, the execution input is output to the control server 30 via the gateway 20a.

[0155] According to this control system 100a, when the first device 40 is included in the controlled objects of the scene control, the control of the first device 40 can be performed quickly. Thus, the control system 100a can perform scene control quickly without making the user feel awkward.

[0156] In addition, for example, the first device is a lighting device.

[0157] According to such a control system 100a, the operation of equipment such as lighting equipment can be quickly controlled, which can easily cause awkwardness to the user if there is a time delay from the input of the action execution instruction to the action.

[0158] (Implementation Method 3)

[0159] [structure]

[0160] Next, the structure of the control system 100b of Embodiment 3 will be described. Figure 8 This is a block diagram illustrating an example of the functional structure of the control system related to Implementation Method 3.

[0161] In Embodiment 2, the control device 10a is the operation terminal 10 of Embodiment 1, and is connected to the control server 30 via a gateway 20a and a wide area communication network 70 such as the Internet. In Embodiment 3, the control device 60a is the operation terminal 60 of Embodiments 1 and 2, for example, a portable terminal held by a user. Hereinafter, the description will focus on the differences from Embodiments 1 and 2, and repeated content will be omitted or simplified.

[0162] [Control device 60a]

[0163] The control device 60a is, for example, a user-held portable terminal, which includes a communication unit 61, a control unit 62a, an input receiving unit 63, and a storage unit 66a. If the input receiving unit 63 receives an execution input, it determines whether the control information related to scene control contains the first control information. If it determines that the control information contains the first control information, it controls the first device 40 based on the first control information and outputs the execution input to the control server 30 via the gateway 20a. If it determines that the control information does not contain the first control information, it does not output the execution input to the control server 30 via the gateway 20a.

[0164] The control unit 62a performs information processing related to controlling the operation of the control device 60a and information processing related to controlling the first device 40. For example, if the control unit 62a receives execution input for performing scene control, it reads first control information from the storage unit 66a and controls the first device 40 based on the first control information. More specifically, the control unit 62a outputs control signals to the first device 40 via the communication unit 61. The control unit 62a may be implemented by a microcomputer, for example, but may also be implemented by a processor or dedicated circuitry.

[0165] The storage unit 66a is a storage device for control programs and the like executed by the storage control unit 62a. Furthermore, the storage unit 66a stores first control information related to the operation of the first device in scene control. The storage unit 66a is implemented, for example, by a semiconductor memory.

[0166] [action]

[0167] Next, the operation of the control system 100b will be explained.

[0168] [Example 1: Setting and registering control information related to scene control]

[0169] First, an example of the operation of the control system 100b when setting and registering control information related to scene control will be explained. Figure 9 This is a sequence diagram showing the operation of the first example of the control system 100b in embodiment 3.

[0170] Users can set control information related to scene control on the control device 60a, such as a portable terminal they own. Alternatively, the control device 60a can also be a dedicated terminal.

[0171] First, if the input receiving unit 63 of the control device 60a receives an input of a setting instruction related to scene control (step S501), the control unit 62a determines whether the control information in the input of the setting instruction contains first control information related to the control of the first device 40 (step S502).

[0172] When the control unit 62a of the control device 60a determines that the control information for scene control, which received the setting instruction input in step S501, contains first control information related to the control of the first device 40 ("Yes" in step S502), it saves the first control information to the storage unit 66a (step S503) and outputs the control information to the control server 30 via the communication unit 61 (step S504). At this time, the control information may not be relayed in the gateway 20a.

[0173] The control server 30 obtains the control information (not shown) output from the control device 60a in step S504, and saves the obtained control information to the storage unit 33 (step S505).

[0174] On the other hand, if in step S502 the control unit 62a of the control device 60a determines that the control information for scene control that received the setting instruction in step S501 does not contain the first control information (No), then the control information is output to the control server 30 via the communication unit 61 (step S506). The control server 30 obtains the control information (not shown) output from the control device 60a in step S506 and saves the obtained control information to the storage unit 33 (step S507).

[0175] As described above, the control system 100b stores first control information related to the control of the first device 40 in the storage unit 66a of the control device 60a, and stores second control information (i.e., control information) related to the control of the second device in addition to the first control information in the storage unit 33 of the control server 30. Therefore, when the first device 40 is, for example, a device that requires real-time operation by the user, such as a lighting device, the control device 60a can control the operation of the first device 40 via a local network. As a result, the control of the first device 40 in scene control can be executed quickly without causing the user any discomfort. Furthermore, since the control device 60a is a portable or dedicated terminal held by the user, the user can operate it even without using an operating terminal 10 such as a remote control installed on the wall of the building 80. Therefore, the convenience of the control system 100b is improved.

[0176] [Example 2: Execution of Scene Control]

[0177] Next, an example of the operation of the control system 100b during scene control will be described. Figure 10This is a sequence diagram illustrating the operation of the control system 100b in Embodiment 3, as a second example. In Embodiment 2, an example was described where the control device 10a (e.g., a remote control installed in building 80) controls the first device 40 based on an execution instruction for scene control input by the user. Embodiment 3 differs from Embodiment 2 in that the control device 60a (e.g., a portable terminal held by the user) receives the execution instruction and controls the first device 40.

[0178] First, if the input receiving unit 63 of the control device 60a receives the input of the execution instruction of the scene control (step S601), it is determined whether the control information of the scene control that received the execution instruction contains the first control information related to the control of the first device 40 (step S602).

[0179] In step S602, the control unit 62a of the control device 60a determines that the control information includes the first control information (yes), and reads the first control information from the storage unit 66a (step S603). Next, the control unit 62a of the control device 60a outputs a first control signal, which is used to control the first device 40 based on the first control information read in step S603, to the first device 40 via the communication unit 61 (step S604).

[0180] The first device 40 obtains the first control signal output from the control device 60a in step S404 (step S605), and performs an operation according to the obtained first control signal (step S606).

[0181] Furthermore, the control unit 62a of the control device 60a outputs the scene control execution instruction received in step S601 to the gateway 20a via the communication unit 61 (step S607), and the gateway 20a outputs the obtained scene control execution instruction to the control server 30 via the second communication unit 22 (step S608).

[0182] If the information processing unit 32 of the control server 30 obtains the execution instruction of the scene control relayed by the gateway 20a in step S608 (step S609) by the acquisition unit 34, it reads the second control information related to the control of the second device 50 in the scene control from the storage unit 33 based on the obtained execution instruction (step S610).

[0183] Next, the execution unit 35 of the information processing unit 32 of the control server 30 outputs a second control signal, which is used to control the second device 50 based on the second control information read in step S610, to the second device 50 via the communication unit 31 (step S611).

[0184] The second device 50 obtains the second control signal output from the control server 30 in step S611 (step S612), and performs an action according to the obtained second control signal (step S613).

[0185] On the other hand, in step S602, the control unit 62a of the control device 60a determines that the first control information is not included in the control information (No), and does not output the scene control execution instruction to the control server 30 via the gateway 20a (step S614). Then, the control system 100b performs the above-described steps S609 to S613.

[0186] As described above, during the execution of scene control, the control system 100b outputs an execution instruction via the gateway for the second device 50 if the first device 40 is included in the controlled objects of the scene control, and does not output an execution instruction via the gateway if the first device 40 is not included in the controlled objects of the scene control. This allows for faster scene control.

[0187] [Effects, etc.]

[0188] Furthermore, for example, the control device 60a also includes an input receiving unit 63 for receiving execution inputs; if the input receiving unit 63 receives the execution input, it determines whether the first control information is included in the control information related to scene control; if it is determined that the first control information is included in the control information, the first device 40 is controlled based on the first control information, and the execution input is output to the control server 30 via the gateway 20a; if it is determined that the first control information is not included in the control information, the execution input is not output to the control server 30 via the gateway 20a.

[0189] According to this control system 100b, when the first device 40 is included in the controlled objects of the scene control, the control of the first device 40 can be performed quickly. Therefore, the control system 100b can perform scene control quickly without causing discomfort to the user. Furthermore, according to the control system 100b, since the control server 30 can obtain execution instructions without going through the gateway 20a when the first device 40 is not included in the controlled objects of the scene, scene control can be performed even more quickly.

[0190] In addition, for example, the first device 40 is a lighting device.

[0191] According to such a control system 100b, the operation of equipment such as lighting equipment can be quickly controlled, which can easily cause awkwardness to the user if there is a time delay from the input of the action execution instruction to the action.

[0192] (Other implementation methods)

[0193] The embodiments have been described above, but this disclosure is not limited to the embodiments described above. For example, in the embodiments described above, the constituent elements (functions) of each system can be allocated to multiple devices in any way.

[0194] Furthermore, the communication method between devices in the above embodiments is not particularly limited. Additionally, communication between devices may also be conducted via a relay device (not shown). Furthermore, the information transmission path described in the above embodiments is not limited to the transmission path shown in the sequence diagram.

[0195] Furthermore, in the above embodiments, the processing performed by a specific processing unit can also be performed by other processing units. Additionally, the order of multiple processes can be changed, or multiple processes can be executed in parallel.

[0196] Furthermore, in the above embodiments, each component can also be implemented by executing a software program suitable for each component. Each component can also be implemented by reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory by a program execution unit such as a CPU or processor.

[0197] Furthermore, each component can also be implemented in hardware. For example, each component can be a circuit (or integrated circuit). These circuits can either form a single circuit as a whole or be separate circuits. Moreover, these circuits can be either general-purpose circuits or special-purpose circuits.

[0198] Furthermore, the overall or specific technical solutions disclosed herein can also be implemented by a system, apparatus, method, integrated circuit, computer program, or a recording medium such as a computer-readable CD-ROM, or by any combination of the system, apparatus, method, integrated circuit, computer program, and recording medium.

[0199] For example, this disclosure can also be implemented as a control device or a control system equivalent to the above-described embodiments. Furthermore, this disclosure can also be implemented as a control method executed by a computer in a control system or the like, or as a program for causing a computer to execute such a control method. This disclosure can also be implemented as a computer-readable, non-transitory recording medium containing such a program.

[0200] In addition, this disclosure also includes forms obtained by applying various modifications to the embodiments as conceived by those skilled in the art, or forms achieved by arbitrarily combining the constituent elements and functions of the embodiments without departing from the spirit of this disclosure.

[0201] Label Explanation

[0202] 10, 60 operation terminals

[0203] 10a, 20, 60a control devices

[0204] 13, 63 Input Acceptance Department

[0205] 20a Gateway

[0206] 30 Control Server

[0207] 40 First Equipment

[0208] 50 Second Equipment

[0209] 100, 100a, 100b control systems

Claims

1. A control system used in conjunction with a gateway for relaying data between a local network and the Internet, wherein, have: A control device acquires execution input for performing scene control targeting at least one of a first device connected to the aforementioned local network and a second device different from the first device; based on the acquired execution input, it controls the first device without via the aforementioned internet; the scene control is a scenario control in which both the first device and the second device may simultaneously be the target of control; and The control server obtains the aforementioned execution input and, based on the obtained execution input, controls the aforementioned second device via the aforementioned gateway and the aforementioned Internet. The aforementioned control system also includes an operation terminal for accepting the aforementioned execution inputs. The aforementioned operating terminal stores first control information related to the action of the first device in the aforementioned scene control and second control information related to the action of the second device in the aforementioned scene control. Upon receiving the aforementioned execution input, it determines whether the first control information is included in the control information related to the aforementioned scene control. If it determines that the first control information is included in the control information, it outputs the execution input to the control server via the aforementioned control device. If it determines that the first control information is not included in the aforementioned control information, it does not output the execution input to the control server via the aforementioned control device. The first device mentioned above is a lighting device.

2. The control system as described in claim 1, wherein, The control device stores the first control information in the above-mentioned scene control, and controls the first device based on the first control information when the above-mentioned execution input is obtained; In addition to the first control information, the control server also stores the second control information in the scenario control. When the execution input is obtained, the second device is controlled based on the second control information.

3. The control system as described in claim 1 or 2, wherein, The aforementioned control device manages the operational status of the first device and is communicatively connected to the aforementioned control server; The aforementioned control server obtains the aforementioned execution input via the aforementioned control device.

4. The control system as described in claim 2, wherein, The aforementioned control device also includes an input receiving unit for accepting the aforementioned execution inputs; When the input receiving unit receives the execution input, it determines whether the control information related to the scene control contains the first control information. If it determines that the control information contains the first control information, it controls the first device based on the first control information and outputs the execution input to the control server via the gateway. If it determines that the control information does not contain the first control information, it outputs the execution input to the control server via the gateway.

5. The control system as described in claim 1 or 2, wherein, The aforementioned first device, the aforementioned second device, and the aforementioned control device are all located within a single building; The aforementioned control server is located outside one of the aforementioned buildings.

6. The control system as described in claim 2, wherein, The aforementioned control device also includes an input receiving unit for accepting the aforementioned execution inputs; When the input receiving unit receives the execution input, it determines whether the control information related to the scene control contains the first control information. If it determines that the control information contains the first control information, it controls the first device based on the first control information and outputs the execution input to the control server via the gateway. If it determines that the control information does not contain the first control information, it does not output the execution input to the control server via the gateway.

7. A control method, wherein, include: The first control step involves the control device acquiring execution input for performing scene control targeting at least one of a first device connected to the local network and a second device different from the first device. Based on the acquired execution input, the first device is controlled without via the internet. This scene control is a scenario control where both the first device and the second device may simultaneously be the target of control. The second control step involves the control server obtaining the aforementioned execution input and, based on the obtained execution input, controlling the second device via a gateway that relays the local network and the internet, and the internet itself. The above control method also includes the step of having the operating terminal accept the above-mentioned execution input. The aforementioned operating terminal stores first control information related to the action of the first device in the aforementioned scene control and second control information related to the action of the second device in the aforementioned scene control. Upon receiving the aforementioned execution input, it determines whether the first control information is included in the control information related to the aforementioned scene control. If it determines that the first control information is included in the control information, it outputs the execution input to the control server via the aforementioned control device. If it determines that the first control information is not included in the aforementioned control information, it does not output the execution input to the control server via the aforementioned control device. The first device mentioned above is a lighting device.

8. A program recording medium, wherein, The system contains a program for causing the computer to perform the control method of claim 7.