Information processing method

Abstract

To improve usability.SOLUTION: An information processing method includes the followings. An information terminal respectively paired to a first device having a first light-emitting part and a second device having a second light-emitting part transmits first information for controlling driving of the first light-emitting part to the first device on the basis of first identification information about the first device. The first device executes first control for controlling the driving of the first light-emitting part on the basis of the first information. The information terminal acquires first image data showing an image obtained by imaging the first light-emitting part and the second light-emitting part after executing the first control and the image including a first object and the second object. The information terminal associates the first object with the first device on the basis of the first image data and the first information.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method. [Background technology]

[0002] Conventionally, there are known techniques for operating devices such as lighting fixtures using information terminals such as smartphones. For example, Patent Document 1 discloses a system in which an image of a lighting fixture captured by a camera of the mobile terminal is displayed on a touch panel of the mobile terminal, and the lighting of the lighting fixture is controlled based on touch operations on the touch panel. In the system described in Patent Document 1, the target lighting fixture is identified by touch operations using the lighting fixture positions stored in a server. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-98155 Summary of the Invention [Problem to be solved by the invention]

[0004] The system described in Patent Document 1 requires the server to store the lamp positions, which places a heavy burden on the user. Also, when a lamp is replaced, there may be multiple lamps in the same lamp position, which may result in the lamp not being able to be identified. [Means for solving the problem]

[0005] An information processing method according to one embodiment of the present disclosure includes an information terminal paired with a first device having a first light-emitting unit and a second device having a second light-emitting unit, transmitting first information to the first device for controlling driving of the first light-emitting unit based on first identification information regarding the first device; the first device executing first control for controlling driving of the first light-emitting unit based on the first information; the information terminal acquiring first image data indicating an image captured of the first light-emitting unit and the second light-emitting unit after executing the first control, the image including a first object and a second object; and the information terminal associating the first object with the first device based on the first image data and the first information. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a schematic diagram of a system used in an information processing method according to a first embodiment. [Figure 2] 1 is a configuration diagram of a system used in an information processing method according to a first embodiment. [Figure 3] 3 is a flowchart showing the flow of an information processing method according to the first embodiment. [Figure 4] FIG. 10 is an explanatory diagram of an image indicated by second image data. [Figure 5] FIG. 2 is an explanatory diagram of an image represented by first image data. [Figure 6] FIG. 10 is an explanatory diagram of an operation image. [Figure 7] FIG. 10 is a configuration diagram of a system used in an information processing method according to a second embodiment. [Figure 8] 10 is a flowchart showing the flow of an information processing method according to the third embodiment. [Figure 9] FIG. 10 is a configuration diagram of a system used in an information processing method according to a fourth embodiment. [Figure 10] 10 is a flowchart showing the flow of an information processing method according to a fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings. Note that the dimensions and scale of each part in the drawings may differ from the actual dimensions and are shown schematically to facilitate understanding. Furthermore, the scope of the present disclosure is not limited to these embodiments unless otherwise specified in the following description to the effect that the present disclosure is limited.

[0008] 1. First embodiment 1-1. Overview of the system used in the information processing method FIG. 1 is a schematic diagram of a system 100 used in an information processing method according to a first embodiment. The system 100 includes lighting devices 10-1 to 10-7 and an information terminal 20, and controls the driving of the lighting devices 10-1 to 10-7 using the information terminal 20. The lighting device 10-1 is an example of a "first device." The lighting device 10-2 is an example of a "second device." The lighting device 10-7 is an example of a "third device."

[0009] Each of the lighting devices 10-1 to 10-7 is a lighting fixture. Each of the lighting devices 10-1 to 10-6 is installed in a room RM1. The lighting device 10-1 has a light-emitting unit 11-1 that emits light in the room RM1. The light-emitting unit 11-1 is an example of a "first light-emitting unit." Similarly, the lighting devices 10-2 to 10-6 have light-emitting units 11-2 to 11-6 that emit light in the room RM1. The light-emitting unit 11-2 is an example of a "second light-emitting unit." In contrast, the lighting device 10-7 is installed in a room RM2 that is different from the room RM1. The lighting device 10-7 has a light-emitting unit 11-7 that emits light in the room RM2. The light-emitting unit 11-7 is an example of a "third light-emitting unit."

[0010] Hereinafter, lighting devices 10-1 to 10-7 may be referred to as lighting device 10 without distinction. Furthermore, light-emitting units 11-1 to 11-7 may be referred to as light-emitting unit 11 without distinction.

[0011] The number of lighting devices 10 installed in room RM1 may be two or more, and is not limited to the illustrated example, but may be any number. The number of lighting devices 10 installed in room RM2 is not limited to the illustrated example, but may be any number. The lighting devices 10 installed in room RM2 may be omitted.

[0012] The information terminal 20 is an information processing device paired with each of the lighting devices 10-1 to 10-7 using a protocol such as Matter, and has a function of controlling the operation of the lighting devices 10-1 to 10-7. "Matter" is a registered trademark. The information terminal 20 has a display device 21, and causes the display device 21 to display an operation image GC for accepting an operation to control the operation of the lighting devices 10-1 to 10-7. The operation image GC includes an object OB associated with the lighting device 10, as will be described later. The information terminal 20 is capable of executing a process for performing this association. In the illustrated example, the information terminal 20 is a portable terminal such as a smartphone or a tablet terminal, and the display device 21 accepts a touch operation by a user on the operation image GC.

[0013] 1-2. System configuration used in information processing method 2 is a configuration diagram of a system 100 used in the information processing method according to the first embodiment. As shown in FIG. 2, each of the lighting devices 10-1 to 10-7 includes a light-emitting unit 11, a communication device 12, and a control device 13.

[0014] The light emitting unit 11 is a light source that emits light when energized, and includes, for example, light emitting diode elements that emit light of a plurality of colors.

[0015] The communication device 12 is a receiving circuit that receives control information D3 (described later) from the information terminal 20, and is, for example, a wireless communication device such as LPWA (Low Power Wide Area), wireless LAN including Wi-Fi, Bluetooth, etc. "Wi-Fi" and "Bluetooth" are both registered trademarks. The control device 13 is a circuit that controls the driving of the light-emitting unit 11 based on control information D3, which will be described later. The control device 13 has, for example, a power supply circuit that includes a converter or the like that converts power from an AC power supply (not shown) into DC and supplies the DC power to the light-emitting unit 11, and a control circuit that includes a processor or the like that controls the operation of the power supply circuit based on control information D3, which will be described later.

[0016] On the other hand, the information terminal 20 includes a display device 21, an imaging device 22, an input device 23, a communication device 24, a storage device 25, and a processing device 26. These are connected to each other so that they can communicate with each other.

[0017] The display device 21 displays various images under the control of the processing device 26. The display device 21 is a display device including various display panels such as a liquid crystal display panel and an organic EL (electro-luminescence) display panel. The display device 21 of this embodiment is a touch panel and also serves as the input device 23.

[0018] The imaging device 22 is a digital camera having an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).

[0019] The input device 23 is an input device that accepts operations from a user. The input device 23 of this embodiment is configured as a touch panel integrated with the display device 21. Note that the input device 23 is not limited to a touch panel, and may be, for example, a touch pad provided separately from the display device 21 or a pointing device such as a mouse.

[0020] The communication device 24 is a communication device capable of communicating with the lighting devices 10-1 to 10-7, etc. For example, the communication device 24 is a wireless communication device such as LPWA, wireless LAN including Wi-Fi, Bluetooth, etc. Note that the communication device 24 is not limited to a wireless communication device, and may be a wired communication device such as a wired LAN (Local Area Network), USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), etc.

[0021] The storage device 25 is a storage device that stores programs such as an operating system and application programs executed by the processing device 26, and data processed by the processing device 26. The storage device 25 includes, for example, a hard disk drive or a semiconductor memory. Note that part or all of the storage device 25 may be an external storage device of the information terminal 20, or may be provided in an external device such as a server connected to the information terminal 20 via a communication network such as the Internet.

[0022] The storage device 25 stores a program PR1, identification information ID-1 to ID-7, image data D1-1 to D1-7, image data D2, control information D3-1 to D3-7, and correspondence information D4.

[0023] Identification information ID-1 is an example of "first identification information." Identification information ID-2 is an example of "second identification information." Identification information ID-7 is an example of "third identification information." Image data D1-1 is an example of "first image data." Image data D1-2 is an example of "fourth image data." Image data D1-7 is an example of "fifth image data." Image data D2 is an example of "second image data." Control information D3-1 is an example of "first information." Control information D3-2 is an example of "second information." Control information D3-7 is an example of "third information."

[0024] Hereinafter, the identification information ID-1 to ID-7 may be referred to as identification information ID without distinction, the image data D1-1 to D1-7 may be referred to as image data D1 without distinction, and the control information D3-1 to D3-7 may be referred to as control information D3 without distinction.

[0025] The program PR1 is a program for executing an information processing method to be described later.

[0026] The identification information ID is information related to the lighting device 10, for example, identification information for identifying the lighting device 10. Specifically, the identification information ID-1 is information related to the lighting device 10-1, for example, including the unique information of the lighting device 10-1. The identification information ID-2 is information related to the lighting device 10-2, for example, including the unique information of the lighting device 10-2. The identification information ID-3 is information related to the lighting device 10-3, for example, including the unique information of the lighting device 10-3. The identification information ID-4 is information related to the lighting device 10-4, for example, including the unique information of the lighting device 10-4. The identification information ID-5 is information related to the lighting device 10-5, for example, including the unique information of the lighting device 10-5. The identification information ID-6 is information related to the lighting device 10-6, for example, including the unique information of the lighting device 10-6. The identification information ID-7 is information related to the lighting device 10-7, for example, including the unique information of the lighting device 10-7.

[0027] The image data D1 is information indicating an image G1, which will be described later. The image G1 is an image of the light-emitting units 11-1 to 11-6 in the room RM1 captured by the imaging device 22 after execution of step ST30, which will be described later, and includes objects OB-1 to OB-6, which will be described later. Specifically, the image G1 indicated by the image data D1-1 is an image of the light-emitting units 11-1 to 11-5 captured after execution of drive control of the light-emitting unit 11-1 in step ST30. The image G1 indicated by the image data D1-2 is an image of the light-emitting units 11-1 to 11-5 captured after execution of drive control of the light-emitting unit 11-2 in step ST30. The image G1 indicated by the image data D1-3 is an image of the light-emitting units 11-1 to 11-5 captured after execution of drive control of the light-emitting unit 11-3 in step ST30. Image G1 represented by image data D1-4 is an image of light-emitting units 11-1 to 11-5 captured after drive control of light-emitting unit 11-4 is executed in step ST30. Image G1 represented by image data D1-5 is an image of light-emitting units 11-1 to 11-5 captured after drive control of light-emitting unit 11-5 is executed in step ST30. Image G1 represented by image data D1-6 is an image of light-emitting units 11-1 to 11-5 captured after drive control of light-emitting unit 11-6 is executed in step ST30. Image G1 represented by image data D1-7 is an image of light-emitting units 11-1 to 11-5 captured after drive control of light-emitting unit 11-7 is executed in step ST30.

[0028] Image data D2 is information indicating image G2, which will be described later. Image G2 is an image of light-emitting units 11-1 to 11-5 captured before step ST30, which will be described later, is executed, and includes objects OB-1 to OB-6, which will be described later.

[0029] Control information D3 is information for controlling the driving of light-emitting unit 11. Specifically, control information D3-1 is information for controlling the driving of light-emitting unit 11-1. Control information D3-2 is information for controlling the driving of light-emitting unit 11-2. Control information D3-3 is information for controlling the driving of light-emitting unit 11-3. Control information D3-4 is information for controlling the driving of light-emitting unit 11-4. Control information D3-5 is information for controlling the driving of light-emitting unit 11-5. Control information D3-6 is information for controlling the driving of light-emitting unit 11-6. Control information D3-7 is information for controlling the driving of light-emitting unit 11-7.

[0030] The correspondence information D4 is information indicating the correspondence between the lighting device 10 and an object OB, which will be described later, and is obtained by associating the lighting device 10 with an object OB, which will be described later, in an information processing method, which will be described later.

[0031] The processing device 26 has the function of controlling each part of the information terminal 20 and the function of processing various types of data. The processing device 26 includes, for example, a processor such as a CPU (Central Processing Unit). The processing device 26 may be configured with a single processor or multiple processors. Furthermore, some or all of the functions of the processing device 26 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array).

[0032] In the information terminal 20 described above, the processing unit 26 executes the program PR1 stored in the storage unit 25, thereby realizing various functions required for the information processing method described below.

[0033] 1-3. Information processing method Fig. 3 is a flowchart showing the flow of the information processing method according to the first embodiment. As shown in Fig. 3, the information processing method according to this embodiment includes steps ST10 to ST100. Here, steps ST20 to ST50 are repeated until the association between the lighting device 10 and an object OB (described later) is completed.

[0034] More specifically, first, in step ST10, the information terminal 20 acquires image data D2. This acquisition is performed by the processing device 26 driving the imaging device 22. Here, it is preferable that all of the lighting devices 10-1 to 10-7 are in an off state or in an on state. Furthermore, when all of the lighting devices 10-1 to 10-7 are in an on state, it is preferable that all of the lighting devices are in the same color. The image G2 represented by the image data D2 will be described later with reference to FIG. 4.

[0035] After step ST10, in step ST20, the information terminal 20 transmits the control information D3 to the lighting device 10 based on the identification information ID. Here, by repeating the execution of step ST20, the control information D3-1 to D3-7 is transmitted sequentially. In the present embodiment, the transmission order of the control information D3-1 to D3-6 is illustrated as control information D3-1, D3-2, D3-3, D3-4, D3-5, and D3-6. The transmission of the control information D3-7 may be before or after the transmission of the control information D3-1 to D3-6, or may be between the transmission of the control information D3-1 to D3-6.

[0036] After step ST20, in step ST30, lighting device 10 controls the driving of light-emitting unit 11 based on control information D3. Here, by repeatedly executing step ST30, light-emitting units 11-1 to 11-7 are sequentially controlled and driven. The control by lighting device 10-1 to control the driving of light-emitting unit 11-1 based on control information D3-1 is an example of "first control." The control by lighting device 10-2 to control the driving of light-emitting unit 11-2 based on control information D3-2 is an example of "second control." The control by lighting device 10-7 to control the driving of light-emitting unit 11-7 based on control information D3-7 is an example of "third control."

[0037] The drive control of the light-emitting unit 11 in step ST30 is control that puts the target light-emitting unit 11 into a light-emitting state different from that of the other light-emitting units 11. Examples of different light-emitting states include a state in which the target light-emitting unit 11 is made to emit light and the other light-emitting units 11 are turned off, a state in which the target light-emitting unit 11 is turned off and the other light-emitting units 11 are made to emit light, a state in which the light-emitting color of the target light-emitting unit 11 is made to differ from that of the other light-emitting units 11, and the like.

[0038] After step ST30, in step ST40, the information terminal 20 acquires image data D1. This acquisition is performed by the processing device 26 driving the imaging device 22. Here, as step ST30 is repeatedly executed, step ST40 is repeatedly executed, thereby sequentially acquiring image data D1-1 to D1-7. Image G1 represented by the image data D1 will be described later with reference to FIG. 5.

[0039] After step ST40, in step ST50, the information terminal 20 associates an object OB (described later) with the lighting device 10 based on the image data D1 and the control information D3. Step ST50 includes step ST51. In step ST51, the information terminal 20 detects a change in the object OB resulting from the execution of step ST30 based on the image data D1 and the image data D2. This detection result is used to associate the object OB (described later) with the lighting device 10. This association will be described later with reference to FIGS. 4 and 5.

[0040] After step ST50, in step ST60, the information terminal 20 determines whether or not the association between the lighting devices 10 and the object OB is complete. For example, when the information terminal 20 has associated all of the lighting devices 10-1 to 10-7 with the object OB, the information terminal 20 determines that the association between the lighting devices 10 and the object OB is complete. Note that the information terminal 20 may also determine that the association between the lighting devices 10 and the object OB is complete based on an operation from the user. Note that the "operation from the user" refers to, for example, the user selecting a button (not shown) such as "end association" displayed on the display device 21.

[0041] If the association between the lighting devices 10 and the objects OB is not completed (step ST60: NO), the information terminal 20 returns to step ST20. This allows association between a plurality of lighting devices 10 and the objects OB to be performed.

[0042] By repeating steps ST20 to ST50 in this way, even if the control of the plurality of light-emitting units 11 is the same, it is possible to associate one object OB with another lighting device 10 through a process separate from the process of associating one object OB with the lighting device 10. This simplifies the process of associating these objects.

[0043] However, when steps ST20 to ST50 are executed for the lighting device 10-7, the object OB is not associated with the lighting device 10 in step ST50, and the process proceeds to step ST60.

[0044] Therefore, if the image G1 represented by the image data D1 does not include an object OB associated with a lighting device 10 and the image G2 represented by the image data D1 includes an object OB that is not associated with a lighting device 10 paired with the information terminal 20 (step ST60: NO), in step ST20, the information terminal 20 transmits, to the other lighting devices 10 paired with the information terminal 20, other control information D3 for controlling the driving of other light-emitting units 11 of the other lighting devices 10, based on other identification information ID related to the other lighting devices 10. Furthermore, in step ST30, the other lighting devices 10 perform other control for controlling the driving of other light-emitting units 11, based on the other identification information ID. Furthermore, in step ST40, the information terminal 20 acquires other image data D1 representing an image G1 captured by light-emitting units 11-1 to 11-6 after the execution of the other control. Furthermore, in step ST50, based on the other image data D1 and the other control information D3, the information terminal 20 associates the other object OB included in the image G1 represented by the image data D1 with the other lighting device 10. In this way, it is possible to associate the other object OB with the other lighting device 10 after determining that there are no lighting devices 10 within the imaging range that are not candidates for association with the object OB.

[0045] Furthermore, in step ST50, if there is only one object OB remaining in image G1 represented by image data D1 that has not been associated with a lighting device 10 already paired with information terminal 20, the correspondence between the remaining object OB and lighting device 10 is clear, and therefore the remaining object OB may be associated with the lighting device 10 without repeating steps ST20 to ST50. For example, after associating object OB-1 with lighting device 10-1, if the only remaining object OB is object OB-2, object OB-2 is associated with lighting device 10-2 based on image data D1-1 and control information D3-1. As a result, if there is no other lighting device 10 to be associated with object OB other than lighting device 10-2, object OB-2 can be associated with lighting device 10-2 without controlling the driving of light-emitting unit 11-2. As a result, the number of steps required for association can be reduced.

[0046] On the other hand, when the association between the lighting device 10 and the object OB is completed (step ST60: YES), in step ST70, the information terminal 20 causes the display device 21 to display an operation image GC using the image G1 indicated by the image data D1. A specific example of the operation image GC will be described later with reference to FIG.

[0047] After step ST70, in step ST80, the information terminal 20 determines whether or not an operation to select an object OB using the operation image GC has been accepted.

[0048] If an operation on the operation image GC is received (step ST80: YES), in step ST90, the information terminal 20 controls the driving of the light-emitting unit 11 by transmitting control information D3 to the lighting device 10 based on the operation of selecting the object OB, for controlling the driving of the light-emitting unit 11 corresponding to that operation.

[0049] After step ST90, or if no operation on the operation image GC is received (step ST80: NO), in step ST100, the information terminal 20 determines whether or not to end the process. This determination is made based on, for example, an operation from the user.

[0050] If the processing is not to be ended (step ST100: NO), the information terminal 20 returns to step ST80. This allows the operation image GC to be displayed on the display device 21 until an operation on the operation image GC is accepted. On the other hand, if the processing is to be ended (step ST100: YES), the information terminal 20 ends the processing.

[0051] Fig. 4 is an explanatory diagram of an image G2 represented by image data D2. Fig. 4 illustrates an example of image G2 represented by image data D2 acquired by executing step ST10 with all of lighting devices 10-1 to 10-7 turned off.

[0052] Image G2 is an image obtained by capturing an image of the inside of room RM1, and includes objects OB-1 to OB-6. Object OB-1 is an example of a "first object." Object OB-2 is an example of a "second object."

[0053] Object OB-1 is a captured image of lighting device 10-1. Object OB-2 is a captured image of lighting device 10-2. Object OB-3 is a captured image of lighting device 10-3. Object OB-4 is a captured image of lighting device 10-4. Object OB-5 is a captured image of lighting device 10-5. Object OB-6 is a captured image of lighting device 10-6. Note that since lighting device 10-7 is installed in room RM2, which is different from room RM1, image G2 does not include a captured image of lighting device 10-7.

[0054] Fig. 5 is an explanatory diagram of image G1 represented by image data D1. Fig. 5 illustrates image G1 represented by image data D1-1 acquired by executing step ST40 after driving and controlling light-emitting unit 11-1 in step ST30 by transmitting identification information ID-1 in step ST20.

[0055] 5, image G2 differs from image G1 only in that object OB-1, which is an image captured by lighting device 10-1. Therefore, in step ST51, object OB-1 can be detected based on the difference between image G1 and image G2, and object OB-1 can be associated with lighting device 10-1.

[0056] As described above, in step ST51, the information terminal 20 detects a change in the object OB resulting from the execution of step ST30, based on the image data D1 and image data D2. This allows the object OB to be associated with the lighting device 10 based on the difference between the image G1 indicated by the image data D1 and the image G2 indicated by the image data D2. Furthermore, even if another lighting device 10 other than the target of association has been performing the same process as step ST30 before and after step ST30, the object OB is prevented from being recognized erroneously.

[0057] If the control in step ST30 controls the light emission color of the target light-emitting unit 11, then in step ST40, image data D1 is acquired with the target light-emitting unit 11 and the other light-emitting units 11 emitting light of different colors. This allows the target object OB to be associated with the target lighting device 10 based on the color difference between the target object OB and the other objects OB included in the image G1 represented by the image data D1. Here, if the other light-emitting units 11 and the other objects OB are a pair, the other objects OB can also be associated with the other lighting devices 10 based on the color difference between the target object OB and the other objects OB included in the image G1 represented by the image data D1. Another advantage is that distinguishing between the target object OB and the other objects OB included in the image G1 represented by the image data D1 is less susceptible to the influence of external light. In contrast, if the control in step ST30 is an on / off control or brightness control, acquiring the image data D1 with both the target light-emitting unit 11 and the other light-emitting units 11 emitting light may make it difficult to distinguish between the target object OB and the other objects OB included in the image G1 represented by the image data D1, depending on the external light and other factors.

[0058] As described above, even if information indicating the positions of lighting devices 10-1 to 10-6 is not registered in a server or the like, information terminal 20 can recognize objects OB-1 to OB-6 as objects OB corresponding to lighting devices 10-1 to 10-6.

[0059] 6 is an explanatory diagram of the operation image GC. The operation image GC includes buttons B1-1 to B1-6, B2, and B3, which are displayed superimposed on an image G1 represented by image data D1. Below, the buttons B1-1 to B1-6 may be referred to as button B1 without distinction.

[0060] The button B1 is a button for operating the lighting device 10 and can accept an operation to select an object OB. The button B1-1 is a button for operating the lighting device 10-1 and accepts an operation to select an object OB-1. The operation to select the object OB-1 is an example of a "first operation." The button B1-2 is a button for operating the lighting device 10-2 and accepts an operation to select an object OB-2. The button B1-3 is a button for operating the lighting device 10-3 and accepts an operation to select an object OB-3. The button B1-4 is a button for operating the lighting device 10-4 and accepts an operation to select an object OB-4. The button B1-5 is a button for operating the lighting device 10-5 and accepts an operation to select an object OB-5. The button B1-6 is a button for operating the lighting device 10-6 and accepts an operation to select an object OB-6.

[0061] In this way, after associating the object OB with the lighting device 10, by selecting the object OB to be displayed on the display device 21, it is possible to control the driving of the corresponding light-emitting unit 11.

[0062] In the illustrated example, the button B1 is arranged in the operation image GC such that the distance between the center of the button B1 and the corresponding object OB is shorter than the distance between the center of the button B1 and the non-corresponding object OB, thereby making it easier to understand the correspondence between the button B1, the object OB, and the lighting device 10.

[0063] The button B2 is a button for selecting the control content of the lighting device 10 corresponding to the selected object OB. In the illustrated example, the button B2 includes an item "Power" for turning the lighting device 10 on and off, an item "Level" for adjusting the light emission intensity of the lighting device 10, and an item "Color" for adjusting the light emission color of the lighting device 10. Note that the display content of the button B2 is not limited to the illustrated example and may be arbitrary.

[0064] The button B3 is a button for changing the driving state of the lighting device 10 corresponding to the selected object OB. In the illustrated example, the button B3 includes an indication that allows operation regarding the selection content of the button B2. Note that the display content of the button B3 is not limited to the illustrated example and may be arbitrary.

[0065] As described above, in this embodiment, even if information indicating the positions of the lighting devices 10-1 to 10-6 is not registered in a server or the like, the objects OB-1 to OB-6 can be recognized as the objects OB corresponding to the lighting devices 10-1 to 10-6 in the information terminal 20. This can improve usability.

[0066] 2. Second embodiment A second embodiment of the present disclosure will be described below. In the following exemplary embodiment, for elements whose actions and functions are similar to those of the first embodiment, the reference numerals used in the description of the first embodiment will be used, and detailed descriptions of each element will be omitted as appropriate.

[0067] 7 is a configuration diagram of a system 100A used in an information processing method according to the second embodiment. The system 100A has the same configuration as the system 100 of the first embodiment, except that it includes an information terminal 20A instead of the information terminal 20, and that it also includes a relay device 30 and an imaging device 40.

[0068] The information terminal 20A is configured in the same manner as the information terminal 20 of the first embodiment, except that the information terminal 20A uses the program PR2 instead of the program PR1. Note that the imaging device 22 may be omitted from the information terminal 20A.

[0069] The information terminal 20A operates in the same manner as the information terminal 20 of the first embodiment, except that it transmits control information D3 to the lighting devices 10-1 to 10-7 via the relay device 30 and acquires image data D1 and D2 using the imaging device 40 instead of the imaging device 22.

[0070] Information terminal 20A is paired with each of lighting devices 10-1 to 10-7 via relay device 30 using a protocol such as Matter.

[0071] Relay device 30 is a control device such as an AI (Artificial Intelligence) speaker that is paired with lighting devices 10-1 to 10-7, information terminal 20A, and imaging device 40 using a protocol such as Matter, and is configured to be able to control the driving of lighting devices 10-1 to 10-7. In the illustrated example, relay device 30 has input device 31 for voice recognition, which allows driving of lighting devices 10-1 to 10-7 to be controlled by voice.

[0072] The imaging device 40 is a digital camera such as a surveillance camera that is paired with the relay device 30 using a protocol such as Matter, and includes an imaging element such as a CCD or CMOS, and a communication circuit connected to the imaging element.

[0073] The second embodiment described above also makes it possible to improve usability.

[0074] 3. Third embodiment A third embodiment of the present disclosure will be described below. In the following exemplary embodiments, elements that have the same actions and functions as those in the first embodiment will be designated by the same reference numerals as those in the first embodiment, and detailed descriptions of each element will be omitted where appropriate.

[0075] 8 is a flowchart showing the flow of an information processing method according to the third embodiment. The information processing method according to the third embodiment is the same as the information processing method according to the first embodiment, except that step ST10 is omitted and step ST50A is included instead of step ST50.

[0076] Step ST50A includes steps ST52 and ST53. In step ST52, the information terminal 20 displays the image G1 indicated by the image data D1 on the display device 21. Here, the image G1 can accept an operation to specify a position in the image G1 on the display device 21.

[0077] After step ST52, in step ST53, the information terminal 20 accepts an operation to select an object OB in the image G1 displayed on the display device 21. Here, the target object OB in the image G1 is visually different from other objects OB due to the execution of step ST30. Therefore, the user can select the target object OB based on this difference. Note that the target object OB selected by the user may be information such as pixel coordinates in the image G1.

[0078] In this way, the object OB displayed on the display device 21 is visually recognized by the user, and then the object OB is associated with the lighting device 10 through an operation by the user. This increases the reliability of the association between the object OB and the lighting device 10.

[0079] The third embodiment described above also makes it possible to improve usability.

[0080] 4. Fourth embodiment A fourth embodiment of the present disclosure will be described below. In the following exemplary embodiments, elements whose actions and functions are similar to those of the first embodiment will be designated by the same reference numerals as those used in the description of the first embodiment, and detailed descriptions thereof will be omitted where appropriate.

[0081] 9 is a configuration diagram of a system 100B used in an information processing method according to the fourth embodiment. The system 100B has the same configuration as the system 100 of the first embodiment, except that the system 100B includes an information terminal 20B instead of the information terminal 20.

[0082] The information terminal 20B is configured similarly to the information terminal 20 of the first embodiment, except that it uses a program PR3 instead of the program PR1. The information terminal 20B executes the same operations as the information terminal 20 of the first embodiment, except that it associates the object OB with the lighting device 10 without using image data D2. The image data D1-2 of this embodiment is an example of "third image data."

[0083] 10 is a flowchart showing the flow of an information processing method according to the fourth embodiment. The information processing method of this embodiment is the same as the information processing method of the first embodiment, except that steps ST10 and ST60 are omitted and steps ST20B to ST50B are included instead of steps ST20 to ST50.

[0084] In step ST20B, information terminal 20B transmits control information D3-1 to D3-7. Here, control information D3-1 to D3-7 indicates control to periodically blink light-emitting units 11-1 to 11-7 at predetermined time intervals with mutually shifted timings.

[0085] After step ST20B, in step ST30B, ​​lighting device 10 executes drive control of light-emitting unit 11 based on control information D3. Here, as step ST30B is executed, light-emitting units 11-1 to 11-7 blink periodically at predetermined time intervals with mutually shifted timings.

[0086] After step ST30B, ​​in step ST40B, information terminal 20B periodically acquires image data D1 at a predetermined time interval. This interval is an integer multiple of the interval of step ST20B. As a result, image data D1-1 to D1-7 can be acquired in the same manner as in the first embodiment.

[0087] After step ST40B, in step ST50B, the information terminal 20B associates an object OB (described later) with the lighting device 10 based on the image data D1 and the control information D3. Step ST50B includes step ST54. In step ST54, the information terminal 20B detects a change in the object OB resulting from the execution of step ST30B based on the image data D1-1 to D1-7. The detection result is used to associate the object OB (described later) with the lighting device 10.

[0088] In this way, in step ST40B, information terminal 20B acquires other image data D1 at a timing when a predetermined period has elapsed since the imaging timing of one image data D1. Here, as described above, the control indicated by control information D3 is control for controlling the blinking cycle of light-emitting unit 11. The predetermined period is a period that is an integer multiple of the cycle. In step ST54, information terminal 20B detects a change in object OB due to the execution of the control of step ST30B, ​​based on two image data D1 imaged at different timings. This makes it possible to associate object OB with lighting device 10 even when the light-emitting colors of light-emitting units 11-1 to 11-7 cannot be made different.

[0089] The fourth embodiment described above can also improve usability.

[0090] 5. Variations The above-described embodiments can be modified in various ways. Specific modifications that can be applied to the above-described embodiments are exemplified below. Two or more embodiments arbitrarily selected from the following examples can be combined as appropriate within the scope of not mutually contradictory.

[0091] 5-1. Variation 1 In the above-described embodiment, the lighting devices 10-1 to 10-7 are used, but the present invention is not limited to this. For example, at least one of the lighting devices 10-3 to 10-7 may be omitted.

[0092] 5-2. Variation 2 In the above-described embodiment, the lighting device 10 is exemplified as the device paired with the information terminals 20, 20A, and 20B. However, the present invention is not limited to this, and various devices having a light-emitting unit 11 may be paired with the information terminals 20, 20A, and 20B instead of the lighting device 10.

[0093] 6. Notes A summary of this disclosure is provided below.

[0094] (Supplementary Note 1) A first aspect, which is a preferred example of the information processing method of the present disclosure, includes an information terminal paired with each of a first device having a first light-emitting unit and a second device having a second light-emitting unit, transmitting first information to the first device for controlling driving of the first light-emitting unit based on first identification information regarding the first device; the first device executing first control for controlling driving of the first light-emitting unit based on the first information; the information terminal acquiring first image data indicating an image captured of the first light-emitting unit and the second light-emitting unit after executing the first control, the image including a first object and a second object; and the information terminal associating the first object with the first device based on the first image data and the first information.

[0095] In the above aspect, the first object can be recognized as an object corresponding to the first device in the information terminal without registering information indicating the positions of the first device and the second device in a server or the like.

[0096] (Supplementary Note 2) In a second aspect, which is a preferred example of the first aspect, the information terminal further includes acquiring second image data indicating an image captured of the first light-emitting unit and the second light-emitting unit before executing the first control, and associating the first object with the first device includes the information terminal detecting a change in the first object due to execution of the first control based on the first image data and the second image data. In the above aspect, the first object can be associated with the first device based on a difference between an image indicated by the first image data and an image indicated by the second image data. Furthermore, even if another device is executing a process similar to the first control before and after the first control, recognizing an incorrect object is suppressed.

[0097] (Supplementary Note 3) In a third aspect which is a preferred example of the first or second aspect, associating the first object with the first device includes causing the information terminal to display an image represented by the first image data on a display device, and receiving an operation by the information terminal to select the first object displayed on the display device. In the above aspect, the first object is displayed on the display device and then the user visually recognizes the first object, and the first object is associated with the first device through an operation by the user, thereby increasing the reliability of the association between the first object and the first device.

[0098] (Supplementary Note 4) In a fourth aspect, which is a preferred example of any of the first to third aspects, the first control controls the light emission color of the first light-emitting unit. In the above aspects, by acquiring the first image data with the first light-emitting unit and the second light-emitting unit emitting light of different colors, it is possible to associate the first object with the first device and the second object with the second device based on the difference in color between the first object and the second object included in the image represented by the first image data. Another advantage is that external light is less likely to affect the identification of the first object and the second object included in the image represented by the first image data. In contrast, if the first control is an on / off control or a brightness control, acquiring the first image data with both the first light-emitting unit and the second light-emitting unit emitting light may make it difficult to identify the first object and the second object included in the image represented by the first image data depending on the external light conditions, etc.

[0099] (Supplementary Note 5) In a fifth aspect which is a preferred example of any of the first to fourth aspects, the information terminal further includes acquiring third image data indicating an image obtained by capturing the first light-emitting unit and the second light-emitting unit at a timing when a predetermined period has elapsed since the capture timing of the first image data, the first control controls a blinking cycle of the first light-emitting unit, the predetermined period being an integral multiple of the cycle, and associating the first object with the first device includes the information terminal detecting a change in the first object due to the execution of the first control based on the first image data and the third image data. In the above aspect, even if it is not possible to differentiate the light emission colors of the first light-emitting unit and the second light-emitting unit, it is possible to associate the first object with the first device and to associate the second object with the second device.

[0100] (Supplementary Note 6) In a sixth aspect, which is a preferred example of any of the first to fifth aspects, the information terminal transmits second information to the second device for controlling the driving of the second light-emitting unit based on second identification information related to the second device; the second device executes second control for controlling the driving of the second light-emitting unit based on the second information; the information terminal acquires fourth image data representing an image captured of the first light-emitting unit and the second light-emitting unit after executing the second control; and the information terminal associates the second object with the second device based on the fourth image data and the second information. In the above aspect, even if the first control and the second control are the same, the second object and the second device can be associated by a process separate from the process for associating the first object with the first device. This simplifies the process of associating them.

[0101] (Supplementary Note 7) In an eighth aspect which is a preferred example of any one of the first to sixth aspects, the information terminal is paired with a third device having a third light-emitting unit, and the information terminal transmits third information to the third device for controlling driving of the third light-emitting unit based on third identification information related to the third device, the third device executes third control for controlling driving of the third light-emitting unit based on the third information, the information terminal acquires fifth image data indicating an image captured of the first light-emitting unit and the second light-emitting unit after executing the third control, and the information terminal determines whether the image indicated by the fifth image data does not include an object associated with the third device and is associated with a device already paired with the information terminal. and when an object not included in the image represented by the first image data is included in the image represented by the first image data, for the other device paired with the information terminal, transmitting to the other device other information for controlling drive of another light-emitting unit of the other device based on other identification information related to the other device, the other device executing other control for controlling drive of the other light-emitting unit based on the other identification information, the information terminal acquiring other image data representing an image captured of the first light-emitting unit and the second light-emitting unit after executing the other control, and the information terminal associating the other object included in the image represented by the first image data with the other device based on the other image data and the other information. In the above aspect, it is possible to associate the other object with the other device after determining that a third device that is not a target for association with the object does not exist within the imaging range.

[0102] (Supplementary Note 8) In an eighth aspect, which is a preferred example of any of the first to seventh aspects, the information terminal further includes, when the second object is the only object included in the image represented by the first image data that is not associated with a device paired with the information terminal, associating the second object with the second device based on the first image data and the first information. In the above aspects, when there is no other device to associate with the object other than the second device, the second object can be associated with the second device without controlling the driving of the second light-emitting unit. As a result, the number of steps required for association can be reduced.

[0103] (Supplementary Note 9) In a ninth aspect, which is a preferred example of any of the first to eighth aspects, the information terminal causes a display device to display an operation image using an image represented by the first image data, the information terminal accepts a first operation to select the first object using the operation image, and the information terminal controls driving of the first light-emitting unit by transmitting the first information to the first device based on the first operation. In the above aspect, after associating the first object with the first device, the driving of the first light-emitting unit can be controlled by selecting the first object displayed on the display device. [Explanation of symbols]

[0104] 10...lighting device, 10-1...lighting device (first device), 10-2...lighting device (second device), 10-3...lighting device, 10-4...lighting device, 10-5...lighting device, 10-6...lighting device, 10-7...lighting device (third device), 11...light-emitting unit, 11-1...light-emitting unit (first light-emitting unit), 11-2...light-emitting unit (second light-emitting unit), 11-3...light-emitting unit, 11-4...light-emitting unit, 11-5...light-emitting unit, 11-6...light-emitting unit, 11-7...light-emitting unit (third light-emitting unit), 12...communication device, 13...control device, 20...information terminal, 20A...information terminal, 20B...information terminal, 21...display device, 22...imaging device, 23 ...input device, 24...communication device, 25...storage device, 26...processing device, 30...relay device, 31...input device, 40...imaging device, 100...system, 100A...system, 100B...system, B1...button, B1-1...button, B1-2...button, B1-3...button, B1-4...button, B1-5...button, B1-6...button, B2...button, B3...button, D1...image data, D1-1...image data (first image data), D1-2...image data (third image data, fourth image data), D1-3...image data, D1-4...image data, D1-5...image data, D1-6...image data, D1-7...image data (fifth image data), D2...image data (second image data), D3...control information, D3-1...control information (first information), D3-2...control information (second information), D3-3...control information, D3-4...control information, D3-5...control information, D3-6...control information, D3-7...control information (third information), D4...correspondence information, G1...image, G2...image, GC...operation image, ID-1...identification information (first identification information), ID-2...identification information (first identification information), ID-3...identification information, ID-4...identification information, ID-5...identification information, ID-6...identification information ,ID-7...identification information (third identification information), OB...object, OB-1...object (first object), OB-2...object (second object), OB-3...object, OB-4...object, OB-5...object, OB-6...object, PR1...program, PR2...program, PR3...program, RM1...room, RM2...room, ST10...step, ST20...step, ST20B...step, ST30...step, ST30B...step, ST40...step, ST40B...step, ST50...step,ST50A... step, ST50B... step, ST51... step, ST52... step, ST53... step, ST54... step, ST60... step, ST70... step, ST80... step, ST90... step, ST100... step.

Claims

1. an information terminal paired with each of a first device having a first light-emitting unit and a second device having a second light-emitting unit transmits first information to the first device for controlling driving of the first light-emitting unit based on first identification information related to the first device; the first device executes first control to control driving of the first light-emitting unit based on the first information; acquiring, by the information terminal, first image data representing an image captured by the first light-emitting unit and the second light-emitting unit after the first control is executed, the image including a first object and a second object; The information terminal associates the first object with the first device based on the first image data and the first information. Information processing methods.

2. The information terminal further includes acquiring second image data indicating images captured of the first light-emitting unit and the second light-emitting unit before the first control is executed, Associating the first object with the first device includes: detecting, by the information terminal, a change in the first object due to execution of the first control, based on the first image data and the second image data; The information processing method according to claim 1 .

3. Associating the first object with the first device includes: the information terminal displays an image indicated by the first image data on a display device; receiving, by the information terminal, an operation to select the first object displayed on the display device; The information processing method according to claim 1 .

4. the first control controls the light emission color of the first light-emitting unit; The information processing method according to claim 1 .

5. The information terminal further includes acquiring third image data indicating an image obtained by capturing the first light-emitting unit and the second light-emitting unit at a timing when a predetermined period has elapsed since the timing of capturing the first image data, the first control controls a blinking cycle of the first light-emitting unit, the predetermined period is an integral multiple of the period, Associating the first object with the first device includes: detecting, by the information terminal, a change in the first object due to execution of the first control, based on the first image data and the third image data; The information processing method according to claim 1 .

6. transmitting, to the second device, second information for controlling driving of the second light-emitting unit, based on second identification information related to the second device, by the information terminal; the second device executes second control to control driving of the second light-emitting unit based on the second information; acquiring, by the information terminal, fourth image data indicating an image captured of the first light-emitting unit and the second light-emitting unit after the second control is executed; and the information terminal associating the second object with the second device based on the fourth image data and the second information. The information processing method according to claim 1 .

7. the information terminal is paired with a third device having a third light-emitting unit, transmitting, to the third device, third information for controlling driving of the third light-emitting unit, based on third identification information related to the third device, by the information terminal; the third device executes third control to control driving of the third light-emitting unit based on the third information; acquiring, by the information terminal, fifth image data indicating an image captured of the first light-emitting unit and the second light-emitting unit after the third control is executed; When the image represented by the fifth image data does not include an object associated with the third device and the image represented by the first image data includes an object not associated with a device paired with the information terminal, the information terminal transmits, to the other device, other information for controlling driving of another light-emitting unit of the other device, based on other identification information related to the other device; the other device executes another control for controlling driving of the other light-emitting unit based on the other identification information; acquiring, by the information terminal, other image data representing images captured of the first light-emitting unit and the second light-emitting unit after the execution of the other control; and the information terminal associates another object included in an image represented by the first image data with the other device based on the other image data and the other information. The information processing method according to claim 1 .

8. The method further includes, when the second object is the only object included in the image indicated by the first image data and not associated with a device paired with the information terminal, associating the second object with the second device based on the first image data and the first information, by the information terminal. The information processing method according to claim 1 .

9. the information terminal displays an operation image using an image represented by the first image data on a display device; receiving, by the information terminal, a first operation for selecting the first object using the operation image; The information terminal controls driving of the first light-emitting unit by transmitting the first information to the first device based on the first operation. The information processing method according to claim 1 .

Images