Device control method and device control apparatus

Abstract

To provide a device control method capable of automatically connecting to partner devices using information acquired by a camera, regardless of the number of partner devices to be communicated with.SOLUTION: A device control method acquires an image of an acoustic device installed in a room, acquires first device information from the acquired image of the acoustic device, determines from the first device information whether or not wireless connection of the acoustic device is possible, and when it is determined that wireless connection is possible, instructs the wireless device to connect the acoustic device.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a device control method for automatically connecting to peripheral devices using information acquired by a camera in a wireless communication device.

Background Art

[0002] Conventionally, when constructing and using a simple peer-to-peer network, an authentication processing technique is known in which a digital camera reads information for giving permission for communication output by a partner device.

[0003] For example, Patent Document 1 discloses a wireless communication authentication device that is mounted on a digital camera and can perform wireless communication with a partner device having information output means for outputting information for giving permission for communication and authentication means for authenticating the information. A wireless communication authentication device having information acquisition means for acquiring information output from the information output means of the partner device and recognition means for recognizing the information acquired by the information acquisition means is disclosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the wireless communication authentication device disclosed in Patent Document 1 is used when constructing and using a simple peer-to-peer network in an environment where there is no access point, and an environment in which a plurality of partner devices to be communicated with are installed is not assumed. Further, the wireless communication authentication device disclosed in Patent Document 1 has a problem that the information for giving permission for communication output by the partner device is limited to barcode information.

[0006] An object of the present invention is to provide a device control method capable of automatically connecting a target device using information acquired by a camera regardless of the number of target devices for communication.

Means for Solving the Problems

[0007] The device control method is to acquire an image of an acoustic device installed indoors, to acquire first device information from the acquired image of the acoustic device, to determine whether the acoustic device can be wirelessly connected from the first device information, and to instruct a wireless device to connect to the acoustic device when it is determined to be possible.

Effects of the Invention

[0008] According to the device control method of the present invention, there is an effect that the target device can be automatically connected regardless of the number of target devices for communication.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0010] Hereinafter, the information processing system according to the embodiment of the present invention will be described with reference to the drawings. The same reference numerals are given to the same parts in each figure. After Modification 1, the description of matters common to the first embodiment will be omitted, and only the different points will be described. In particular, the same operations and effects due to the same configuration will not be sequentially mentioned for each embodiment.

[0011] 《First Embodiment》 FIG. 1 is a block diagram showing the basic configuration of the information processing system 1. As shown in FIG. 1, the information processing system 1 includes a data processing device 10, a wireless device 20, an audio device 30, and a camera 40.

[0012] Note that the wireless device 20 is, for example, a signal processing device that receives an audio signal from the audio device 30 and performs signal processing. Alternatively, the wireless device 20 may be a wireless access point that connects the audio device 30 to a network. The audio device 30 is a desktop small microphone. The audio device 30 may be a desktop small speaker, a large speaker, a personal computer incorporating a microphone and speaker, a smartphone, a wearable terminal, or a device capable of recording and playing back sounds such as music. Hereinafter, these will be collectively referred to as the audio device 30.

[0013] The data processing device 10 is connected to the wireless device 20 and the camera 40. The camera 40 photographs the audio device 30. The camera 40 transmits the photographed image to the data processing device 10. The data processing device 10 acquires device information from the image of the audio device 30 photographed by the camera 40. The device information is information for identifying the audio device 30. The device information is, for example, information related to the external shape of the product and corresponds to the model information.

[0014] Figure 2 is a block diagram showing the basic configuration of the data processing apparatus 10. As shown in Figure 2, the data processing apparatus 10 includes a CPU 11, a RAM 12, a memory 13, and a user interface (I / F) 14.

[0015] A program for operating the data processing apparatus 10 is stored in the memory 13. The CPU 11 reads the program stored in the memory 13 into the RAM 12 and controls the operation of the data processing apparatus 10. However, the program does not necessarily have to be stored in the memory 13. The CPU 11 may download the program from, for example, a server each time.

[0016] Next, with reference to FIGS. 3 and 4, the flow from when the camera 40 captures an image of the audio device 30 until the data processing apparatus 10 instructs the wireless device 20 to connect to the audio device 30 will be described.

[0017] Figure 3 is an external perspective view of Room R1 according to the first embodiment.

[0018] In the present embodiment, the camera 40 installed in the room R1 is, for example, a ceiling camera. Note that the camera 40 is not limited to a ceiling camera, and may be a camera installed on a wall or a camera placed on a conference monitor. The camera 40 may be installed at a position where it can capture the audio device 30.

[0019] In FIG. 3, the angle of view A1 of the camera 40 is indicated by a dashed line. That is, the camera 40 captures the range of the angle of view A1 and transmits the captured image to the data processing apparatus 10. Also, within the angle of view A1 of the room R1, a speaker S1 and a table microphone M1 are installed around the user, and a speaker S2 and a table microphone M2 are installed at a position away from the user. Outside the angle of view A1 of the room R1, a speaker S3 is installed. Note that in the present embodiment, the speakers S1 to S3, the table microphones M1 and M2 are an example of the audio device 30 of the present invention.

[0020] FIG. 4 is a flowchart showing the operations executed by the CPU 11 according to the first embodiment. As shown in FIG. 4, the data processing apparatus 10 acquires an image of the acoustic device 30 captured by the camera 40 (S001). As described above, the image captured by the camera 40 includes the device information of the acoustic device 30.

[0021] Next, the data processing apparatus 10 acquires information on the external shape of the acoustic device 30 as "first device information" based on the image received from the camera 40 (S002).

[0022] Next, the data processing apparatus 10 determines whether the acoustic device 30 can be wirelessly connected based on the first device information (S003). The data processing apparatus 10 may store in advance in the memory 13 device information of the connection target (for example, information on the external shape, information on the logo, etc.), and determine that the acoustic device 30 can be wirelessly connected when the registered device information of the connection target matches the first device information. As another determination method, the data processing apparatus 10 stores in the memory 13 the first device information of the acoustic device 30 that has been connected in the past, and determines that the acoustic device 30 can be wirelessly connected when the past first device information stored in the memory 13 matches the newly acquired first device information. Further, the CPU 11 may determine whether the acoustic device 30 can be wirelessly connected using a trained model obtained by training a predetermined model using, for example, a neural network or the like with respect to the relationship between the device information of the acoustic device 30, the image of the camera, and whether wireless connection is possible.

[0023] When it is determined that wireless connection is possible (S003: YES), the data processing apparatus 10 instructs the wireless device 20 to connect the acoustic device 30 (S004). The wireless device 20 that has received the instruction from the data processing apparatus 10 performs pairing with the acoustic device 30.

[0024] As described above, in this embodiment, when the acoustic device 30 is installed within the shooting angle A1 captured by the camera 40, the wireless device 20 and the acoustic device 30 are paired. On the other hand, when the acoustic device 30 is installed outside the shooting angle A1 not captured by the camera 40, such as the speaker S3 in FIG. 3, the wireless device 20 and the acoustic device 30 are not paired.

[0025] Therefore, the user of the information processing system 1 can automatically complete the connection between the wireless device 20 and the acoustic device 30 without performing complicated operations. That is, the user of the information processing system 1 can obtain a new customer experience that only the acoustic device 30 that the user wants to use at that time can be automatically connected to the wireless device 20 by simply moving only the acoustic device 30 that the user wants to use within the shooting angle A1 of the camera 40 and moving the acoustic device 30 that the user does not want to use outside the shooting angle A1 of the camera 40.

[0026] 《Second Embodiment》 In the first embodiment, even if the acoustic device 30 is installed at a position away from the user, it is connected to the wireless device 20 as long as it is installed within the shooting angle A1 of the camera 40. However, even if the acoustic device 30 is installed within the shooting angle A1 of the camera 40, the following processing may be executed when it is installed at a position away from the user.

[0027] In the example of FIG. 3, the speaker S2 and the desktop microphone M2 are installed at positions away from the user. In this case, the data processing device 10 does not issue an instruction to connect the speaker S2 and the desktop microphone M2 to the wireless device 20. Specifically, the data processing device 10 determines not to issue an instruction to connect the speaker S2 and the desktop microphone M2 to the wireless device 20 by executing the following operations.

[0028] FIG. 5 is a flowchart showing the operations executed by the CPU 11 according to the second embodiment. Since the processes of steps S001, S002, S003, and S004 in FIG. 5 are the same as those of steps S001, S002, S003, and S004 in FIG. 4, the description thereof will be omitted. In step S003, when it is determined that the acoustic device 30 can be wirelessly connected (S003: YES), the data processing device 10 identifies the position of the acoustic device 30 (S005). When it is determined that the wireless connection is not possible (S003: NO), the data processing device 10 ends the process (END). Next to step S005, the data processing device 10 identifies the position of the user from the received image (S006).

[0029] Note that the position information of the acoustic device 30 and the user identified in steps S005 and S006 includes two-dimensional position information. The two-dimensional position information is X, Y coordinates (orthogonal coordinates) with a predetermined position (for example, the lower left) of the image captured by the camera 40 as the origin.

[0030] Next, the data processing device 10 calculates the distance between the identified acoustic device 30 and the user based on the position information of the acoustic device 30 and the user, and determines whether the distance is less than or equal to a predetermined value (S007). When the determination result is less than or equal to the predetermined value (S007: YES), the data processing device 10 instructs the wireless device 20 to connect to the acoustic device 30 (S004). When the determination result is greater than the predetermined value (S007: NO), the data processing device 10 ends the process (END).

[0031] As described above, in this embodiment, even if the acoustic device 30 is installed within the viewing angle A1 captured by the camera 40, if it is installed at a position away from the user, it is not connected to the wireless device 20. Therefore, the user of the information processing system 1 can operate only the necessary acoustic devices 30. The user can experience a new customer experience of improving the energy saving effect, such as not connecting acoustic devices that are not needed without performing any particular work.

[0032] Also, in the present embodiment, when a plurality of acoustic devices 30 are included in the image captured by the camera 40, the data processing device 10 may acquire both the device information of the acoustic device 30 and the position information of the detected acoustic device 30 as the "first device information". Thereby, even if the data processing device 10 acquires the same device information for a plurality of acoustic devices 30 in the image, since the position information of the plurality of acoustic devices 30 is different from each other, it becomes possible to identify each of the plurality of acoustic devices 30. That is, even if the speaker S1 and the speaker S2, and the desktop microphone M1 and the desktop microphone M2 are of the same model and have the same device information, the data processing device 10 does not misrecognize the speaker S1 and the speaker S2, and the desktop microphone M1 and the desktop microphone M2 as the same acoustic device 30.

[0033] 《Third Embodiment》 In the second embodiment, the positions of the acoustic device 30 and the user are specified from the image acquired by the camera 40, and only the acoustic device 30 installed at a position close to the user is connected to the wireless device 20. However, if there is an acoustic device 30 installed at a position away from the user and the user wants to always connect it to the wireless device 20, the following processing may be executed.

[0034] As described above, in the room R1 shown in FIG. 3, the speaker S1 and the desktop microphone M1 are installed around the user, and the speaker S2 and the desktop microphone M2 are installed at positions away from the user. In such an environment, the user of the information processing system 1 may want to keep only the wireless device 20 and the speaker S2 always connected. For example, the user may want to use the speaker S2 at a far position to output sound from a larger number of speakers to improve the sound quality. In such a case, the user of the information processing system 1 can maintain the state in which the speaker S2 is connected to the wireless device 20 regardless of the position of the user by registering the device information of the speaker S2 in the memory 13 in advance.

[0035] FIG. 6 is a flowchart showing operations executed by the CPU 11 according to the third embodiment. Since the processes in steps S001 and S004 in FIG. 6 are the same as the processes in steps S001 and S004 in FIG. 4, the description thereof is omitted. The data processing device 10 receives an input from the user of the information processing system 1 via the user I / F 14. Specifically, the user of the information processing system 1 inputs device information of the audio device 30 that he / she wants to constantly connect to the wireless device 20. For example, the user determines a unique ID (numerical value) etc. specific to the audio device 30 that he / she wants to constantly connect to, and inputs the unique ID as device information. Further, the user prepares a piece of paper on which the unique ID is written, and attaches it to the audio device 30 that he / she wants to constantly connect to. The data processing device 10 stores the device information input by the user of the information processing system 1 in the memory 13 as "second device information" (S008).

[0036] Next, the data processing device 10 acquires an image of the audio device 30 from the camera 40 (S001). Next, the data processing device 10 acquires the device information included in the image as "first device information" (S009). Here, the data processing device 10 recognizes not only the external shape but also numerical values etc. (unique ID) as device information.

[0037] Next, the data processing device 10 determines whether or not the first device information and the second device information match (S010). Here, when the data processing device 10 recognizes a numerical value that matches the unique ID (numerical value) input by the user, it determines that the first device information and the second device information match. If it is determined that they match (S010: YES), the data processing device 10 instructs the wireless device 20 to connect to the audio device 30 (S004). If it is determined that they do not match (S010: NO), the data processing device 10 ends the process (END).

[0038] As described above, in this embodiment, even for the audio device 30 installed at a position away from the user, the user can input device information to the data processing device 10 in advance, so that the state of being connected to the wireless device 20 can be maintained.

[0039] 《Fourth Embodiment》 Figures 7, 8, and 9 are diagrams showing the large conference room R2 in plan view according to the fourth embodiment. The range indicated by the dashed line in Figures 7, 8, and 9 is the viewing angle A2 of the camera 40 in the present embodiment.

[0040] In the present embodiment, the number of cameras 40 installed in the large conference room R2 may be one or a plurality. Also, the viewing angle A2 can be arbitrarily set by the user of the information processing system 1. Further, a monitor (not shown) for displaying the image captured by the camera 40 may be installed in the large conference room R2 so that the user of the information processing system 1 can visually recognize the viewing angle A2 of the camera 40.

[0041] As shown in Figure 7, a plurality of table microphones M3 to M7 are installed near the users in the large conference room R2. In the present embodiment, the table microphones M3 to M7 are an example of the acoustic device 30 of the present invention.

[0042] In Figure 7, it is assumed that the data processing device 10 has already completed the connection between the wireless device 20 and the table microphones M3 to M7 based on the first device information of the table microphones M3 to M7. In such a situation, for example, if two new users bring a table microphone M8 into the large conference room R2 and change the layout as shown in Figure 8. In such a case, the data processing device 10 receives a new image from the camera 40, newly acquires the first device information of the table microphone M8 from the image, and instructs the wireless device 20 to connect the table microphone M8 based on the first device information.

[0043] In the present embodiment, the data processing device 10 continuously receives images from the camera 40 in real time. As a result, the user of the information processing system 1 can easily connect the wireless device 20 and the acoustic device 30 at any time by moving the acoustic device 30 to be connected to the wireless device 20 within the viewing angle A2 of the camera 40.

[0044] In addition, the user of the information processing system 1 may want to change back from the layout of FIG. 8 to the layout of FIG. 7. In such a case, the user may move the desktop microphone M8 outside the viewing angle A2 of the camera 40. When the data processing device 10 can no longer obtain the first device information of the desktop microphone M8 from the image received from the camera 40, it instructs the wireless device 20 to disconnect the connection with the desktop microphone M8.

[0045] Also, the user of the information processing system 1 may want to change from the lecture-style layout shown in FIG. 8 to the discussion-style layout shown in FIG. 9. In such a case, the user of the information processing system 1 sets a plurality of regions (viewing angles A3, A4, A5) from the image of the camera 40. The data processing device 10 receives an image from the camera 40 and obtains the first device information of the desktop microphones M3 to M5 from the viewing angles A3, A4, and A5 in the image, respectively. Based on the obtained first device information of each of the viewing angles A3, A4, and A5, the data processing device 10 instructs the wireless device 20 to connect the desktop microphones M3 to M5. At this time, the data processing device 10 instructs three different wireless devices 20 to connect to the desktop microphones M3 to M5, respectively.

[0046] In this way, in the present embodiment, the user of the information processing system 1 can easily create a space like a small conference room by setting the viewing angles A3, A4, and A5 of a smaller space from the viewing angle A2 of the camera 40 without moving to another room.

[0047] <<Modification Example 1>> FIG. 10 is a block diagram showing the basic configuration of the information processing system 1 according to Modification Example 1.

[0048] In Modification Example 1, the audio device 30 further includes a display unit 31, and the device information of the audio device 30 is displayed on the display unit 31. As the device information displayed on the display unit 31, in addition to the information related to the external shape, for example, there are a two-dimensional code, a manufacturer logo, a product logo, an LED lighting pattern, or a barcode.

[0049] In addition, when using a two-dimensional code as device information, the two-dimensional code only contains information for identifying the audio device 30. The data processing device 10 reads only the two-dimensional code related to the device information and does not read other two-dimensional codes. For example, even if there is a confidential document with a two-dimensional code for accessing internal company confidential information printed beside the audio device 30, the camera 40 does not read the two-dimensional code of the confidential document, and there is no risk of leakage of confidential information.

[0050] Finally, the description of this embodiment should be considered illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims rather than the above-described embodiments. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope equivalent to the claims.

Description of Reference Numerals

[0051] 1: Information processing system, 10: Data processing device, 11: CPU, 12: RAM, 13: Memory, 14: User interface, 20: Wireless device, 30: Audio device, 31: Display unit, 40: Camera, A1 to A5: Viewing angles, R1: Room, R2: Conference room, S1 to S3: Speakers, M1 to M8: Table microphones

Claims

1. Acquire images of the audio equipment installed in the room, acquiring first device information from the acquired image of the audio device; determining whether or not wireless connection of the audio device is possible based on the first device information; instructing the wireless device to connect the audio device if it is determined that the connection is possible; Device control method.

2. The first device information includes information related to a shape, a logo, a two-dimensional code, or an LED lighting pattern of the audio device. The device control method according to claim 1 .

3. the image includes images of a plurality of the audio devices; the first device information includes position information of each of the plurality of audio devices; identifying each of the plurality of audio devices based on the location information; The device control method according to claim 1 .

4. The second device information is stored in advance in a storage unit; determining that a wireless connection is possible when the first device information and the second device information match; The device control method according to any one of claims 1 to 3.

5. The second device information includes a shape, a logo, a two-dimensional code, or an LED lighting pattern of the audio device. The device control method according to claim 4.

6. instructing the wireless device to disconnect from the audio device when the first device information of the audio device cannot be acquired from the image; The device control method according to any one of claims 1 to 3.

7. The wireless device is a signal processing device that receives an audio signal from the audio device and processes the signal, or a wireless access point that connects the audio device to a network. The device control method according to any one of claims 1 to 3.

8. A camera that captures images of audio equipment installed in a room; a processing unit that acquires first device information from the acquired image of the audio device and determines whether or not wireless connection of the audio device is possible based on the first device information; a wireless device that is wirelessly connected to the audio device, and a device control device that instructs the wireless device to connect to the audio device when it is determined that wireless connection is possible.

9. The processing unit acquires a shape, a logo, a two-dimensional code, or an LED lighting pattern of the audio device as the first device information. The device control device according to claim 8.

10. The camera captures an image including a plurality of the audio devices; The processing unit acquires the first device information including position information of each of the plurality of audio devices, and identifies each of the plurality of audio devices based on the position information. The device control device according to claim 8.

11. The processing unit stores second device information in advance in a storage unit, determining that a wireless connection is possible when the first device information and the second device information match; The device control device according to any one of claims 8 to 10.

12. The processing unit acquires a shape, a logo, a two-dimensional code, or an LED lighting pattern of the audio device as the second device information. The device control device according to claim 11.

13. the processing unit instructs the wireless device to disconnect from the acoustic device when the first device information of the acoustic device cannot be acquired from the image. The device control device according to any one of claims 8 to 10.

14. The wireless device is a signal processing device that receives an audio signal from the audio device and processes the signal, or a wireless access point that connects the audio device to a network. The device control device according to any one of claims 8 to 10.

Images