Control system, device control system, control method, device control method, and program

Abstract

To provide a control system capable of controlling equipment on the basis of a person's appearance.SOLUTION: A WEB server 30, which is an example of a control system, includes an acquisition unit 34 that acquires first information regarding clothing of a person located within a specified area 61 and second information regarding the person's gestures, and an output unit 35 that outputs information for controlling equipment to a first state on the basis of the acquired first information, and outputs information for controlling the equipment to a second state on the basis of second information acquired when the equipment is controlled to the first state.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a control system, a device control system, a control method, a device control method, and a program.

Background Art

[0002] Various techniques related to lighting or video effects have been proposed. Patent Document 1 discloses a lighting effect system in which a customer (user) can participate in lighting effects.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention provides a control system or the like that can control a device based on a person's appearance.

Means for Solving the Problems

[0005] A control system according to an aspect of the present invention includes an acquisition unit that acquires first information regarding a person's clothing located within a predetermined area and second information regarding the person's gesture, and outputs information for controlling a device to a first state based on the acquired first information, and outputs information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state.

[0006] A device control system according to an aspect of the present invention includes a first communication unit that communicates with the control system and a second communication unit that communicates with the device, and the second communication unit transmits information for controlling the device to the device based on the information received by the first communication unit.

[0007] A control method according to one aspect of the present invention is a control method executed by a computer system, the method including: an acquisition step of acquiring first information regarding the clothing of a person located within a predetermined area and second information regarding the gesture of the person; and an output step of outputting information for controlling a device to a first state based on the acquired first information, and outputting information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state.

[0008] A program according to one aspect of the present invention is a program for causing the computer system to execute the control method.

[0009] A device control method according to one aspect of the present invention is a device control method executed by a computer system, the method including: a first communication step of communicating with the control system; and a second communication step of transmitting, to the device, information for controlling the device based on the information received in the first communication step.

[0010] A program according to one aspect of the present invention is a program for causing the computer system to execute the device control method.

Advantages of the Invention

[0011] The control system and the like of the present invention can control a device based on the appearance of a person.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

[0013] Hereinafter, the embodiments will be specifically described with reference to the drawings. Note that each of the embodiments described below shows a comprehensive or specific example. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, the components not described in the independent claims are described as optional components.

[0014] Note that each figure is a schematic diagram and is not necessarily drawn precisely. Also, in each figure, the same reference numerals are given to substantially the same configurations, and duplicate descriptions may be omitted or simplified.

[0015] (Embodiment) [Configuration] First, the configuration of the cooperative production system according to the embodiment will be described. FIG. 1 is a block diagram showing the functional configuration of the cooperative production system according to the embodiment.

[0016] The cooperative production system 10 is a system capable of performing lighting production using a plurality of lighting devices 28 in the production target area 60. The production here includes lighting production in parks and the like, and lighting production of buildings such as shrines, temples, museums, suspension bridges, stadiums, or high-rise buildings. FIG. 2 is a diagram showing the lighting production of a building, where the black squares in the figure correspond to the lighting devices 28, and the broken lines in the figure represent the light emitted by the lighting devices 28.

[0017] As shown in FIG. 2, when a person enters a predetermined area 61 within the target area 60, a lighting effect corresponding to the color of the person's clothing is started. Also, when the person makes a gesture (predetermined gesture) of stretching the left or right arm horizontally, the content of the lighting effect is changed. FIG. 3 is a diagram showing an example of the predetermined gesture. That is, the coordinated effect system 10 can perform a lighting effect based on the appearance of a person, such as the person's clothing and gesture. In the example of FIG. 2, the lighting effect is performed not only on the building but also in the vicinity of the person (predetermined area 61).

[0018] The coordinated effect system 10 includes an effect system 20, a WEB server 30, an image processing system 40, and a detection system 50. Hereinafter, these devices or systems will be specifically described.

[0019] Specifically, the effect system 20 includes an effect server 21, a controller 26, a signal converter 27, and a plurality of lighting devices 28.

[0020] The effect server 21 generates effect data (time-series data indicating how the lighting device 28 emits light) based on the effect information received from the WEB server 30 and provides it to the controller 26. The effect server 21 is realized, for example, by a server device (cloud server) located at a location away from the target area 60. The effect server 21 is used, for example, by a first operator who provides a lighting effect service. Specifically, the effect server 21 includes a first communication unit 22, an information processing unit 23, a storage unit 24, and a second communication unit 25.

[0021] The first communication unit 22 is a communication module (communication circuit) for the effect server 21 to communicate with the WEB server 30, the image processing system 40, etc. via a wide-area communication network such as the Internet. The communication performed by the first communication unit 22 is, for example, wired communication, but may also be wireless communication. The communication standard used for communication is not particularly limited either.

[0022] The information processing unit 23 performs information processing for generating the production data. The information processing unit 23 is realized by, for example, a microcomputer, but may also be realized by a processor. The information processing unit 23 includes an acquisition unit 23a and an output unit 23b. The functions of the acquisition unit 23a and the output unit 23b are realized, for example, by a microcomputer or a processor constituting the information processing unit 23 executing a computer program stored in the storage unit 24.

[0023] The storage unit 24 is a storage device that stores information necessary for the above information processing and computer programs executed by the information processing unit 23. The storage unit 24 is realized by, for example, an HDD (Hard Disk Drive), but may also be realized by a semiconductor memory or the like.

[0024] The second communication unit 25 is a communication module (communication circuit) for the production server 21 to communicate with the controller 26 and the like via a wide area communication network such as the Internet. The communication performed by the second communication unit 25 is, for example, wired communication, but may also be wireless communication. The communication standard used for communication is not particularly limited. Note that the second communication unit 25 may be realized by a communication circuit different from the first communication unit 22, or may be realized by the same communication circuit as the first communication unit 22.

[0025] The controller 26 controls a plurality of lighting devices 28 to be controlled based on the production data provided from the production server 21. The plurality of lighting devices 28 to be controlled means a plurality of lighting devices 28 connected to the controller 26 via a signal converter 27. The controller 26 is realized by, for example, a dedicated device, but may also be realized by a general-purpose information terminal. The controller 26 controls the plurality of lighting devices 28 to be controlled by transmitting a control signal to the signal converter 27 in accordance with a communication standard such as Ethernet (registered trademark). The controller 26 is installed, for example, in the target area 60.

[0026] The signal converter 27 converts a control signal in a format based on Ethernet (registered trademark) into a control signal in a format based on DMX. The signal converter 27 is installed in the target area 60, for example.

[0027] The lighting device 28 is installed in the target area 60 and emits light based on the control signal received from the signal converter 27. Specifically, the lighting device 28 includes a red light source, a green light source, and a blue light source. Each of the red light source, the green light source, and the blue light source is realized by an LED chip or the like, and the emission luminance of each light source can be independently controlled. Thereby, the change of the emission color of the lighting device 28 is realized. That is, the lighting device 28 has a dimming function and a color mixing function. Note that each of the red light source, the green light source, and the blue light source may be realized by a light emitting module using a semiconductor light emitting element such as a semiconductor laser, a solid light emitting element such as organic EL (Electro Luminescence) or inorganic EL.

[0028] The WEB server 30 determines the content of the lighting effect in the target area 60 based on the result of the image processing performed by the WEB server 30 or the image processing system 40. The WEB server 30 is realized by a server device (cloud server) located at a location away from the target area 60, for example. Specifically, the WEB server 30 includes a communication unit 31, an information processing unit 32, and a storage unit 33.

[0029] The communication unit 31 is a communication module (communication circuit) for the WEB server 30 to communicate with the production system 20, the image processing system 40, the detection system 50, etc. via a wide area communication network such as the Internet. The communication performed by the communication unit 31 is, for example, wired communication, but may also be wireless communication. The communication standard used for communication is not particularly limited either.

[0030] The information processing unit 32 performs information processing for determining the content of the lighting-up effect in the target area 60. The information processing unit 32 is realized by, for example, a microcomputer, but may also be realized by a processor. The information processing unit 32 includes an acquisition unit 34 and an output unit 35. The functions of the acquisition unit 34 and the output unit 35 are realized, for example, by a microcomputer or a processor constituting the information processing unit 32 executing a computer program stored in the storage unit 33.

[0031] The storage unit 33 is a storage device that stores information necessary for the above information processing and computer programs executed by the information processing unit 32. The storage unit 33 is realized by, for example, an HDD (Hard Disk Drive), but may also be realized by a semiconductor memory or the like.

[0032] The image processing system 40 performs image processing on the images captured by the image sensor 51 of the detection system 50. The image processing system 40 is realized by, for example, one or more server devices.

[0033] The detection system 50 performs detection processing (sensing) in the target area 60 and provides the detection results (also described as detection information) to the WEB server 30 or the image processing system 40. The detection system 50 includes an image sensor 51.

[0034] The image sensor 51 is installed in the target area 60, captures images in the target area 60, and provides the image information of the captured images to the WEB server 30 or the image processing system 40. The image information is an example of detection information. In other words, the image sensor 51 is a camera. Note that the detection system 50 may include a plurality of image sensors 51 or may include a plurality of types of sensors.

[0035] [Operation Example 1] The cooperation performance system 10 can determine the performance content based on the image information transmitted by the detection system 50, and cause the performance system 20 to execute the determined performance content. Hereinafter, an operation example 1 of such a cooperation performance system 10 will be described. FIG. 4 is a sequence diagram of the operation example 1 of the cooperation performance system 10.

[0036] The detection system 50 transmits the image information of the image captured by the image sensor 51 and including a predetermined area 61 as the imaging target to the WEB server 30 (S11).

[0037] The communication unit 31 of the WEB server 30 receives the image information. The acquisition unit 34 performs image processing on the received image information to detect that there is a person (a person has entered) within a predetermined area 61 of the target area 60 (S12).

[0038] In addition, the acquisition unit 34 performs image processing on the received image information to acquire first information regarding the clothing of the person detected in step S12 (first information indicating the color of the person's clothing) (S13). The acquisition unit 34 determines, for example, to which of n predetermined colors each pixel value of the pixels included in the area where the person appears in the image corresponds. The acquisition unit 34 can acquire the first information indicating the determined clothing color by determining that the color with the largest number of pixels among the n colors is the color of the person's clothing. Note that the color of the clothing may be determined by other methods such as a method using a machine learning model capable of identifying the color of the clothing, and the method for determining the color of the clothing is not particularly limited.

[0039] Next, based on the first information obtained in step S13, the output unit 35 selects one of the initial contents for the n types of lighting-up effects (S14), and uses the communication unit 31 to output (transmit) the effect information including the identification information of the selected initial content to the effect system 20 (S15). The effect information is an example of information for controlling the lighting device 28 (device) to the first state. The effect information has, for example, a format defined by an API (Application Programming Interface) for linking the WEB server 30 and the effect system 20.

[0040] The first communication unit 22 of the effect server 21 receives the effect information. The information processing unit 23 executes an effect according to the identification information of the initial content included in the received effect information based on the received effect information (S16). For example, in the storage unit 24, information (such as table information) indicating the correspondence between the identification information of the content and the effect data (actual data of the content) is stored, and the information processing unit 23 determines the effect data by referring to the information, and uses the second communication unit 25 to control a plurality of lighting devices 28 based on the determined effect data. Instruct the controller 26. That is, the second communication unit 25 transmits information for controlling the lighting device 28 to the lighting device 28 via the controller 26 and the signal converter 27 based on the effect information received by the first communication unit 22.

[0041] Thereby, a lighting-up effect (temporal change of at least one of the emission color and brightness of a plurality of lighting devices 28) corresponding to the color of the clothing of a person located in the predetermined area 61 is realized.

[0042] Here, when a lighting-up effect is being performed based on the initial content determined by the color of the clothing, if a person located in the predetermined area 61 makes a predetermined gesture, the content is changed. As shown in FIG. 3, the predetermined gesture is, for example, a gesture of extending the left arm (or right arm) horizontally. Hereinafter, the operation when the content is changed by the gesture will be described.

[0043] While the lighting-up effect based on the initial content is being performed, the detection system 50 transmits the image information of the image captured by the image sensor 51 to the WEB server 30 (S17).

[0044] The communication unit 31 of the WEB server 30 receives the image information. The acquisition unit 34 performs image processing on the received image information to determine whether the person detected in step S12 has made a predetermined gesture (S18). The acquisition unit 34 can determine, for example, by extracting the area in the image where the person appears and performing pattern matching on the area, whether a predetermined gesture has been made. Note that the determination of whether a predetermined gesture has been made may be determined by other methods such as using a machine learning model and is not particularly limited.

[0045] When the acquisition unit 34 determines that a predetermined gesture has been made, it acquires second information regarding the person's gesture (second information indicating whether the left arm or the right arm has been extended) (S19). Note that if it is determined in step S18 that no predetermined gesture has been made, the processing after step S19 is not performed.

[0046] Next, the output unit 35 selects content based on the second information acquired in step S19 (S20). FIG. 5 is a diagram showing an example of a method for selecting content.

[0047] The storage unit 33 stores content selection information in which a selection order (corresponding to the arrangement of the contents in the circumferential direction in FIG. 5) is determined for the identification information of a plurality of contents (eight contents in the example of FIG. 5) including initial content. For example, when the second information indicates that a gesture of extending the left arm has been performed, the content located adjacent in the counterclockwise direction to the currently reproduced content is selected. Also, when the second information indicates that a gesture of extending the right arm has been performed, the content located adjacent in the clockwise direction to the currently reproduced content is selected. Which content is selected is looped, and when a person located in the predetermined area 61 continuously performs a gesture of extending the left arm (or right arm) a predetermined number of times (eight times in the example of FIG. 5), the initial content is reproduced again.

[0048] Next, the output unit 35 uses the communication unit 31 to output (transmit) production information including the identification information of the selected content to the production system 20 (S21). The production information here is an example of information for controlling the lighting device 28 to the second state based on the second information acquired in the state where the lighting device 28 is controlled to the first state.

[0049] The first communication unit 22 of the production server 21 receives the production information. The information processing unit 23 executes a production corresponding to the identification information of the content included in the received production information based on the received production information (S22). The process of step S22 is the same as the process of step S16. Thereby, a change in the lighting-up production (temporal change of at least one of the emission color and brightness of the plurality of lighting devices 28) according to the gesture of a person located in the predetermined area 61 is realized.

[0050] At least one of the color of the light output by the lighting device 28, the brightness of the light output by the lighting device 28, and the blinking pattern (lighting pattern) of the light output by the lighting device 28 is different between the initial content (the first state of the lighting device 28) and the changed content (the second state of the lighting device 28). Note that when there is no person in the predetermined area 61, the lighting-up production stops.

[0051] As described above, the collaborative production system 10 acquires first information regarding a person's clothing located within a predetermined area 61 and second information regarding the person's gesture, and outputs information for controlling the lighting device 28 to a first state based on the acquired first information. In a state where the lighting device 28 is controlled to the first state, information for controlling the lighting device 28 to a second state is output based on the second information acquired.

[0052] Such a collaborative production system 10 can control the lighting device 28 (perform a lighting-up production) based on the first information regarding the person's clothing, and can change the control content of the lighting device 28 (change the lighting-up production) based on the second information regarding the person's gesture.

[0053] [Operation Example 2] In Operation Example 1, the image processing on the image captured by the detection system 50 (image sensor 51) was performed by the WEB server 30 (acquisition unit 34), but it may be performed by the image processing system 40. Hereinafter, Operation Example 2 of such a collaborative production system 10 will be described. FIG. 6 is a sequence diagram of Operation Example 2 of the collaborative production system 10.

[0054] The detection system 50 transmits the image information of an image including a predetermined area 61 captured by the image sensor 51 to the image processing system 40 (S31).

[0055] The image processing system 40 receives the image information, performs image processing on the received image information, and detects that there is a person (a person has entered) within a predetermined area 61 of the target area 60 (S32). Further, the image processing system 40 performs image processing on the received image information to identify the color of the clothing of the person detected in step S31, and transmits first information indicating the identified color of the clothing to the WEB server 30 (S33). The process of identifying the color of the clothing in step S33 is the same as that in step S13.

[0056] The communication unit 31 of the WEB server 30 receives the first information, and the acquisition unit 34 acquires the received first information (S34). The first information in this case is information indicating the result of image processing on an image in which a person located in a predetermined area 61 is reflected (the result of image processing by the image processing system 40). The output unit 35 selects initial content for a lighting-up effect based on the first information acquired in step S34 (S35), and uses the communication unit 31 to output (transmit) effect information including the identification information of the selected initial content to the effect system 20 (S36). The process of step S36 is the same as the process of step S15.

[0057] The first communication unit 22 of the effect server 21 receives the effect information. The information processing unit 23 executes an effect according to the identification information of the initial content included in the received effect information based on the received effect information (S37). The process of step S37 is the same as the process of step S16. As a result, a lighting-up effect according to the color of the clothing of a person located in the predetermined area 61 is realized.

[0058] While the lighting-up effect based on the initial content is being performed, the detection system 50 transmits the image information of the image captured by the image sensor 51 to the image processing system 40 (S38).

[0059] The image processing system 40 receives the image information, performs image processing on the received image information, and determines whether the person detected in step S32 has made a predetermined gesture (S39). The process of step S39 is the same as the process of step S18.

[0060] When the image processing system 40 determines that a predetermined gesture has been made, it transmits second information regarding the person's gesture (second information indicating whether the left arm or the right arm is extended) to the WEB server 30 (S40). Note that if it is determined in step S39 that no predetermined gesture has been made, the processes after step S40 are not performed.

[0061] The communication unit 31 of the WEB server 30 receives the second information, and the acquisition unit 34 acquires the received second information (S41). The second information in this case is information indicating the result of image processing on an image in which a person located in a predetermined area 61 is reflected (the result of image processing by the image processing system 40). The output unit 35 selects content based on the second information acquired in step S41 (S42). The output unit 35 uses the communication unit 31 to output (transmit) production information including the identification information of the selected content to the production system 20 (S43). The processes of steps S42 and S43 are the same as the processes of steps S20 and S21.

[0062] The first communication unit 22 of the production server 21 receives the production information. The information processing unit 23 executes a production according to the identification information of the content included in the received production information based on the received production information (S44). The process of step S44 is the same as the process of step S22. As a result, a change in the lighting-up production according to the gesture of the person located in the predetermined area 61 is realized.

[0063] As described above, the image processing on the image captured by the detection system 50 (image sensor 51) may be performed by the image processing system 40. That is, the first information and the second information acquired by the acquisition unit 34 may include information indicating the result of image processing on an image in which a person is reflected and executed by a device or system other than the WEB server 30.

[0064] Also in this case, the cooperative production system 10 can control the lighting device 28 (perform a lighting-up production) based on the first information regarding the clothing of the person and change the control content of the lighting device 28 (change the lighting-up production) based on the second information regarding the gesture of the person.

[0065] [Operation Example 3] In Operation Example 1 and Operation Example 2, the selection of content was performed by the WEB server 30 (output unit 35), but it may also be performed by the production system 20. Hereinafter, Operation Example 3 of such a cooperative production system 10 will be described. FIG. 7 is a sequence diagram of Operation Example 3 of the cooperative production system 10.

[0066] The detection system 50 transmits the image information of an image taken by the image sensor 51 and including a predetermined area 61 as a shooting target to the WEB server 30 (S51).

[0067] The communication unit 31 of the WEB server 30 receives the image information. The information processing unit 32 performs image processing on the received image information to detect that there is a person (a person has entered) within a predetermined area 61 of the target area 60 (S52). Further, the acquisition unit 34 performs image processing on the received image information to identify the color of the clothing of the person detected in step S51, and transmits first information indicating the identified clothing color to the production system 20 (S53). The process of identifying the clothing color in step S53 is the same as that in step S13.

[0068] The first communication unit 22 of the production server 21 receives the first information, and the acquisition unit 23a acquires the received first information (S54). The first information in this case is information indicating the result of image processing on the image in which the person located in the predetermined area 61 is reflected (the result of image processing by the WEB server 30). The output unit 23b selects initial content (production data) for the lighting-up production based on the first information acquired in step S44 (S55).

[0069] In addition, the output unit 23b instructs the controller 26 to control a plurality of lighting devices 28 corresponding to the selected production data using the second communication unit 25. That is, the output unit 23b executes a production according to the initial content (S56). In other words, the output unit 23b outputs information for controlling the lighting device 28 to the first state based on the first information acquired by the acquisition unit 23a. Thereby, a lighting-up production corresponding to the color of the clothing of the person located in the predetermined area 61 is realized.

[0070] While the lighting-up effect based on the initial content is being performed, the detection system 50 transmits the image information of the image captured by the image sensor 51 to the WEB server 30 (S57).

[0071] The communication unit 31 of the WEB server 30 receives the image information. The information processing unit 32 performs image processing on the received image information to determine whether the person detected in step S52 has made a predetermined gesture (S58). The process of step S58 is the same as the process of step S18.

[0072] When the information processing unit 32 determines that a predetermined gesture has been made, it transmits second information regarding the person's gesture (second information indicating whether the left arm or the right arm is extended) to the effect system 20 (S59). Note that if it is determined in step S58 that no predetermined gesture has been made, the processes after step S59 are not performed.

[0073] The first communication unit 22 of the effect server 21 receives the second information, and the acquisition unit 23a acquires the received second information (S60). The second information in this case is information indicating the result of image processing on the image in which the person located in the predetermined area 61 is reflected (the result of image processing by the WEB server 30). The output unit 23b selects content (effect data) based on the second information acquired in step S60 (S61). In operation example 3, content selection information that defines the content selection order as shown in FIG. 5 is stored in the storage unit 24, and the output unit 23b can select content by referring to such content selection information.

[0074] Further, the output unit 23b instructs the controller 26 to control a plurality of lighting devices 28 corresponding to the selected effect data using the second communication unit 25. That is, the output unit 23b executes an effect according to the initial content (S62). In other words, the output unit 23b outputs information for controlling the lighting device 28 to the second state based on the second information acquired in the state where the lighting device 28 is controlled to the first state. As a result, a change in the lighting-up effect according to the gesture of a person located in the predetermined area 61 is realized.

[0075] As described above, the selection of the content may be performed by the effect system 20. Also in this case, the cooperation effect system 10 can control the lighting device 28 (perform a lighting-up effect) based on the first information regarding a person's clothing, and can change the control content of the lighting device 28 (change the lighting-up effect) based on the second information regarding the person's gesture.

[0076] Note that in operation example 3, instead of the WEB server 30, an image processing system 40 may perform image processing. That is, in operation example 3, the WEB server 30 may be replaced with the image processing system 40.

[0077] [Modification Example] In the above embodiment, the initial effect (initial content) is determined according to the color of a person's clothing, but it may be changed according to the information regarding the person's clothing. For example, the initial effect may be changed according to the presence or absence of a hat, the type of the hat, the type of the upper body clothing (such as short sleeves or long sleeves), or the type of the lower body clothing (such as trousers or a skirt).

[0078] In the above embodiment, the gesture for changing the effect is described as an action of stretching the left arm or the right arm horizontally, but other actions may also be possible. For example, the gesture may be an action of a person squatting or an action of a person jumping.

[0079] In addition, in the above-described embodiment, the effect was a lighting-up effect realized by controlling the lighting device 28. However, when the lighting device 28 has a video projection function, the effect includes projection mapping onto a building or the like. That is, the effect may be an effect using video.

[0080] In addition, the effect may be an effect using sound (music) realized by controlling a music playback device. In this case, the initial content (the first state of the music playback device) and the changed content (the second state of the music playback device) are different in the music to be played. The effect may be an effect using water realized by controlling a water discharge device or the like. Thus, the cooperative effect system 10 may include at least one type of device among the lighting device 28, the music playback device, and the water discharge device.

[0081] In addition, the effect may be realized by combining two or more of light, video, sound, and water. For example, in the above-described operation examples 1 to 3, the effect may be realized by combining the light emitted from the lighting device 28 and the music played by the music playback device.

[0082] In the operation examples 1 to 3 of the above-described embodiment, the identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed were based on the images captured by the same image sensor 51, but may be based on the images captured by different image sensors 51. In the operation example 2 of the above-described embodiment, the identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed were performed by the same image processing system 40, but may be performed by different image processing systems 40.

[0083] In addition, the identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed may be performed by different image processing systems 40 based on the images captured by the same image sensor 51. The identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed may be performed by the same image processing system 40 based on the images captured by different image sensors 51.

[0084] Alternatively, one of the identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed may be carried out by the WEB server 30 by combining Operation Example 1 and Operation Example 2, and the other of the identification of the color of the clothing and the determination of whether or not a predetermined gesture has been performed may be carried out by the image processing system 40.

[0085] [Effects, etc.] Hereinafter, the invention obtained from the disclosure of this specification will be exemplified, and the effects, etc. obtained from the exemplified invention will be described.

[0086] Invention 1 is a control system including: an acquisition unit that acquires first information regarding a person's clothing located within a predetermined area 61 and second information regarding the person's gesture; and an output unit that outputs information for controlling a device to a first state based on the acquired first information, and outputs information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state. In Operation Example 1 and Operation Example 2, the acquisition unit, the output unit, and the control system are the acquisition unit 34, the output unit 35, and the WEB server 30, respectively. In Operation Example 3, the acquisition unit, the output unit, and the control system are the acquisition unit 23a, the output unit 23b, and the production system 20 (production server 21), respectively.

[0087] Such a control system can control a device based on a person's appearance. More specifically, the control system can control a device for production, etc. based on a person's appearance.

[0088] Invention 2 is the control system of Invention 1, wherein the first information includes information indicating the color of the clothing.

[0089] Such a control system can control a device to a first state based on the color of a person's clothing.

[0090] Invention 3 is the control system of Invention 1 or 2, wherein the first information includes information indicating the result of image processing on an image in which a person is reflected.

[0091] Such a control system can control the device to a first state based on first information regarding a person's clothing obtained as a result of image processing.

[0092] Invention 4 is a control system according to any one of Inventions 1 to 3, wherein the second information includes information indicating the result of image processing on an image in which a person appears.

[0093] Such a control system can control the device to a second state based on second information regarding a person's gesture obtained as a result of image processing.

[0094] Invention 5 is a control system according to any one of Inventions 1 to 4, wherein the device includes a lighting device 28, and the first state and the second state are different in the color of the light output by the lighting device 28.

[0095] Such a control system can change the color of the light output by the lighting device 28 based on the second information regarding a person's gesture.

[0096] Invention 6 is a control system according to any one of Inventions 1 to 5, wherein the device includes a lighting device 28, and the first state and the second state are different in the brightness of the light output by the lighting device 28.

[0097] Such a control system can change the brightness of the light output by the lighting device 28 based on the second information regarding a person's gesture.

[0098] Invention 7 is a control system according to any one of Inventions 1 to 6, wherein the device includes a lighting device 28, and the first state and the second state are different in the blinking pattern of the light output by the lighting device 28.

[0099] Such a control system can change the blinking pattern of the light output by the lighting device 28 based on the second information regarding a person's gesture.

[0100] Invention 8 is such that the device includes a music playback device, and the first state and the second state are control systems according to any one of Inventions 1 to 7, where the music pieces are different.

[0101] Such a control system can change the music piece played by the music playback device based on second information regarding a person's gesture.

[0102] Invention 9 is a device control system including a first communication unit 22 that communicates with a control system according to any one of Inventions 1 to 8, and a second communication unit 25 that communicates with a device. The second communication unit 25 transmits information for controlling the device to the device based on the information received by the first communication unit 22. Such a device control system is the production system 20 (production server 21) in Operation Example 1 and Operation Example 2.

[0103] Such a device control system can control the device in cooperation with the control system.

[0104] Invention 10 is a control method executed by a computer system, including an acquisition step of acquiring first information regarding a person's clothing located within a predetermined area 61 and second information regarding a person's gesture, and an output step of outputting information for controlling the device to a first state based on the acquired first information, and outputting information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state. The computer system is the WEB server 30 in Operation Example 1 and 2, and is the production system 20 (production server 21) in Operation Example 3. The acquisition step is steps S13 and S18 in Operation Example 1, steps S34 and S41 in Operation Example 2, and steps S54 and S60 in Operation Example 3. The output step is steps S15 and S21 in Operation Example 1, steps S36 and S43 in Operation Example 2, and steps S56 and S62 in Operation Example 3.

[0105] Such a control method can control a device based on a person's appearance. More specifically, the control method can control a device for production based on a person's appearance.

[0106] Invention 11 is a program for causing a computer system to execute the control method of Invention 10.

[0107] According to such a program, the computer system can control a device based on a person's appearance. More specifically, the computer system can control a device for production based on a person's appearance.

[0108] Invention 12 is a device control method executed by a computer system, including a first communication step of communicating with any one of the control systems of Inventions 1 to 8, and a second communication step of transmitting information for controlling the device to the device based on the information received in the first communication step. The computer system is the WEB server 30 in Operation Examples 1 and 2. The first communication step is steps S15 and S21 in Operation Example 1, and steps S36 and S43 in Operation Example 2. The second communication step is steps S16 and S22 in Operation Example 1, and steps S37 and S44 in Operation Example 2.

[0109] According to such a device control method, the computer system can control a device in cooperation with the control system.

[0110] Invention 13 is a program for causing a computer system to execute the device control method of Invention 12.

[0111] According to such a program, the computer system can control a device in cooperation with the control system.

[0112] (Other Embodiments) Although the embodiments have been described above, the present invention is not limited to the above embodiments.

[0113] For example, in the above embodiment, the collaborative production system is used for outdoor lighting production, but it may also be used for indoor lighting production such as in stores, offices, or concert halls.

[0114] Also, in the above embodiment, a system such as the collaborative production system is realized by a plurality of devices, but it may also be realized as a single device. Thus, the system in this specification may be configured by a single device or by a plurality of devices. When the system is realized by a plurality of devices, the components included in the system may be distributed among the plurality of devices in any manner.

[0115] Also, in the above embodiment, the processing executed by a specific processing unit may be executed by another processing unit. Also, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel.

[0116] Also, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0117] Also, each component may be realized by hardware. Each component may be a circuit (or an integrated circuit). These circuits may constitute one circuit as a whole or may be separate circuits respectively. Also, these circuits may be general-purpose circuits or dedicated circuits respectively.

[0118] Furthermore, the general or specific aspects of the present invention may be implemented in a system, apparatus, method, integrated circuit, computer program, or a recording medium such as a computer-readable CD-ROM. Also, it may be implemented by any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

[0119] For example, the present invention may be implemented as any system or apparatus such as the cooperation production system, production system, production server, or WEB server of the above-described embodiment. Also, the present invention may be implemented as a control method or device control method executed by a computer system. The present invention may be implemented as a program for causing a computer to execute a control method or device control method, or may be implemented as a computer-readable non-transitory recording medium on which such a program is recorded.

[0120] In addition, forms obtained by applying various modifications that those skilled in the art can conceive to each embodiment, or forms realized by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present invention are also included in the present invention.

Description of Reference Numerals

[0121] 10 Cooperation production system 20 Production system 21 Production server 22 First communication unit 23, 32 Information processing unit 23a, 34 Acquisition unit 23b, 35 Output unit 24, 33 Storage unit 25 Second communication unit 26 Controller 27 Signal converter 28 Lighting equipment 30 WEB server 31 Communication unit 40 Image processing system 50 Detection system 51 Image sensor 60 Target area 61 Predetermined area

Claims

1. An acquisition unit that acquires first information regarding the clothing worn by a person located within a predetermined area and second information regarding the gesture of the person; An output unit that outputs information for controlling the device to a first state based on the acquired first information, and outputs information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state. A control system.

2. The first information includes information indicating the color of the clothing. The control system according to claim 1.

3. The first information includes information indicating the result of image processing on an image in which the person is reflected. The control system according to claim 1.

4. The second information includes information indicating the result of image processing on an image in which the person is reflected. The control system according to claim 1.

5. The device includes a lighting device, The first state and the second state are different in the color of the light output by the lighting device. The control system according to claim 1.

6. The device includes a lighting device, The first state and the second state are different in the brightness of the light output by the lighting device. The control system according to claim 1.

7. The device includes a lighting device, The first state and the second state are different in the blinking pattern of the light output by the lighting device. The control system according to claim 1.

8. The device includes a music playback device, The first state and the second state are different in the music. The control system according to claim 1.

9. A first communication unit that communicates with the control system according to any one of claims 1 to 8, and a second communication unit that communicates with the device, wherein the second communication unit transmits information for controlling the device to the device based on the information received by the first communication unit. Device control system.

10. A control method executed by a computer system, comprising: an acquisition step of acquiring first information regarding the clothing of a person located within a predetermined area and second information regarding the gesture of the person; and an output step of outputting information for controlling the device to a first state based on the acquired first information, and outputting information for controlling the device to a second state based on the second information acquired in a state where the device is controlled to the first state. Control method.

11. A program for causing the computer system to execute the control method according to claim 10.

12. A device control method executed by a computer system, comprising: a first communication step of communicating with the control system according to any one of claims 1 to 8; and a second communication step of transmitting information for controlling the device to the device based on the information received in the first communication step. Device control method.

13. A program for causing the computer system to execute the device control method according to claim 12.

Images