CONTROL DEVICE, CONTROL SYSTEM, CONTROL METHOD AND CONTROL PROGRAM

Abstract

A control device controls an output device (300) which outputs a stimulus.The control device (100) includes an acquisition unit (120) that acquires a video obtained by an imaging device (200) by capturing images of a plurality of people located at a location where movement in a plurality of directions is possible, and a control unit (130) that counts moving people as a number of people who have moved in a first direction out of the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the count of moving people, and, if a situation where the ratio is less than a predetermined threshold value continues for a predetermined set time, executes control to change the stimulus currently output by the output device (300) to another stimulus.

Description

FIELD OF TECHNOLOGY

[0001] The present disclosure relates to a control device, a control system, a control method and a control program. TECHNICAL BACKGROUND

[0002] Displays or signs are installed in train stations, shopping malls, and other areas. For example, information for guiding people is displayed on the sign. A technology for displaying the information on the sign is described, for example, in Patent Reference 1.

[0003] DE102006044298B3 discloses a method for monitoring crowds of people with the following repetitive steps: taking an image of the crowd of people, recording the position of the people on the image and then comparing these recorded positions with positions on a previous image.

[0004] DE102009000173A1 discloses a device for determining how many people enter a building and for counting people entering and exiting. For this purpose, a camera monitors a surveillance area and uses it to identify and count objects that pass through a predetermined distance.

[0005] AT412177B discloses a method for monitoring a road section and its surroundings. For this purpose, images captured by a camera are evaluated and compared with predetermined values ​​to obtain information regarding the type of objects, their distribution, and / or their movement. REFERENCES TO THE PRIOR ART PATENT REFERENCE

[0006] Patent Reference 1: Japanese Patent Application Publication No. 2014-215662 SUMMARY OF THE INVENTION PROBLEM TO BE SOLVED BY THE INVENTION

[0007] An individual receives a stimulus. The stimulus can be, for example, a visual stimulus, an auditory stimulus, or something similar. Once individuals become habituated to a stimulus, they no longer respond to it.

[0008] An object of the present disclosure is to cause individuals to respond to a stimulus. MEANS TO SOLVE THE PROBLEM

[0009] A control device according to one aspect of the present disclosure is provided. The control device controls an output device that outputs a stimulus.The control device includes an acquisition unit that acquires a video obtained by an image capture device by capturing images of a plurality of people who were located at a location where movement in a plurality of directions is possible, and a control unit that acquires a moving person count as a number of people who have moved in a first direction among the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the moving person count, and, when a situation in which the ratio is smaller than a predetermined threshold continues for a predetermined set time, executes control for changing the stimulus currently outputted from the output device to another stimulus. EFFECT OF THE INVENTION

[0010] According to the present disclosure, it is possible to cause individuals to respond to a stimulus. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic diagram of a control system in a first embodiment. Fig. 2 is a diagram showing an installation example of a camera and an output device in the first embodiment. Fig. 3 is a diagram showing the hardware included in a control device in the first embodiment. Fig. 4 is a block diagram showing the functions of the control device in the first embodiment. Fig. 5 is a flowchart showing an example of a process executed by the controller in the first embodiment. Fig. 6 is a diagram showing an example of a management table in a first modification of the first embodiment. Fig. 7 is a flowchart showing an example of a process executed by a controller in the first modification of the first embodiment. Fig. 8 is a diagram showing an example of a threshold table in a second modification of the first embodiment. Fig. 9 is a flowchart showing an example of a process executed by a controller in the second modification of the first embodiment. Fig. 10 is a block diagram showing functions of a control device in a second embodiment. Fig. 11 is a flowchart showing an example of a process executed by the control device in the second embodiment. Fig. 12 is a flowchart showing an example of a process executed by a controller in a first modification of the second embodiment. Fig. 13 is a diagram showing an example of a threshold table in a second modification of the second embodiment. Fig. 14 is a flowchart showing an example of a process executed by a controller in the second modification of the second embodiment. Fig. 15 is a block diagram showing functions of a control device in a third embodiment. Fig. 16 is a flowchart showing an example of a process executed by the control device in the third embodiment. Fig. 17 is a diagram showing a control system in a fourth embodiment. Fig. 18 is a sequence diagram showing an example of a process executed in the control system of the fourth embodiment. Fig. 19 is a diagram showing a control system in a fifth embodiment. Fig. 20 is a sequence diagram showing an example of a process executed in the control system of the fifth embodiment. MODE FOR CARRYING OUT THE INVENTION

[0011] Embodiments will be described below with reference to the drawings. The following embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. First embodiment

[0012] Fig. Figure 1 is a schematic representation of a control system in a first embodiment. The control system includes a control device 100, a camera 200, and an output device 300. The control device 100, the camera 200, and the output device 300 communicate via a network.

[0013] For example, the camera 200 and the output device 300 are installed in a train station. The control device 100 is installed at a different location than the camera 200 and the output device 300, for example. A case where the camera 200 and the output device 300 are installed at a different location than the control device 100 is illustrated below.

[0014] Fig. 2 is a diagram showing an installation example of the camera and the output device in the first embodiment. Fig. 2 shows the camera 200 and the output device 300. Fig. 2 shows a multitude of people in a location where movement in a variety of directions is possible. To the right and left of the output device 300 in Fig. Two passageways exist. In short, there is a T-junction. A multitude of people can move toward the passageways. Incidentally, the location where movement in multiple directions is possible can also be an intersection or something similar.

[0015] The control device 100 is a device that executes a control method. The control device 100 controls the output device 300.

[0016] The camera 200 is also referred to as an image capture device. The camera 200 can also be an infrared camera.

[0017] The output device 300 is a device that outputs a stimulus. The output device 300 can be, for example, a display device, a loudspeaker, an air conditioner, an odor generator, a projector, a deodorizer, a lighting device, or the like. The display device can also be, for example, a digital signage system.

[0018] The output device 300 outputs, for example, information for guiding people. In the case where the output device 300 is a projector, the output device 300 performs floor area illumination. The output device 300 is capable of guiding people through the floor area illumination, for example.

[0019] The following description assumes that the output device 300 is a digital guidance system. The following mainly describes cases in which a stimulus is changed through visual perception by changing the content output to the output device 300.

[0020] The hardware contained in the control device 100 is described below.

[0021] Fig. Figure 3 is a diagram showing the hardware included in the control device in the first embodiment. The control device 100 includes a processor 101, a volatile memory device 102, and a non-volatile memory device 103.

[0022] The processor 101 controls the entire control device 100. The processor 101 is, for example, a central processing unit (CPU), a field-programmable gate array (FPGA), or the like. The processor 101 may also be a multiprocessor. The control device 100 may further include processing circuitry. The processing circuitry may be either a single circuit or a combined circuitry.

[0023] The volatile storage device 102 is the main memory of the control device 100. The volatile storage device 102 is, for example, a random access memory (RAM). The non-volatile storage device 103 is an auxiliary storage device of the control device 100. The non-volatile storage device 103 is, for example, a hard disk drive (HDD) or a solid-state drive (SSD).

[0024] The functions contained in the control device 100 are described below.

[0025] Fig. Figure 4 is a block diagram showing the functions of the control device in the first embodiment. The control device 100 includes a storage unit 110, an acquisition unit 120, and a control unit 130.

[0026] The storage unit 110 may be implemented as a memory area reserved in the volatile memory device 102 or in the non-volatile memory device 103.

[0027] The acquisition unit 120 and the control unit 130 may be implemented partially or entirely by the processing circuit. Furthermore, the acquisition unit 120 and the control unit 130 may be implemented partially or entirely as modules of a program executed by the processor 101. The program executed by the processor 101 is also referred to, for example, as a control program. The control program is recorded, for example, on a recording medium.

[0028] The functions of the procurement unit 120 and the control unit 130 are described in detail below.

[0029] In the following, a process executed by the control device 100 is described using a flowchart.

[0030] Fig. Fig. 5 is a flowchart showing an example of the process executed by the control device in the first embodiment. At the time of starting the process of Fig. 5, the output device outputs 300 pieces of content. The content can be letters, an image, or a video. The image can be a symbol such as an arrow, for example.

[0031] (Step S11) The acquisition unit 120 acquires a video obtained by the camera 200 capturing images of a plurality of people. For example, the acquisition unit 120 acquires the video of the camera 200. The acquisition unit 120 may also acquire the video from a device other than the camera 200. The video is a video obtained by the camera 200 performing image capturing for a predetermined period of time. The time is, for example, one minute.

[0032] (Step S12) The control unit 130 acquires a moving person count as the number of people who have moved in a first direction from the plurality of directions based on the video. The control unit 130 identifies the people using, for example, image recognition technology. The control unit 130 acquires the moving person count by identifying the people. Incidentally, the first direction is, for example, a direction to the left of the output device 300 in Fig. 2.

[0033] (Step S13) The control unit 130 calculates a ratio of the people who moved in the first direction using the moving person count. For example, the control unit 130 calculates the ratio using the moving person count and the actual number of people included in the video. Accordingly, the ratio of the people who moved in the first direction is calculated from the actual number of people.

[0034] (Step S14) The control unit 130 judges whether the ratio is less than a predetermined threshold. The threshold can be defined as follows. For example, the threshold is "8" in "8:2." Incidentally, "8:2" means that 80% of the people are guided to the left and 20% of the people are guided to the right. For example, if the threshold is "8," the control unit 130 judges whether the ratio is less than "8."

[0035] If the ratio is below the threshold, the process proceeds to step S15. If the ratio is greater than or equal to the threshold, the process ends.

[0036] (Step S15) The control unit 130 judges whether or not a predetermined set time has elapsed since the first judgment that the ratio is smaller than the threshold. The set time is, for example, 5 minutes.

[0037] If the set time has elapsed, the control unit 130 judges that the situation where the ratio is below the threshold continues for the set time. Then, the process proceeds to step S16. If the set time has not elapsed, the process proceeds to step S11.

[0038] (Step S16) The control unit 130 executes control to change the content currently output from the output device 300 to another content. For example, the control unit 130 transmits the different contents and an output command for the different contents to the output device 300. Accordingly, the content output to the output device 300 is changed.

[0039] As described above, when the situation where the ratio is smaller than the predetermined threshold continues for the set time, the control unit 130 executes the control to change the stimulus currently outputted from the output device 300 to another stimulus.

[0040] Here, a process executed by the control unit 130 when the output device 300 is a speaker or the like will be described.

[0041] If the output device 300 is a speaker, the control unit 130 performs the following process. If it is judged that the situation where the ratio is below the threshold continues for the set time, the control unit 130 executes control to change the sound currently output from the speaker to another sound. Accordingly, the sound output from the speaker is changed.

[0042] If the output device 300 is an air conditioner, the control unit 130 performs the following process. If it is judged that the situation where the ratio is below the threshold continues for the set time, the control unit 130 executes control to change the direction of air currently output by the air conditioner to another direction. Accordingly, the direction of the air is changed. It is also possible for the control unit 130 to perform control to change the wind power of the air conditioner.

[0043] If the output device 300 is an odor generator, the control unit 130 performs the following process. If it is judged that the situation where the ratio is below the threshold continues for the set time, the control unit 130 performs control to change an odor currently output by the odor generator to another odor. Accordingly, the odor output by the odor generator is changed. In cases where a deodorizer is connected to the control device 100, the control unit 130 may activate the deodorizer instead of generating another odor.

[0044] If the output device 300 is a projector, the control unit 130 performs the following process. If it is judged that the situation where the ratio is below the threshold continues for the set time, the control unit 130 executes control to change the information currently output by the projector to other information. Accordingly, the information output by the projector is changed.

[0045] If the output device 300 is a lighting device, the control unit 130 performs the following process. If it is judged that the situation where the ratio is below the threshold continues for the set time, the control unit 130 executes control to change the illuminance, illuminance color, or illuminance angle of light currently output by the lighting device. The illuminance, illuminance color, or illuminance angle is changed accordingly.

[0046] In addition, the control unit 130 can change the stimulus output by the output device 300 to a stimulus that guides people in the first direction. For example, if the output device 300 is a display device, the control unit 130 executes control to change the content currently output by the display device to content that guides people in the first direction. For example, if the output device 300 is a projector, the control unit 130 executes control to change the information currently output by the projector to information that guides people in the first direction. For example, if the output device 300 is a speaker, the control unit 130 executes control to change the sound currently output by the projector to sound that guides people in the first direction.As described above, the control device 100 is capable of guiding people in the first direction through the control performed by the control unit 130.

[0047] Here, when people become accustomed to a stimulus, they no longer respond to the stimulus. According to the first embodiment, the controller 100 changes the stimulus when it is judged that the situation in which the ratio is below the threshold continues for the set time. For example, the controller 100 executes control to change the content output to the output device 300 when it is judged that the situation in which the ratio is below the threshold continues for the set time. This changes the stimulus through visual perception. By changing the stimulus, people begin to respond to the stimulus. Accordingly, the controller 100 is capable of causing people to respond to a stimulus.

[0048] The above description refers to a case where the moving person count is acquired based on a video. It is also possible for the control device 100 to perform the following process. The acquisition unit 120 acquires position information about one or more individuals from one or more terminal devices (e.g., smartphones). The control unit 130 acquires the moving person count based on the position information related to one or more individuals. First modification of the first embodiment

[0049] In a first modification of the first embodiment, a case will be described in which a stimulus dissimilar to the currently output stimulus is determined based on a management table. An example of the management table will be shown below.

[0050] Fig. 6 is a diagram showing an example of the management table in a first modification in the first embodiment. The management table 111 may be stored in the storage unit 110. The management table 111 is also referred to as management information. The management table 111 includes entries such as content name, day of the week, issue count, time slot, dissimilar content, and threshold.

[0051] The name of the content is entered under the "Content Name" entry. The day of the week on which the content is distributed is entered under the "Day of the week" entry. The number of times the content has been distributed is entered under the "Distribution Count" entry. The time window in which the content is distributed is entered under the "Time Window" entry. The name of the dissimilar content is entered under the "Dissimilar Content" entry. For example, content X is dissimilar to content A. Information about the threshold is entered under the "Threshold" entry.

[0052] As above, the management table 111 indicates a correspondence relationship between content and dissimilar content. That is, the management table 111 indicates information related to content with the same attribute. Incidentally, the similarity between content and content can be represented by a numerical value.

[0053] Fig. Figure 6 shows examples of the content. Information about a stimulus other than content can also be entered in the management table 111. For example, the management table 111 can also specify a correspondence relationship between a tone and a tone dissimilar to the tone.

[0054] The management table 111 is acquired by the acquisition unit 120. For example, the acquisition unit 120 acquires the management table 111 from the storage unit 110. In this case, the management table 111 may be stored on an external device (e.g., a cloud server). In the case where the management table 111 is stored in an external device, the acquisition unit 120 acquires the management table 111 from the external device.

[0055] In addition, a threshold was assigned to each stimulus. For example, the threshold was assigned with content as the stimulus through visual perception. Furthermore, the threshold does not have to be a fixed value. The threshold can be changed by feedback of a result obtained by outputting the content.

[0056] In the following, a process executed by the control device 100 is described using a flowchart.

[0057] Fig. Fig. 7 is a flowchart showing an example of the process executed by the control device in the first modification of the first embodiment. The process of Fig. 7 differs from the process of Fig. 5 by executing steps S14a, S15a and S16a. Therefore, steps S14a, S15a and S16a in Fig. 7 below. In this case, the description of processing other than steps S14a, S15a, and S16a is omitted.

[0058] (Step S14a) The control unit 130 judges whether or not the ratio is below the threshold value corresponding to the currently output content.

[0059] If the ratio is below the threshold, the process proceeds to step S15. If the ratio is greater than or equal to the threshold, the process ends.

[0060] (Step S15a) The control unit 130 identifies the dissimilar stimulus based on the currently output stimulus and the management table 111. Specifically, the control unit 130 identifies content dissimilar to the currently output content based on the currently output content and the management table 111. For example, if the currently output content is content A, the control unit 130 identifies content X. It is also possible for the control unit 130 to perform the following process. The control unit 130 identifies content dissimilar to the currently output content based on the threshold value corresponding to the currently output content and the management table 111. For example, the control unit 130 refers to the management table 111 and identifies the records of the threshold value corresponding to the currently output content.The control unit 130 identifies a data record of the currently output content A from the identified data records. The control unit 130 identifies the content X in the recording of the content A.

[0061] (Step S16a) The control unit 130 executes control to change the currently output stimulus to a dissimilar stimulus. Specifically, the control unit 130 executes control to change the currently output content to the identified dissimilar content. For example, the control unit 130 transmits the dissimilar content and an output command for the dissimilar content to the output device 300. Accordingly, the content output to the output device 300 is changed.

[0062] By changing the content in the process of Fig. 7 is changed to sound, wind, smell, information output from the projector, or lighting, dissimilar sound, wind, smell, information output from the projector, or lighting are output. In short, a dissimilar stimulus is output.

[0063] According to the first modification of the first embodiment, the control device 100 is capable of making people more receptive to a stimulus by changing the stimulus to a dissimilar stimulus. Second modification of the first embodiment

[0064] In a second modification of the first embodiment, a case where the threshold is changed based on a user attribute will be described. When changing the threshold, a threshold table is used. An example of a threshold table is shown below.

[0065] Fig. 8 is a diagram showing an example of the threshold table in the second modification of the first embodiment. The threshold table 112 may be stored in the storage unit 110. The threshold table 112 is also referred to as threshold information. The threshold table 112 includes entries such as user attributes and threshold values.

[0066] Information specifying the user attribute is entered under the User Attribute entry. Information about the threshold is entered under the Threshold entry.

[0067] The threshold table 112 is acquired by the acquisition unit 120. For example, the acquisition unit 120 acquires the threshold table 112 from the storage unit 110. In this case, the threshold table 112 may be stored on an external device. In the case where the threshold table 112 is stored in an external device, the acquisition unit 120 acquires the threshold table 112 from the external device.

[0068] Furthermore, the content and the threshold table 112 can be associated with each other. If the content and the threshold table 112 are associated with each other, the acquisition unit 120 acquires a threshold table 112 corresponding to the currently output content. As described above, each of a plurality of content elements can be associated with a threshold table 112.

[0069] In the following, a process executed by the control device 100 is described using a flowchart.

[0070] Fig. Fig. 9 is a flowchart showing an example of the process executed by the control device in the second modification of the first embodiment. The process of Fig. 9 differs from the process of Fig. 5 by executing steps S13b and S14b. Therefore, steps S13b and S14b are Fig. 9 below. In this case, the description of processing other than steps S13b and S14b is omitted.

[0071] (Step S13b) Based on the video, the control unit 130 identifies a user attribute as an attribute of an individual included in the video. Specifically, the control unit 130 identifies the user attribute using the video and image recognition technology. For example, based on the video, the control unit 130 detects a wheelchair, thus identifying that an individual with a leg disability is present in the video. Furthermore, based on the video, the control unit 130 identifies that the age of an individual included in the video is "60 years old."

[0072] The control unit 130 identifies the threshold corresponding to the user attribute based on the threshold table 112. For example, using the threshold table 112, the control unit 130 identifies the threshold “6” corresponding to “60 years old”.

[0073] The control unit 130 changes the predetermined threshold value to the threshold value corresponding to the user attribute.

[0074] The control unit 130 may identify a user attribute with the highest ratio among a plurality of user attributes based on the plurality of people included in the video. The control unit 130 may then identify the threshold corresponding to the identified user attribute based on the threshold table 112.

[0075] (Step S14a) The control unit 130 judges whether or not the ratio is below the threshold value corresponding to the user attribute.

[0076] If the ratio is below the threshold, the process proceeds to step S15. If the ratio is greater than or equal to the threshold, the process ends.

[0077] According to the second modification of the first embodiment, the controller 100 is capable of making a judgment depending on the attribute of an individual included in the video by making the judgment using the threshold value corresponding to the user attribute. Second embodiment

[0078] A second embodiment is described below. In the second embodiment, the features that differ from those of the first embodiment are primarily described. In the second embodiment, the description of features that are the same as those of the first embodiment is omitted. Fig. 1 to 3 and 6 is referred to in the second embodiment.

[0079] In the first embodiment, the case where the content is changed based on the ratio of people who moved in the first direction was described. In the second embodiment, a case where the content is changed based on a visual recognition rate is described.

[0080] Fig. 10 is a block diagram showing functions of a control device in the second embodiment. The control device 100a controls the output device 300, which outputs information. In the second embodiment, the output device 300 is a display device or a projector.

[0081] The control device 100a comprises a storage unit 110a, a procurement unit 120a and a control unit 130a.

[0082] The storage unit 110a may be implemented as a memory area reserved in the volatile memory device 102 or in the non-volatile memory device 103.

[0083] The acquisition unit 120a and the control unit 130a may be implemented partially or entirely by the processing circuit. Furthermore, the acquisition unit 120a and the control unit 130a may be implemented partially or entirely as modules of a program executed by the processor 101. The program executed by the processor 101 is also referred to, for example, as a control program. The control program is recorded, for example, on a recording medium.

[0084] The acquisition unit 120a acquires an image obtained by the camera 200 capturing an image of a plurality of people. For example, the acquisition unit 120a acquires the image from the camera 200. The acquisition unit 120a may also acquire the image from a device other than the camera 200.

[0085] The control unit 130a calculates the visual recognition rate with respect to the information currently output by the output device 300 based on the image. For example, in the case where the output device 300 is a display device, the control unit 130a calculates the visual recognition rate with respect to the content currently output by the display device. For example, in the case where the output device 300 is a projector, the control unit 130a further calculates the visual recognition rate with respect to the content currently output by the projector. If the visual recognition rate is lower than a predetermined threshold, the control unit 130a executes control to change the information currently output by the output device 300 to other information.For example, if the output device 300 is a display device, the control unit 130a executes control to change the content currently output by the display device to another content. In the case where the output device 300 is a projector, for example, the control unit 130a further executes control to change the information currently output by the projector to another information.

[0086] In the following, a process executed by the control device 100a is described using a flowchart.

[0087] Fig. Fig. 11 is a flowchart showing an example of the process executed by the control device in the second embodiment. At the time of starting the process of Fig. 11 the output device outputs 300 contents.

[0088] (Step S21) The acquisition unit 120a acquires the image from the camera 200.

[0089] (Step S22) The control unit 130a acquires a person count as the number of people viewing the content based on the image. For example, the control unit 130a acquires the person count based on the direction of the face of each individual included in the image or the line of sight of each individual included in the image.

[0090] It is also possible for the control unit 130a to detect the person count by subtracting the number of people who do not see the content from the total number of people in the image.

[0091] (Step S23) The control unit 130a calculates the visual recognition rate based on the detected count of people and the total number of people in the image.

[0092] (Step S24) The control unit 130a judges whether the calculated visual recognition rate is below the predetermined threshold. Incidentally, the threshold may also be, for example, a visual recognition rate measured in the past.

[0093] If the visual recognition rate is below the threshold, the process proceeds to step S25. If the visual recognition rate is greater than or equal to the threshold, the process ends.

[0094] (Step S25) The control unit 130 executes control to change the currently output content to another content. For example, the control unit 130a transmits the different contents and an output command for the different contents to the output device 300. Accordingly, the content output to the output device 300 is changed.

[0095] Furthermore, the acquisition unit 120a may acquire the management table 111. The management table 111 indicates a correspondence relationship between the currently output information and the dissimilar information. Then, the control unit 130a may identify the dissimilar information based on the currently output information and the management table 111 and execute control to change the currently output information to the dissimilar information. For example, the control unit 130a identifies the dissimilar content based on the currently output content and the management table 111. The control unit 130a executes control to change the currently output content to dissimilar content.

[0096] For example, if the visual recognition rate is below the threshold, it can be assumed that people do not see the content because they have become accustomed to the content. That is, it can be assumed that people have become accustomed to the stimulus through visual perception. Therefore, if the visual recognition rate is below the threshold, the controller 100a executes control to change the currently output content to another content. In other words, the controller 100a executes control to change the stimulus through visual perception. In this way, people begin to view the content. Accordingly, the controller 100a is able to cause people to respond to a stimulus. First modification of the second embodiment

[0097] In the second embodiment, the case where an image is acquired was described. In a first modification of the second embodiment, a case where a video is acquired will be described.

[0098] Fig. Fig. 12 is a flowchart showing an example of a process executed by a control device in the first modification of the second embodiment. The process of Fig. 12 differs from the process of Fig. 11 by executing steps S21a, S22a and S23a. Therefore, steps S21a, S22a and S23a in Fig. 12 below. In this case, the description of processing other than steps S21a, S22a, and S23a is omitted.

[0099] (Step S21a) The acquisition unit 120a acquires a video from the camera 200. The acquisition unit 120a acquires, for example, the video from the camera 200. The acquisition unit 120a may also acquire the video from a device other than the camera 200. The video is a video obtained by the camera 200 by performing image capturing for a predetermined period of time. The time is, for example, one minute.

[0100] (Step S22a) The control unit 130a acquires a person count as the number of people who view the content for a predetermined time based on the video. For example, the control unit 130a acquires the person count as the number of people who view the content for three seconds among the people included in the video.

[0101] (Step S23a) The control unit 130a calculates the visual recognition rate based on the detected person count and the actual number of people included in the video.

[0102] It is also possible for the control unit 130a to calculate an average value of a plurality of visual recognition rates as the visual recognition rate each obtained by calculation based on each of a plurality of images as the video.

[0103] According to the first modification of the second embodiment, the control device 100a is capable of making people respond to a stimulus. Second modification of the second embodiment

[0104] In a second modification of the second embodiment, a case where the threshold is changed based on the user attribute will be described. When changing the threshold, a threshold table is used. An example of a threshold table is shown below.

[0105] Fig. 13 is a diagram showing an example of the threshold table in the second modification of the second embodiment. The threshold table 112a can be stored in the storage unit 110a. The threshold table 112a is also referred to as threshold information. The threshold table 112a includes entries of user attributes and threshold values.

[0106] Information specifying the user attribute is entered under the User Attribute entry. Information about the threshold is entered under the Threshold entry.

[0107] The threshold table 112a is acquired by the acquisition unit 120a. For example, the acquisition unit 120a acquires the threshold table 112a from the storage unit 110a. In this case, the threshold table 112a may be stored on an external device. In the case where the threshold table 112a is stored in an external device, the acquisition unit 120a acquires the threshold table 112a from the external device.

[0108] In the following, a process executed by the control device 100a is described using a flowchart.

[0109] Fig. Fig. 14 is a flowchart showing an example of the process executed by the control device in the second modification of the second embodiment. The process of Fig. 14 differs from the process of Fig. 11 by executing steps S23b and 24b. Therefore, steps S23b and S24b are Fig. 14 below. In this case, the description of processing other than steps S23b and S24b is omitted.

[0110] (Step S23b) The control unit 130a identifies a user attribute as an attribute of an individual included in the image based on the image. Specifically, the control unit 130a identifies the user attribute using the image and image recognition technology. For example, the control unit 130a identifies that the age of an individual included in the image is "60 years old" based on the image.

[0111] The control unit 130a identifies the threshold corresponding to the user attribute based on the threshold table 112a. For example, using the threshold table 112a, the control unit 130a identifies the threshold "Th2" corresponding to "60 years old."

[0112] The control unit 130a changes the predetermined threshold value to the threshold value corresponding to the user attribute.

[0113] (Step S24) The control unit 130a judges whether or not the calculated visual recognition rate is below the threshold value corresponding to the user attribute.

[0114] If the visual recognition rate is below the threshold, the process proceeds to step S25. If the visual recognition rate is greater than or equal to the threshold, the process ends.

[0115] While the above description described the case where the threshold is changed when acquiring an image, the threshold can also be changed when acquiring a video.

[0116] According to the second modification of the second embodiment, the control device 100a is capable of making a judgment depending on the attribute of an individual included in the image or video by making the judgment using the threshold value corresponding to the user attribute. Third embodiment

[0117] Next, a third embodiment will be described below. In the third embodiment, description will be given mainly to features different from those in the first or second embodiment. In the third embodiment, descriptions of features common to the first or second embodiment will be omitted. In the third embodiment, the output device 300 is a display device or a projector.

[0118] Fig. 15 is a block diagram showing functions of a control device in the third embodiment. The control device 100b includes a storage unit 110b, an acquisition unit 120b, and a control unit 130b.

[0119] The storage unit 110b may be implemented as a memory area reserved in the volatile memory device 102 or in the non-volatile memory device 103.

[0120] The acquisition unit 120b and the control unit 130b may be implemented partially or entirely by the processing circuit. Furthermore, the acquisition unit 120b and the control unit 130b may be implemented partially or entirely as modules of a program executed by the processor 101. The program executed by the processor 101 is also referred to, for example, as a control program. The control program is recorded, for example, on a recording medium.

[0121] The functions of the procurement unit 120b and the control unit 130b are described in detail below.

[0122] In the following, a process executed by the control device 100b is described using a flowchart.

[0123] Fig. Fig. 16 is a flowchart showing an example of the process executed by the control device in the third embodiment. At the time of starting the process of Fig. 16, the output device outputs 300 contents. As in Fig. 2, there were also a large number of people in a location where movement in a variety of directions is possible.

[0124] (Step S31) The acquisition unit 120b acquires a video obtained from the camera 200 by capturing images of a plurality of people.

[0125] (Step S32) The control unit 130b acquires the person count as the number of people who view the content for a predetermined time based on the video. For example, the control unit 130b acquires the person count as the number of people who view the content for three seconds among the people included in the video.

[0126] (Step S33) The control unit 130b calculates the visual recognition rate based on the detected person count and the actual number of people included in the video.

[0127] It is also possible for the control unit 130b to calculate the average value of a plurality of visual recognition rates, each obtained by calculation based on each of a plurality of images as the video, as the visual recognition rate.

[0128] (Step S34) The control unit 130b judges whether or not the calculated visual recognition rate is below the predetermined threshold.

[0129] If the visual recognition rate is below the threshold, the process proceeds to step S35. If the visual recognition rate is greater than or equal to the threshold, the process ends.

[0130] (Step S35) The control unit 130b acquires the moving person count as the number of people who moved in the first direction among the plurality of directions based on the video. In this case, the first direction is, for example, the left direction.

[0131] (Step S36) The control unit 130b calculates the ratio of the people who have moved in the first direction using the moving person count.

[0132] (Step S37) The control unit 130b judges whether or not the ratio is smaller than the predetermined threshold.

[0133] If the ratio is below the threshold, the process proceeds to step S38. If the ratio is greater than or equal to the threshold, the process ends.

[0134] (Step S38) The control unit 130b executes control to change the information currently output by the output device 300 to other information. Specifically, the control unit 130b executes control to change the currently output content to other content.

[0135] It is also possible for the control unit 130b to execute the control to change the information currently output from the output device 300 to other information when the visual recognition rate is greater than or equal to the threshold and the ratio is smaller than the threshold.

[0136] According to the third embodiment, the controller 100b judges whether the content should be changed or not using the visual recognition rate and the ratio based on the moving person count. Therefore, the controller 100b is capable of providing a stimulus through visual perception depending on the detailed conditions of the people present in the video.

[0137] In the second and third embodiments, the cases where control is performed to change the information (e.g., contents) currently output by the output device 300 to other information were described. Control regarding sound, wind, smell, or illumination can also be performed similarly to the first modification of the first embodiment. The control will be described in detail below. The control device 100b communicates with a display device that displays information (e.g., contents). In addition, the control device 100b controls an output device that outputs a stimulus (e.g., sound, wind, smell, or illumination). Incidentally, the output device is installed near the display device. In addition, the output device may be arranged at a fixed position near the display device.The control unit 130b calculates a visual recognition rate as a ratio at which the information displayed by the display device is visually recognized due to the stimulus output by the output device, based on the image or video acquired by the acquisition unit 120b. If the visual recognition rate is lower than a predetermined threshold, the control unit 130b executes control to change the stimulus currently output by the output device to another stimulus. For example, the control unit 130b executes control to change the sound currently output by the output device to a sound that prompts people to look more closely at the display device. As described above, the visual recognition rate is increased by changing the stimulus output by the output device.

[0138] Furthermore, the management table 111 acquired by the acquisition unit 120b can indicate a correspondence relationship between the currently issued stimulus and a dissimilar stimulus. Then, the dissimilar stimulus can be identified based on the management table 111.

[0139] In the first to third embodiments, the output device 300 may be included in the control device 100, 100a, 100b. The control device 100, 100a, 100b includes, for example, a display device or a projector. If the output device 300 is a display device, the control unit 130 executes control to output the content currently output by the display device to the display device. Fourth embodiment

[0140] A fourth embodiment will be described below. In the fourth embodiment, the features that are different from those of the second embodiment will be described primarily. In the fourth embodiment, the description of features that are the same as those of the second embodiment will be omitted.

[0141] Fig. 17 is a diagram showing a control system in the fourth embodiment. The control system includes a control device 400, a camera 500, an output device 510, a camera 600, and an output device 610.

[0142] The camera 500 is also referred to as a first image capture device. The output device 510 is also referred to as a first output device. The camera 600 is also referred to as a second image capture device. The output device 610 is also referred to as a second output device. Each of the output device 510 and the output device 610 is a display device or a projector.

[0143] The control device 400, the camera 500, the output device 510, the camera 600 and the output device 610 are connected to each other via a network.

[0144] The camera 500 and the output device 510 are installed at a first location. The camera 600 and the output device 610 are installed at a second location. The second location is one location after the first location. For example, if a person passes the second location after the first location, the person sees the content output by the output device 610 after seeing the content output by the output device 510.

[0145] The control device 400 manages the content output by the output device 510 and the content output by the output device 610.

[0146] The following describes a process executed in the control system using a sequence diagram.

[0147] Fig. 18 is a sequence diagram showing an example of the process executed in the control system of the fourth embodiment.

[0148] (Step ST111) The camera 500 transmits an image obtained by capturing an image of a plurality of people to the controller 400.

[0149] (Step ST112) The controller 400 calculates the visual recognition rate using the image. The calculation method of the visual recognition rate is the same as the calculation method of the visual recognition rate in the second embodiment. The controller 400 judges that the visual recognition rate is below a predetermined threshold. Incidentally, this visual recognition rate is also referred to as the first visual recognition rate.

[0150] (Step ST113) The camera 600 transmits an image obtained by capturing an image of a plurality of people to the controller 400.

[0151] (Step ST114) The controller 400 calculates the visual recognition rate using the image. The calculation method of the visual recognition rate is the same as the calculation method of the visual recognition rate in the second embodiment. The controller 400 judges that the visual recognition rate is below a predetermined threshold. Incidentally, this visual recognition rate is also referred to as the second visual recognition rate.

[0152] (Step ST115) If the visual recognition rate at the first location is low and the visual recognition rate at the second location is low, the controller 400 executes control to cause the output device 610 to output content different from the content currently output by the output device 510. Specifically, the controller 400 transmits the different content and an output command for the different content to the output device 610.

[0153] Accordingly, the other content is output to the output device 610.

[0154] The above description refers to the case where the visual recognition rates are calculated using images. It is also possible for the controller 400 to calculate the visual recognition rates using the videos transmitted from the camera 500 and the camera 600. The calculation method of the visual recognition rate is otherwise the same as the calculation method of the visual recognition rate in the first modification of the second embodiment.

[0155] According to the fourth embodiment, the control system is capable of making people respond to a stimulus.

[0156] It is also possible for the control device 400 to execute a control to cause the output device 610 to output information that is different from the information currently output by the output device 510 when the first visual recognition rate is lower than the predetermined threshold. Through this control, an individual is more easily induced to view the content at the second location, even if the individual has not seen the content at the first location. According to the fourth embodiment, the control system is thus capable of causing individuals to respond to a stimulus. Fifth embodiment

[0157] Next, a fifth embodiment will be described. In the fifth embodiment, the features different from those in the second or fourth embodiment will be described primarily. In the fifth embodiment, the description of features common to the second or fourth embodiment will be omitted.

[0158] The fourth embodiment describes the case where one control device is integrated into the control system. The fifth embodiment describes a case where two control devices are integrated into one control system.

[0159] Fig. Figure 19 is a diagram showing the control system in the fifth embodiment. The control system includes a controller 700, a controller 800, the camera 500, the output device 510, the camera 600, and the output device 610.

[0160] The control device 700 and the control device 800 are connected to each other via a network. The control device 700 is also referred to as a first control device. The control device 800 is also referred to as a second control device.

[0161] The control device 700, the camera 500, and the output device 510 are connected to each other via a network. The control device 700 is a device that controls the camera 500 and the output device 510. The control device 700 manages the information to be output by the output device 510.

[0162] The control device 800, the camera 600, and the output device 610 are connected to each other via a network. The control device 800 is a device that controls the camera 600 and the output device 610. The control device 800 manages the information to be output by the output device 610.

[0163] The following describes a process executed in the control system using a sequence diagram.

[0164] Fig. 20 is a sequence diagram showing an example of the process executed in the control system of the fifth embodiment.

[0165] (Step ST121) The camera 500 transmits an image obtained by capturing an image of a plurality of people to the controller 700.

[0166] (Step ST122) The controller 700 calculates the visual recognition rate using the image. The calculation method of the visual recognition rate is the same as the calculation method of the visual recognition rate in the second embodiment. The controller 700 judges that the visual recognition rate is below a predetermined threshold. Incidentally, this visual recognition rate is also referred to as the first visual recognition rate.

[0167] (Step ST123) The controller 700 notifies the controller 800 that the visual recognition rate at the first location is low.

[0168] (Step ST124) The camera 600 transmits an image obtained by capturing an image of a plurality of people to the controller 800.

[0169] (Step ST125) The controller 800 calculates the visual recognition rate using the image. The calculation method of the visual recognition rate is the same as the calculation method of the visual recognition rate in the second embodiment. The controller 800 judges that the visual recognition rate is low. Incidentally, this visual recognition rate is also referred to as the second visual recognition rate.

[0170] (Step ST126) The control device 800 transmits a transmission request to the control device 700, requesting the transmission of information about the content currently output by the output device 510.

[0171] (Step ST127) The control device 700 transmits the information about the content currently output by the output device 510 to the control device 800.

[0172] (Step ST128) The controller 800 executes control to cause the output device 610 to output content different from the content currently output by the output device 510. Specifically, the controller 800 transmits the different content and an output command for the different content to the output device 610.

[0173] Accordingly, the other content is output to the output device 610.

[0174] The above description refers to the case where the visual recognition rate is calculated using an image. It is also possible for the controller 700 to calculate the visual recognition rate using a video transmitted from the camera 500. It is also possible for the controller 800 to calculate the visual recognition rate using a video transmitted from the camera 600. The calculation method of the visual recognition rate is otherwise the same as the calculation method of the visual recognition rate in the first modification of the second embodiment.

[0175] According to the fifth embodiment, the control system is capable of making people respond to a stimulus, similar to the fourth embodiment.

[0176] It is also possible for the control device 800 to transmit a transmission request to the control device 700 to request the transmission of the information currently output by the output device 510 when the first visual recognition rate is lower than the threshold. This makes it easier to tempt an individual to view the content at the second location, even if the individual has not seen the content at the first location. According to the fifth embodiment, the control system is thus capable of making individuals respond to a stimulus.

[0177] The control device in any of the first to fifth embodiments may also include at least one of a camera and an output device (e.g., a display). Furthermore, the functions of the control device in any of the first to fifth embodiments may be implemented in a form distributed among a plurality of devices, such as an input device such as a camera, an output device such as a display, etc. Furthermore, the control device may include a plurality of devices, such as a camera and an output device, as mentioned above.

[0178] Features in the embodiments described above can be combined with each other in a suitable manner. LIST OF REFERENCE SYMBOLS

[0179] 100: Control device, 100a: Control device, 100b: Control device, 101: Processor, 102: Volatile storage device, 103: Non-volatile storage device, 110: Storage unit, 110a: Storage unit, 110b: Storage unit, 111: Management table, 112: Threshold table, 112a: Threshold table, 120: Acquisition unit, 120a: Acquisition unit, 120b: Acquisition unit, 130: Control unit, 130a: Control unit, 130b: Control unit, 200: Camera, 300: Output device, 400: Control device, 500: Camera, 510: Output device, 600: Camera, 610: Output device, 700: Control device, 800: Control device

Claims

A control device (100) for controlling an output device (300) that outputs a stimulus, the control device comprising:an acquisition unit (120) that acquires a video obtained by an image capture device (200) by capturing images of a plurality of people who were located at a location where movement in a plurality of directions is possible;anda control unit (130) that acquires a moving person count as a number of people who have moved in a first direction from the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the moving person count, and, when a situation in which the ratio is smaller than a predetermined threshold continues for a predetermined set time, executes control for changing the stimulus currently output from the output device (300) to another stimulus.; The control device according to claim 1, wherein the acquisition unit (120) acquires management information (111) indicating a correspondence relationship between the currently output stimulus and a dissimilar stimulus having a same attribute as the currently output stimulus and being dissimilar to the currently output stimulus, and the control unit (130) identifies the dissimilar stimulus based on the currently output stimulus and the management information (111) and executes control for changing the currently output stimulus into the dissimilar stimulus. The control device according to claim 1 or 2, wherein the acquisition unit (120) acquires threshold information (112), the control unit (130) identifies a user attribute as an attribute of a person included in the video based on the video and identifies a threshold corresponding to the user attribute based on the threshold information (112), and the predetermined threshold is the identified threshold. A control device according to claim 1 or 2, wherein, when the output device (300) is a display device, the control unit (130) executes control for changing a content currently output by the display device into another content. A control device according to claim 1 or 2, wherein, when the output device (300) is a loudspeaker, the control unit (130) executes control for changing a sound currently output from the loudspeaker to another sound. A control device according to claim 1 or 2, wherein, when the output device (300) is an air conditioner, the control unit (130) executes at least one of control for changing a direction of air currently output from the air conditioner to another direction and control for changing a wind power of the air conditioner. Control device according to claim 1 or 2, wherein the control unit (130), when the output device (300) is an odor generator, executes a control for changing an odor currently output by the odor generator into another odor. A control device according to claim 1 or 2, wherein, when the output device (300) is a projector, the control unit (130) executes control for changing information currently output by the projector into other information. A control device according to claim 1 or 2, wherein, when the output device (300) is a lighting device, the control unit (130) executes a control for changing an illuminance, an illuminating color, or an illuminating angle currently output by the lighting device. Control device according to claim 1 or 2, wherein, when the output device (300) is a display device or a projector, the control unit further comprises the display device or the projector. A control device for controlling an output device (300) that outputs a stimulus, the control device (100a) comprising:an acquisition unit (120a) that acquires an image or a video obtained by an image pickup device (200) by capturing one or more images of a plurality of people, and acquires management information (111) indicating a correspondence relationship between a currently output stimulus and a dissimilar stimulus;anda control unit (130a) that calculates a visual recognition rate with respect to the information currently output by the output device (300) based on the image or the video, if the visual recognition rate is lower than a predetermined threshold, identifies the dissimilar stimulus based on the currently output stimulus and the management information (111), and executes control for changing the currently output stimulus to the dissimilar stimulus.; The control device according to claim 11, wherein the acquisition unit (120a) acquires threshold information (112a), the control unit (130a) identifies a user attribute as an attribute of a person included in the image or video based on the image or video, and identifies a threshold corresponding to the user attribute based on the threshold information (112a), and the predetermined threshold is the identified threshold. A control device according to claim 11 or 12, wherein the plurality of people were located at a location where movement in a plurality of directions is possible, and when the visual recognition rate based on the video is less than the threshold, the control unit (130b) detects a moving person count as a number of people who have moved in a first direction out of the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the moving person count, and when the ratio is less than a predetermined threshold, executes control to change the currently output stimulus to the dissimilar stimulus. A control device according to claim 11 or 12, wherein the plurality of people were located at a location where movement in a plurality of directions is possible, and when the visual recognition rate based on the video is greater than or equal to the threshold, the control unit (130b) detects a moving person count as a number of people who have moved in a first direction out of the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the moving person count, and when the ratio is less than a predetermined threshold, executes control to change the currently output stimulus to the dissimilar stimulus. A control device (100a, 100b) for communicating with a display device that displays information and for controlling an output device that outputs a stimulus, the control device (100a, 100b) comprising:an acquisition unit (120a, 120b) that acquires an image or a video obtained by an image capture device (200) by capturing one or more images of a plurality of people;anda control unit (130a, 130b) that calculates a visual recognition rate as a ratio at which the information displayed by the display device is visually recognized due to the stimulus output by the output device, based on the image or the video, and when the visual recognition rate is lower than a predetermined threshold, executes control for changing the stimulus currently output by the output device to another stimulus without changing the information displayed by the display device.; A control device according to claim 15, wherein, when the output device is a speaker, the control unit (130a, 130b) executes control for changing a sound currently output from the speaker to another sound. A control device according to claim 15, wherein, when the output device is an air conditioner, the control unit (130a, 130b) executes at least one of control for changing a direction of air currently output from the air conditioner to another direction and control for changing the wind power of the air conditioner. A control device according to claim 15, wherein, when the output device is an odor generator, the control unit (130a, 130b) executes a control for changing an odor currently output by the odor generator into another odor. A control device according to claim 15, wherein, when the output device is a lighting device, the control unit (130a, 130b) executes control for changing an illuminance, an illuminating color, or an illuminating angle currently output by the lighting device. A control system comprising: an image pickup device (200); and a control device (100) for controlling an output device (300) that outputs a stimulus, wherein the control device (100) comprises: an acquisition unit (120) that acquires a video obtained by the image pickup device (200) by capturing images of a plurality of people who were located at a location where movement in a plurality of directions is possible;anda control unit (130) that acquires a moving person count as a number of people who have moved in a first direction from the plurality of directions based on the video, calculates a ratio of the people who have moved in the first direction using the moving person count, and, when a situation in which the ratio is smaller than a predetermined threshold continues for a predetermined set time, executes control for changing the stimulus currently output from the output device (300) to another stimulus.; A control system comprising: a first image pickup device (500) installed at a first location and transmitting an image or a video obtained by capturing one or more images of a plurality of people; a first output device (510) installed at the first location; a second output device (610) installed at a second location as a location after the first location; a control device (400) managing information to be output by the first output device (510); and a second image pickup device (600) installed at the second location and transmitting an image or a video obtained by capturing one or more images of a plurality of people,wherein the control device (400) calculates a first visual recognition rate with respect to information currently output by the first output device (510) based on the image or video received by the first image recording device (500), calculates a second visual recognition rate with respect to the information currently output by the second output device (610) based on the image or video received by the second image recording device (600), and if the first visual recognition rate and the second visual recognition rate are lower than a predetermined threshold, executes a control to have the second output device (610) output information that differs from the information currently output by the first output device (510). A control system comprising: a first image capture device (500) installed at a first location and transmitting an image or a video obtained by capturing one or more images of a plurality of people; a first output device (510) installed at the first location; a first control device (700) managing information to be output by the first output device (510); a second output device (610) installed at a second location as a location after the first location; and a second control device (800), wherein the first control device (700) calculates a first visual recognition rate with respect to information currently output by the first output device (510) based on the image or video received by the first image capture device (500), and if the first visual recognition rate is lower than a predetermined threshold,the second control device (800) notifies that the first visual recognition rate is lower than the threshold value. If the first visual recognition rate is lower than the threshold value, the second control device (800) transmits a transmission request requesting transmission of the information currently output by the first output device (510) to the first control device (700). The first control device (700), receiving the transmission request, transmits the information currently output by the first output device (510) to the second control device (800). The second control device (800), receiving the information currently output by the first output device (510), executes control to cause the second output device (610) to output information that differs from the information currently output by the first output device. The control system according to claim 22, further comprising a second image pickup device (600) installed at the second location, wherein the second control device (800) calculates a second visual recognition rate with respect to the information currently output by the second output device (610) based on an image or video received by the second image pickup device (600), and when the first visual recognition rate and the second visual recognition rate are lower than the predetermined threshold, transmits the transmission request to the first control device (700). A control method performed by a control device (100) for controlling an output device (300) that outputs a stimulus, the control method comprising:acquiring a video obtained by an image pickup device (200) by capturing images of a plurality of people who were located at a location where movement in a plurality of directions is possible;acquiring a moving person count as a number of people who have moved in a first direction among the plurality of directions based on the video;calculating a ratio of the people who have moved in the first direction using the moving person count;andwhen a situation in which the ratio is less than a predetermined threshold continues for a predetermined set time, executing control to change the stimulus currently output by the output device (300) to another stimulus.; A control method performed by a control device (100a, 100b) for communicating with a display device that displays information and for controlling an output device that outputs a stimulus, the control method comprising:acquiring an image or a video obtained by an image pickup device by capturing one or more images of a plurality of people;calculating a visual recognition rate as a ratio at which the information displayed by the display device is visually recognized due to the stimulus output by the output device, based on the image or the video; andif the visual recognition rate is lower than a predetermined threshold, executing control for changing the stimulus currently output by the output device to another stimulus without changing the information displayed by the display device. A control program that causes a control device (100) for controlling an output device (300) that outputs a stimulus to perform a process comprising:acquiring a video obtained by an image pickup device (200) by capturing images of a plurality of people who were located at a location where movement in a plurality of directions is possible;acquiring a moving person count as a number of people who have moved in a first direction among the plurality of directions based on the video;calculating a ratio of the people who have moved in the first direction using the moving person count;andwhen a situation in which the ratio is less than a predetermined threshold continues for a predetermined set time, executing control to change the stimulus currently output by the output device (300) to another stimulus.; A control program that causes a control device (100a, 100b) for communicating with a display device that displays information and for controlling an output device that outputs a stimulus to execute a process of:acquiring an image or a video obtained by an image pickup device by capturing one or more images of a plurality of people;calculating a visual recognition rate as a ratio at which the information displayed by the display device is visually recognized due to the stimulus output by the output device, based on the image or the video; andwhen the visual recognition rate is lower than a predetermined threshold, executing control for changing the stimulus currently output by the output device to another stimulus without changing the information displayed by the display device.

Images