Control device, control system, control method, and control program

IN604997BActive Publication Date: 2026-10-05MITSUBISHI ELECTRIC CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202447071298
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-20
Publication Date
2026-10-05
Patent Text Reader

Abstract

This control device controls an output device (300) that outputs a stimulus. The control device (100) includes: an acquisition unit (120) that acquires images obtained by an imaging device (200) which images a plurality of persons present in a location where the persons were able to move in a plurality of directions; and a control unit (130) that, on the basis of the images, detects the number of moving persons who moved in a first direction among the plurality of directions, uses the number of moving persons to compute the ratio of the persons who moved in the first direction, and, if the ratio remains below a predetermined threshold value for a predetermined amount of time, performs control to change the stimulus being outputted by the output device (300) to a different stimulus.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a control device, acontrol system, and a control method.BACKGROUND ART

[0002] Displays are installed in train stations, shopping malls,and so forth. For example, information for guiding people isoutputted to the display. A technology for outputting theinformation to the display is described in Patent Reference 1,for example.PRIOR ART REFERENCEPATENT REFERENCE

[0003] Patent Reference 1: Japanese Patent Application PublicationNo. 2014-215662SUMMARY OF THE INVENTIONPROBLEM TO BE SOLVED BY THE INVENTION

[0004] Incidentally, a person receives a stimulus. For example,the stimulus can be a stimulus by visual sensation, a stimulus byauditory sensation, or the like. As people get accustomed to astimulus, the people stop responding to the stimulus.

[0005] An object of the present disclosure is to make peoplerespond to a stimulus.MEANS FOR SOLVING THE PROBLEM

[0006] A control device according to an aspect of the presentdisclosure is provided. The control device controls an outputdevice that outputs a stimulus. The control device includes anacquisition unit that acquires a video obtained by an imagecapturing device by capturing images of a plurality of peopleexisted in a place where movement in a plurality of directions ispossible and a control unit that detects a moving people count asa number of people who moved in a first direction among theplurality of directions based on the video, calculates a ratio ofthe people who moved in the first direction by using the movingpeople count, and when a situation where the ratio is less than apredetermined threshold value is continuing for a predeterminedset time, executes control for changing the stimulus currentlyoutputted by the output device to a different stimulus.EFFECT OF THE INVENTION

[0007] According to the present disclosure, it is possible to makepeople respond to a stimulus.BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Fig. 1 is a diagram showing a control system in a firstembodiment.Fig. 2 is a diagram showing an installation example of acamera and an output device in the first embodiment.Fig. 3 is a diagram showing the hardware included in acontrol device in the first embodiment.Fig. 4 is a block diagram showing functions of the controldevice in the first embodiment.Fig. 5 is a flowchart showing an example of a processexecuted by the control device in the first embodiment.Fig. 6 is a diagram showing an example of a managementtable in a first modification of the first embodiment.Fig. 7 is a flowchart showing an example of a processexecuted by a control device in the first modification of thefirst embodiment.Fig. 8 is a diagram showing an example of a threshold valuetable in a second modification of the first embodiment.Fig. 9 is a flowchart showing an example of a processexecuted by a control device in the second modification of thefirst embodiment.Fig. 10 is a block diagram showing functions of a controldevice in a second embodiment.Fig. 11 is a flowchart showing an example of a processexecuted by the control device in the second embodiment.Fig. 12 is a flowchart showing an example of a processexecuted by a control device in a first modification of thesecond embodiment.Fig. 13 is a diagram showing an example of a thresholdvalue table in a second modification of the second embodiment.Fig. 14 is a flowchart showing an example of a processexecuted by a control device in the second modification of thesecond embodiment.Fig. 15 is a block diagram showing functions of a controldevice in a third embodiment.Fig. 16 is a flowchart showing an example of a processexecuted by the control device in the third embodiment.Fig. 17 is a diagram showing a control system in a fourthembodiment.Fig. 18 is a sequence diagram showing an example of aprocess executed in the control system in the fourth embodiment.Fig. 19 is a diagram showing a control system in a fifthembodiment.Fig. 20 is a sequence diagram showing an example of aprocess executed in the control system in the fifth embodiment.MODE FOR CARRYING OUT THE INVENTION

[0009] Embodiments will be described below with reference to thedrawings. The following embodiments are just examples and avariety of modifications are possible within the scope of thepresent disclosure.

[0010] First EmbodimentFig. 1 is a diagram showing a control system in a firstembodiment. The control system includes a control device 100, acamera 200 and an output device 300. The control device 100, thecamera 200 and the output device 300 execute communication via anetwork.For example, the camera 200 and the output device 300 areinstalled in a train station. For example, the control device100 is installed in a place different from the camera 200 and theoutput device 300. A case where the camera 200 and the outputdevice 300 are installed in a place different from the controldevice 100 will be shown below.

[0011] Fig. 2 is a diagram showing an installation example of thecamera and the output device in the first embodiment. Fig. 2shows the camera 200 and the output device 300. Fig. 2 shows aplurality of people existed in a place where movement in aplurality of directions is possible. Passages exist to the rightand left of the output device 300 in Fig. 2. In short, there isa T-junction. The plurality of people can move to the passages.Incidentally, the place where movement in a plurality ofdirections is possible can also be a crossroads or the like.The control device 100 is a device that executes a controlmethod. The control device 100 controls the output device 300.

[0012] The camera 200 is referred to also as an image capturingdevice. The camera 200 can also be an infrared camera.The output device 300 is a device that outputs a stimulus.For example, the output device 300 is a display device, aspeaker, an air conditioner, a smell generator, a projector, adeodorizing machine, an illuminator, or the like. Incidentally,the display device is a digital signage, for example.

[0013] For example, the output device 300 outputs information forguiding people. In the case where the output device 300 is aprojector, the output device 300 performs floor surface lighting.For example, the output device 300 is capable of guiding peopleby the floor surface lighting.Here, the output device 300 in the following description isassumed to be a digital signage. Further, the followingdescription will be given mainly of cases where a stimulus byvisual sensation is changed by changing content outputted to theoutput device 300.

[0014] Next, hardware included in the control device 100 will bedescribed below.Fig. 3 is a diagram showing the hardware included in thecontrol device in the first embodiment. The control device 100includes a processor 101, a volatile storage device 102 and anonvolatile storage device 103.

[0015] The processor 101 controls the whole of the control device100. The processor 101 is a Central Processing Unit (CPU), aField Programmable Gate Array (FPGA) or the like, for example.The processor 101 can also be a multiprocessor. Further, thecontrol device 100 may include processing circuitry. Theprocessing circuitry may be either a single circuit or a combinedcircuit.

[0016] The volatile storage device 102 is main storage of thecontrol device 100. The volatile storage device 102 is a RandomAccess Memory (RAM), for example. The nonvolatile storage device103 is auxiliary storage of the control device 100. Thenonvolatile storage device 103 is a Hard Disk Drive (HDD) or aSolid State Drive (SSD), for example.

[0017] Next, functions included in the control device 100 will bedescribed below.Fig. 4 is a block diagram showing the functions of thecontrol device in the first embodiment. The control device 100includes a storage unit 110, an acquisition unit 120 and acontrol unit 130.

[0018] The storage unit 110 may be implemented as a storage areareserved in the volatile storage device 102 or the nonvolatilestorage device 103.Part or all of the acquisition unit 120 and the controlunit 130 may be implemented by processing circuitry. Further,part or all of the acquisition unit 120 and the control unit 130may be implemented as modules of a program executed by theprocessor 101. For example, the program executed by theprocessor 101 is referred to also as a control program. Thecontrol program has been recorded in a record medium, forexample.The functions of the acquisition unit 120 and the controlunit 130 will be described in detail later.

[0019] Next, a process executed by the control device 100 will bedescribed below by using a flowchart.Fig. 5 is a flowchart showing an example of the processexecuted by the control device in the first embodiment. At thetime point of starting the process of Fig. 5, the output device300 is outputting content. Incidentally, the content can beletters, an image or a video. For example, the image can be asymbol such as an arrow.

[0020] (Step S11) The acquisition unit 120 acquires a videoobtained by the camera 200 by capturing images of a plurality ofpeople. For example, the acquisition unit 120 acquires the videofrom the camera 200. The acquisition unit 120 may also acquirethe video from a device other than the camera 200. The video isa video obtained by the camera 200 by performing the imagecapturing for a predetermined time. The time is one minute, forexample.

[0021] (Step S12) The control unit 130 detects a moving peoplecount as the number of people who moved in a first directionamong the plurality of directions based on the video. Forexample, the control unit 130 identifies the people by using theimage recognition technology. The control unit 130 detects themoving people count by identifying the people. Incidentally, thefirst direction is, for example, a leftward direction from theoutput device 300 in Fig. 2.

[0022] (Step S13) The control unit 130 calculates a ratio of thepeople who moved in the first direction by using the movingpeople count. For example, the control unit 130 calculates theratio by using the moving people count and the actual number ofpeople included in the video. Accordingly, the ratio of thepeople who moved in the first direction among the actual numberof people is calculated.

[0023] (Step S14) The control unit 130 judges whether or not theratio is less than a predetermined threshold value. Here, thethreshold value may be defined as follows. For example, thethreshold value is "8" in "8 : 2". Incidentally, "8 : 2"indicates that 80 % of the people are guided in the leftwarddirection and 20 % of the people are guided in the rightwarddirection. For example, when the threshold value is "8", thecontrol unit 130 judges whether or not the ratio is less than"8".If the ratio is less than the threshold value, the processadvances to step S15. If the ratio is higher than or equal tothe threshold value, the process ends.

[0024] (Step S15) The control unit 130 judges whether or not apredetermined set time has elapsed since the first judgment thatthe ratio is less than the threshold value. The set time is 5minutes, for example.If the set time has elapsed, the control unit 130 judgesthat the situation where the ratio is less than the thresholdvalue is continuing for the set time. Then, the process advancesto step S16. If the set time has not elapsed, the processadvances to the step S11.

[0025] (Step S16) The control unit 130 executes control forchanging the content currently outputted by the output device 300to different content. For example, the control unit 130transmits the different content and an output command for thedifferent content to the output device 300. Accordingly, thecontent outputted to the output device 300 is changed.As above, when the situation where the ratio is less thanthe predetermined threshold value is continuing for the set timepredetermined, the control unit 130 executes the control forchanging the stimulus currently outputted by the output device300 to a different stimulus.

[0026] Here, a description will be given of a process executed bythe control unit 130 in cases where the output device 300 is aspeaker or the like.In cases where the output device 300 is a speaker, thecontrol unit 130 executes the following process. When it isjudged that the situation where the ratio is less than thethreshold value is continuing for the set time, the control unit130 executes control for changing sound currently outputted bythe speaker to different sound. Accordingly, the sound outputtedfrom the speaker is changed.

[0027] In cases where the output device 300 is an air conditioner,the control unit 130 executes the following process. When it isjudged that the situation where the ratio is less than thethreshold value is continuing for the set time, the control unit130 executes control for changing the direction of air currentlyoutputted by the air conditioner to a different direction.Accordingly, the direction of the air is changed. It is alsopossible for the control unit 130 to execute control for changingwind power of the air conditioner.

[0028] In cases where the output device 300 is a smell generator,the control unit 130 executes the following process. When it isjudged that the situation where the ratio is less than thethreshold value is continuing for the set time, the control unit130 executes control for changing a smell currently outputted bythe smell generator to a different smell. Accordingly, the smelloutputted from the smell generator is changed. In cases where adeodorizing machine is connected to the control device 100, thecontrol unit 130 may activate the deodorizing machine instead ofgenerating a different smell.

[0029] In cases where the output device 300 is a projector, thecontrol unit 130 executes the following process. When it isjudged that the situation where the ratio is less than thethreshold value is continuing for the set time, the control unit130 executes control for changing information currently outputtedby the projector to different information. Accordingly, theinformation outputted by the projector is changed.

[0030] In cases where the output device 300 is an illuminator, thecontrol unit 130 executes the following process. When it isjudged that the situation where the ratio is less than thethreshold value is continuing for the set time, the control unit130 executes control for changing illuminance, illumination coloror an illumination angle of light currently outputted by theilluminator. Accordingly, the illuminance, the illuminationcolor or the illumination angle is changed.

[0031] Further, the control unit 130 may execute control forchanging the stimulus outputted by the output device 300 to astimulus that guides people in the first direction. For example,in cases where the output device 300 is a display device, thecontrol unit 130 executes control for changing the contentcurrently outputted by the display device to content that guidespeople in the first direction. For example, in cases where theoutput device 300 is a projector, the control unit 130 executescontrol for changing the information currently outputted by theprojector to information that guides people in the firstdirection. For example, in cases where the output device 300 isa speaker, the control unit 130 executes control for changing thesound currently outputted by the projector to sound that guidespeople in the first direction. As above, the control device 100is capable of guiding people in the first direction by thecontrol executed by the control unit 130.

[0032] Here, as people get accustomed to a stimulus, the peoplestop responding to the stimulus. According to the firstembodiment, the control device 100 changes the stimulus when itis judged that the situation where the ratio is less than thethreshold value is continuing for the set time. For example, thecontrol device 100 executes control for changing the contentoutputted to the output device 300 when it is judged that thesituation where the ratio is less than the threshold value iscontinuing for the set time. By doing this, the stimulus byvisual sensation is changed. By changing the stimulus, peoplebegin to respond to the stimulus. Accordingly, the controldevice 100 is capable of making people respond to a stimulus.

[0033] The above description has been given of a case where themoving people count is detected based on a video. It is alsopossible for the control device 100 to execute the followingprocess. The acquisition unit 120 acquires position informationregarding one or more persons from one or more terminal devices(e.g., smartphones). The control unit 130 detects the movingpeople count based on the position information regarding one ormore persons.

[0034] First Modification of First EmbodimentIn a first modification of the first embodiment, adescription will be given of a case where a stimulus dissimilarto the stimulus currently outputted is determined based on amanagement table. First, an example of the management table willbe shown below.

[0035] Fig. 6 is a diagram showing an example of the managementtable in a first modification of the first embodiment. Themanagement table 111 may be stored in the storage unit 110. Themanagement table 111 is referred to also as managementinformation. The management table 111 includes items of contentname, day of week, output count, time slot, dissimilar content,and threshold value.

[0036] In the item of content name, the name of content isregistered. In the item of day of week, a day of the week onwhich the content is outputted is registered. In the item ofoutput count, the number of times the content has been outputtedis registered. In the item of time slot, a time slot in whichthe content is outputted is registered. In the item ofdissimilar content, the name of dissimilar content is registered.For example, the content X is dissimilar to the content A. Inthe item of threshold value, information regarding the thresholdvalue is registered.

[0037] As above, the management table 111 indicates acorrespondence relationship between content and contentdissimilar to the content. That is, the management table 111indicates information regarding content having the sameattribute. Incidentally, the similarity between content andcontent may be represented by a numerical value.Fig. 6 indicates examples of content. Informationregarding a stimulus other than content may also be registered inthe management table 111. For example, the management table 111may also indicate a correspondence relationship between sound andsound dissimilar to the sound.

[0038] The management table 111 is acquired by the acquisitionunit 120. For example, the acquisition unit 120 acquires themanagement table 111 from the storage unit 110. Here, themanagement table 111 may be stored in an external device (e.g.,cloud server). In the case where the management table 111 isstored in an external device, the acquisition unit 120 acquiresthe management table 111 from the external device.

[0039] Further, a threshold value has been associated with eachstimulus. For example, the threshold value has been associatedwith content as a stimulus by visual sensation. Incidentally,the threshold value does not have to be a fixed value. Thethreshold value may be changed by feeding back a result obtainedby outputting the content.

[0040] Next, a process executed by the control device 100 will bedescribed below by using a flowchart.Fig. 7 is a flowchart showing an example of the processexecuted by the control device in the first modification of thefirst embodiment. The process in Fig. 7 differs from the processin Fig. 5 in that steps S14a, S15a and S16a are executed. Thus,the steps S14a, S15a and S16a in Fig. 7 will be described below.Then, the description will be omitted for processing other thanthe steps S14a, S15a and S16a.

[0041] (Step S14a) The control unit 130 judges whether or not theratio is less than the threshold value corresponding to thecontent currently outputted.If the ratio is less than the threshold value, the processadvances to the step S15. If the ratio is higher than or equalto the threshold value, the process ends.

[0042] (Step S15a) The control unit 130 identifies the dissimilarstimulus based on the currently outputted stimulus and themanagement table 111. Specifically, the control unit 130identifies content dissimilar to the currently outputted contentbased on the currently outputted content and the management table111. For example, when the currently outputted content is thecontent A, the control unit 130 identifies the content X. It isalso possible for the control unit 130 to execute the followingprocess. The control unit 130 identifies content dissimilar tothe currently outputted content based on the threshold valuecorresponding to the currently outputted content and themanagement table 111. For example, the control unit 130 refersto the management table 111 and identifies records of thethreshold value corresponding to the currently outputted content.The control unit 130 identifies a record of the currentlyoutputted content A out of the identified records. The controlunit 130 identifies the content X in the record of the content A.

[0043] (Step S16a) The control unit 130 executes control forchanging the currently outputted stimulus to a dissimilarstimulus. Specifically, the control unit 130 executes controlfor changing the currently outputted content to the identifieddissimilar content. For example, the control unit 130 transmitsthe dissimilar content and an output command for the dissimilarcontent to the output device 300. Accordingly, the contentoutputted to the output device 300 is changed.

[0044] By changing the content in the process of Fig. 7 to sound,wind, smell, information outputted by the projector, or lighting,dissimilar sound, wind, smell, information outputted by theprojector, or lighting is outputted. In short, a dissimilarstimulus is outputted.

[0045] According to the first modification of the firstembodiment, the control device 100 is capable of making peoplemore responsive to a stimulus by changing the stimulus to adissimilar stimulus.

[0046] Second Modification of First EmbodimentIn a second modification of the first embodiment, adescription will be given of a case where the threshold value ischanged based on a user attribute. When the threshold value ischanged, a threshold value table is used. An example of thethreshold value table will be shown below.

[0047] Fig. 8 is a diagram showing an example of the thresholdvalue table in the second modification of the first embodiment.The threshold value table 112 may be stored in the storage unit110. The threshold value table 112 is referred to also asthreshold value information. The threshold value table 112includes items of user attribute and threshold value.In the item of user attribute, information indicating theuser attribute is registered. In the item of threshold value,information regarding the threshold value is registered.

[0048] The threshold value table 112 is acquired by theacquisition unit 120. For example, the acquisition unit 120acquires the threshold value table 112 from the storage unit 110.Here, the threshold value table 112 may be stored in an externaldevice. In the case where the threshold value table 112 isstored in an external device, the acquisition unit 120 acquiresthe threshold value table 112 from the external device.Further, content and the threshold value table 112 may beassociated with each other. In the case where content and thethreshold value table 112 are associated with each other, theacquisition unit 120 acquires a threshold value table 112corresponding to the currently outputted content. As above, eachof a plurality of pieces of content may be associated with athreshold value table 112.

[0049] Next, a process executed by the control device 100 will bedescribed below by using a flowchart.Fig. 9 is a flowchart showing an example of the processexecuted by the control device in the second modification of thefirst embodiment. The process in Fig. 9 differs from the processin Fig. 5 in that steps S13b and S14b are executed. Thus, thesteps S13b and S14b in Fig. 9 will be described below. Then, thedescription will be omitted for processing other than the stepsS13b and S14b.

[0050] (Step S13b) The control unit 130 identifies a userattribute as an attribute of a person included in the video basedon the video. Specifically, the control unit 130 identifies theuser attribute by using the video and the image recognitiontechnology. For example, the control unit 130 detects awheelchair based on the video and thereby identifies that thereexists a person having a leg handicap in the video. Further, forexample, based on the video, the control unit 130 identifies thatthe age of a person existing in the video is "60 years old".

[0051] The control unit 130 identifies the threshold valuecorresponding to the user attribute based on the threshold valuetable 112. For example, the control unit 130 identifies thethreshold value "6" corresponding to "60 years old" based on thethreshold value table 112.The control unit 130 changes the predetermined thresholdvalue to the threshold value corresponding to the user attribute.

[0052] The control unit 130 may identify a user attribute havingthe highest ratio among a plurality of user attributes based onthe plurality of people included in the video. Then, the controlunit 130 may identify the threshold value corresponding to theidentified user attribute based on the threshold value table 112.

[0053] (Step S14b) The control unit 130 judges whether or not theratio is less than the threshold value corresponding to the userattribute.If the ratio is less than the threshold value, the processadvances to the step S15. If the ratio is higher than or equalto the threshold value, the process ends.

[0054] According to the second modification of the firstembodiment, the control device 100 is capable of making ajudgment dependent on the attribute of a person included in thevideo by making the judgment by using the threshold valuecorresponding to the user attribute.

[0055] Second EmbodimentNext, a second embodiment will be described below. In thesecond embodiment, the description will be given mainly offeatures different from those in the first embodiment. In thesecond embodiment, the description is omitted for features incommon with the first embodiment. Figs. 1 to 3 and 6 arereferred to in the second embodiment.

[0056] In the first embodiment, the description has given of thecase where the content is changed based on the ratio of thepeople who moved in the first direction. In the secondembodiment, a description will be given of a case where thecontent is changed based on a visual recognition rate.

[0057] Fig. 10 is a block diagram showing functions of a controldevice in the second embodiment. The control device 100acontrols the output device 300 that outputs information. In thesecond embodiment, the output device 300 is a display device or aprojector.The control device 100a includes a storage unit 110a, anacquisition unit 120a and a control unit 130a.

[0058] The storage unit 110a may be implemented as a storage areareserved in the volatile storage device 102 or the nonvolatilestorage device 103.Part or all of the acquisition unit 120a and the controlunit 130a may be implemented by processing circuitry. Further,part or all of the acquisition unit 120a and the control unit130a may be implemented as modules of a program executed by theprocessor 101. For example, the program executed by theprocessor 101 is referred to also as a control program. Thecontrol program has been recorded in a record medium, forexample.

[0059] The acquisition unit 120a acquires an image obtained by thecamera 200 by capturing an image of a plurality of people. Forexample, the acquisition unit 120a acquires the image from thecamera 200. The acquisition unit 120a may also acquire the imagefrom a device other than the camera 200.

[0060] The control unit 130a calculates the visual recognitionrate regarding the information currently outputted by the outputdevice 300 based on the image. For example, in the case wherethe output device 300 is a display device, the control unit 130acalculates the visual recognition rate regarding the contentcurrently outputted by the display device. Further, for example,in the case where the output device 300 is a projector, thecontrol unit 130a calculates the visual recognition rateregarding the information currently outputted by the projector.When the visual recognition rate is lower than a predeterminedthreshold value, the control unit 130a executes control forchanging the information currently outputted by the output device300 to different information. For example, in the case where theoutput device 300 is a display device, the control unit 130aexecutes control for changing the content currently outputted bythe display device to different content. Further, for example,in the case where the output device 300 is a projector, thecontrol unit 130a executes control for changing the informationcurrently outputted by the projector to different information.

[0061] Next, a process executed by the control device 100a will bedescribed below by using a flowchart.Fig. 11 is a flowchart showing an example of the processexecuted by the control device in the second embodiment. At thetime point of starting the process of Fig. 11, the output device300 is outputting content.

[0062] (Step S21) The acquisition unit 120a acquires the imagefrom the camera 200.(Step S22) The control unit 130a detects a people count asthe number of people viewing the content based on the image. Forexample, the control unit 130a detects the people count based onthe direction of the face of each person included in the image orthe line of sight of each person included in the image.It is also possible for the control unit 130a to detectthe people count by subtracting the number of people not viewingthe content from the total number of people in the image.

[0063] (Step S23) The control unit 130a calculates the visualrecognition rate based on the detected people count and the totalnumber of people in the image.(Step S24) The control unit 130a judges whether or not thecalculated visual recognition rate is lower than thepredetermined threshold value. Incidentally, the threshold valuecan also be a visual recognition rate measured in the past, forexample.If the visual recognition rate is lower than the thresholdvalue, the process advances to step S25. If the visualrecognition rate is higher than or equal to the threshold value,the process ends.

[0064] (Step S25) The control unit 130a executes control forchanging the currently outputted content to different content.For example, the control unit 130a transmits the differentcontent and an output command for the different content to theoutput device 300. Accordingly, the content outputted to theoutput device 300 is changed.

[0065] Further, the acquisition unit 120a may acquire themanagement table 111. The management table 111 indicates acorrespondence relationship between the currently outputtedinformation and the dissimilar information. Then, the controlunit 130a may identify the dissimilar information based on thecurrently outputted information and the management table 111 andexecute the control for changing the currently outputtedinformation to the dissimilar information. For example, thecontrol unit 130a identifies the dissimilar content based on thecurrently outputted content and the management table 111. Thecontrol unit 130a executes the control for changing the currentlyoutputted content to the dissimilar content.

[0066] Here, for example, when the visual recognition rate islower than the threshold value, it can be considered that peopleare not viewing the content since the people have got accustomedto the content. That is, it can be considered that the peoplehave got accustomed to the stimulus by visual sensation.Therefore, when the visual recognition rate is lower than thethreshold value, the control device 100a executes the control forchanging the currently outputted content to different content.In other words, the control device 100a executes control forchanging the stimulus by visual sensation. By doing this, peoplebegin to view the content. Accordingly, the control device 100ais capable of making people respond to a stimulus.

[0067] First Modification of Second EmbodimentIn the second embodiment, the description has given of thecase where an image is acquired. In a first modification of thesecond embodiment, a description will be given of a case where avideo is acquired.

[0068] Fig. 12 is a flowchart showing an example of a processexecuted by a control device in the first modification of thesecond embodiment. The process in Fig. 12 differs from theprocess in Fig. 11 in that steps S21a, S22a and S23a areexecuted. Thus, the steps S21a, S22a and S23a in Fig. 12 will bedescribed below. Then, the description will be omitted forprocessing other than the steps S21a, S22a and S23a.

[0069] (Step S21a) The acquisition unit 120a acquires a videofrom the camera 200. For example, the acquisition unit 120aacquires the video from the camera 200. The acquisition unit120a may also acquire the video from a device other than thecamera 200. The video is a video obtained by the camera 200 byperforming the image capturing for a predetermined time. Thetime is one minute, for example.

[0070] (Step S22a) The control unit 130a detects a people countas the number of people viewing the content for a predeterminedtime based on the video. For example, the control unit 130adetects the people count as the number of people viewing thecontent for three seconds among the people included in the video.(Step S23a) The control unit 130a calculates the visualrecognition rate based on the detected people count and theactual number of people included in the video.It is also possible for the control unit 130a to calculatean average value of a plurality of visual recognition rates,respectively obtained by calculation based on each of a pluralityof images as the video, as the visual recognition rate.

[0071] According to the first modification of the secondembodiment, the control device 100a is capable of making peoplerespond to a stimulus.

[0072] Second Modification of Second EmbodimentIn a second modification of the second embodiment, adescription will be given of a case where the threshold value ischanged based on the user attribute. When the threshold value ischanged, a threshold value table is used. An example of thethreshold value table will be shown below.

[0073] Fig. 13 is a diagram showing an example of the thresholdvalue table in the second modification of the second embodiment.The threshold value table 112a may be stored in the storage unit110a. The threshold value table 112a is referred to also asthreshold value information. The threshold value table 112aincludes items of user attribute and threshold value.In the item of user attribute, information indicating theuser attribute is registered. In the item of threshold value,information regarding the threshold value is registered.

[0074] The threshold value table 112a is acquired by theacquisition unit 120a. For example, the acquisition unit 120aacquires the threshold value table 112a from the storage unit110a. Here, the threshold value table 112a may be stored in anexternal device. In the case where the threshold value table112a is stored in an external device, the acquisition unit 120aacquires the threshold value table 112a from the external device.

[0075] Next, a process executed by the control device 100a will bedescribed below by using a flowchart.Fig. 14 is a flowchart showing an example of the processexecuted by the control device in the second modification of thesecond embodiment. The process in Fig. 14 differs from theprocess in Fig. 11 in that steps S23b and S24b are executed.Thus, the steps S23b and S24b in Fig. 14 will be described below.Then, the description will be omitted for processing other thanthe steps S23b and S24b.

[0076] (Step S23b) The control unit 130a identifies a userattribute as an attribute of a person included in the image basedon the image. Specifically, the control unit 130a identifies theuser attribute by using the image and the image recognitiontechnology. For example, based on the image, the control unit130a identifies that the age of a person existing in the image is"60 years old".The control unit 130a identifies the threshold valuecorresponding to the user attribute based on the threshold valuetable 112a. For example, the control unit 130a identifies thethreshold value "Th2" corresponding to "60 years old" based onthe threshold value table 112a.The control unit 130a changes the predetermined thresholdvalue to the threshold value corresponding to the user attribute.

[0077] (Step S24b) The control unit 130a judges whether or notthe calculated visual recognition rate is lower than thethreshold value corresponding to the user attribute.If the visual recognition rate is lower than the thresholdvalue, the process advances to step S25. If the visualrecognition rate is higher than or equal to the threshold value,the process ends.

[0078] While the above description has given of the case where thethreshold value is changed when an image is acquired, thethreshold value may also be changed when a video is acquired.

[0079] According to the second modification of the secondembodiment, the control device 100a is capable of making ajudgment dependent on the attribute of a person included in theimage or video by making the judgment by using the thresholdvalue corresponding to the user attribute.

[0080] Third EmbodimentNext, a third embodiment will be described below. In thethird embodiment, the description will be given mainly offeatures different from those in the first or second embodiment.In the third embodiment, the description is omitted for featuresin common with the first or second embodiment. In the thirdembodiment, the output device 300 is a display device or aprojector.

[0081] Fig. 15 is a block diagram showing functions of a controldevice in the third embodiment. The control device 100b includesa storage unit 110b, an acquisition unit 120b and a control unit130b.

[0082] The storage unit 110b may be implemented as a storage areareserved in the volatile storage device 102 or the nonvolatilestorage device 103.Part or all of the acquisition unit 120b and the controlunit 130b may be implemented by processing circuitry. Further,part or all of the acquisition unit 120b and the control unit130b may be implemented as modules of a program executed by theprocessor 101. For example, the program executed by theprocessor 101 is referred to also as a control program. Thecontrol program has been recorded in a record medium, forexample.The functions of the acquisition unit 120b and the controlunit 130b will be described in detail later.

[0083] Next, a process executed by the control device 100b will bedescribed below by using a flowchart.Fig. 16 is a flowchart showing an example of the processexecuted by the control device in the third embodiment. At thetime point of starting the process of Fig. 16, the output device300 is outputting content. Further, as shown in Fig. 1 2, aplurality of people are existed in a place where movement in aplurality of directions is possible.

[0084] (Step S31) The acquisition unit 120b acquires a videoobtained by the camera 200 by capturing images of a plurality ofpeople.(Step S32) The control unit 130b detects the people countas the number of people viewing the content for a predeterminedtime based on the video. For example, the control unit 130bdetects the people count as the number of people viewing thecontent for three seconds among the people included in the video.

[0085] (Step S33) The control unit 130b calculates the visualrecognition rate based on the detected people count and theactual number of people included in the video.It is also possible for the control unit 130b to calculatethe average value of a plurality of visual recognition rates,respectively obtained by calculation based on each of a pluralityof images as the video, as the visual recognition rate.(Step S34) The control unit 130b judges whether or not thecalculated visual recognition rate is lower than thepredetermined threshold value.If the visual recognition rate is lower than the thresholdvalue, the process advances to step S35. If the visualrecognition rate is higher than or equal to the threshold value,the process ends.

[0086] (Step S35) The control unit 130b detects the moving peoplecount as the number of people who moved in the first directionamong the plurality of directions based on the video. Here, thefirst direction is the leftward direction, for example.(Step S36) The control unit 130b calculates the ratio ofthe people who moved in the first direction by using the movingpeople count.

[0087] (Step S37) The control unit 130b judges whether or not theratio is less than the predetermined threshold value.If the ratio is less than the threshold value, the processadvances to step S38. If the ratio is higher than or equal tothe threshold value, the process ends.(Step S38) The control unit 130b executes the control forchanging the information currently outputted by the output device300 to different information. Specifically, the control unit130b executes control for changing the currently outputtedcontent to different content.

[0088] It is also possible for the control unit 130b to executethe control for changing the information currently outputted bythe output device 300 to different information when the visualrecognition rate is higher than or equal to the threshold valueand the ratio is less than the threshold value.

[0089] According to the third embodiment, the control device 100bjudges whether the content should be changed or not by using thevisual recognition rate and the ratio based on the moving peoplecount. Therefore, the control device 100b is capable of giving astimulus by visual sensation depending on detailed conditions ofthe people existing in the video.

[0090] Further, in the second and third embodiments, thedescription has given of the cases where the control for changingthe information (e.g., content) currently outputted by the outputdevice 300 to different information is executed. The controlregarding the sound, wind, smell or illumination may also beexecuted similarly to the first modification of the firstembodiment. The control will be described in detail below. Thecontrol device 100b communicates with a display device thatdisplays information (e.g., content). Further, the controldevice 100b controls an output device that outputs a stimulus(e.g., sound, wind, smell or illumination). Incidentally, theoutput device is installed in the vicinity of the display device.Further, the output device may be arranged at a fixed position inthe vicinity of the display device. The control unit 130bcalculates a visual recognition rate, as a ratio at which theinformation displayed by the display device is visuallyrecognized thanks to the stimulus outputted by the output device,based on the image or video acquired by the acquisition unit120b. When the visual recognition rate is lower than apredetermined threshold value, the control unit 130b executescontrol for changing the stimulus currently outputted by theoutput device to a different stimulus. For example, the controlunit 130b executes control for changing sound currently outputtedby the output device to sound that prompts the people to view thedisplay device more. As above, the visual recognition rate isincreased by changing the stimulus outputted by the outputdevice.

[0091] Furthermore, the management table 111 acquired by theacquisition unit 120b may indicate a correspondence relationshipbetween the currently outputted stimulus and a dissimilarstimulus. Then, the dissimilar stimulus may be identified basedon the management table 111.

[0092] In the first to third embodiments, the output device 300may be included in the control device 100, 100a, 100b. Forexample, the control device 100, 100a, 100b includes a displaydevice or a projector. In cases where the output device 300 is adisplay device, the control unit 130 executes control foroutputting content different from the content currently outputtedby the display device to the display device.

[0093] Fourth EmbodimentNext, a fourth embodiment will be described below. In thefourth embodiment, the description will be given mainly offeatures different from those in the second embodiment. In thefourth embodiment, the description is omitted for features incommon with the second embodiment.

[0094] Fig. 17 is a diagram showing a control system in the fourthembodiment. The control system includes a control device 400, acamera 500, an output device 510, a camera 600 and an outputdevice 610.The camera 500 is referred to also as a first imagecapturing device. The output device 510 is referred to also as afirst output device. The camera 600 is referred to also as asecond image capturing device. The output device 610 is referredto also as a second output device. Each of the output device 510and the output device 610 is a display device or a projector.The control device 400, the camera 500, the output device510, the camera 600 and the output device 610 are connectedtogether via a network.

[0095] The camera 500 and the output device 510 are installed at afirst spot. The camera 600 and the output device 610 areinstalled at a second spot. The second spot is a spot after thefirst spot. For example, when a person passes through the secondspot subsequently to the first spot, the person views the contentoutputted by the output device 610 after viewing the contentoutputted by the output device 510.The control device 400 manages the content outputted by theoutput device 510 and the content outputted by the output device610.

[0096] Next, a process executed in the control system will bedescribed below by using a sequence diagram.Fig. 18 is a sequence diagram showing an example of theprocess executed in the control system in the fourth embodiment.(Step ST111) The camera 500 transmits an image obtained bycapturing an image of a plurality of people to the control device400.

[0097] (Step ST112) The control device 400 calculates the visualrecognition rate by using the image. The calculation method ofthe visual recognition rate is the same as the calculation methodof the visual recognition rate in the second embodiment. Thecontrol device 400 judges that the visual recognition rate islower than a predetermined threshold value. Incidentally, thisvisual recognition rate is referred to also as a first visualrecognition rate.

[0098] (Step ST113) The camera 600 transmits an image obtained bycapturing an image of a plurality of people to the control device400.(Step ST114) The control device 400 calculates the visualrecognition rate by using the image. The calculation method ofthe visual recognition rate is the same as the calculation methodof the visual recognition rate in the second embodiment. Thecontrol device 400 judges that the visual recognition rate islower than a predetermined threshold value. Incidentally, thisvisual recognition rate is referred to also as a second visualrecognition rate.

[0099] (Step ST115) If the visual recognition rate is low at thefirst spot and the visual recognition rate is low at the secondspot, the control device 400 executes control for making theoutput device 610 output content different from content currentlyoutputted by the output device 510. Specifically, the controldevice 400 transmits the different content and an output commandfor the different content to the output device 610.Accordingly, the different content is outputted to theoutput device 610.

[0100] The above description has given of the case where thevisual recognition rates are calculated by using images. It isalso possible for the control device 400 to calculate the visualrecognition rates by using videos transmitted by the camera 500and the camera 600. Incidentally, the calculation method of thevisual recognition rate is the same as the calculation method ofthe visual recognition rate in the first modification of thesecond embodiment.

[0101] According to the fourth embodiment, the control system iscapable of making people respond to a stimulus.

[0102] It is also possible for the control device 400 to executecontrol for making the output device 610 output informationdifferent from information currently outputted by the outputdevice 510 when the first visual recognition rate is lower thanthe predetermined threshold value. By this control, even when aperson did not view the content at the first spot, the personbecomes likely to view the content at the second spot. Thus,according to the fourth embodiment, the control system is capableof making people respond to a stimulus.

[0103] Fifth EmbodimentNext, a fifth embodiment will be described below. In thefifth embodiment, the description will be given mainly offeatures different from those in the second or fourth embodiment.In the fifth embodiment, the description is omitted for featuresin common with the second or fourth embodiment.In the fourth embodiment, the description has given of thecase where one control device is included in the control system.In the fifth embodiment, a description will be given of a casewhere two control devices are included in a control system.

[0104] Fig. 19 is a diagram showing the control system in thefifth embodiment. The control system includes a control device700, a control device 800, the camera 500, the output device 510,the camera 600 and the output device 610.The control device 700 and the control device 800 areconnected to each other via a network. The control device 700 isreferred to also as a first control device. The control device800 is referred to also as a second control device.

[0105] The control device 700, the camera 500 and the outputdevice 510 are connected together by a network. The controldevice 700 is a device that controls the camera 500 and theoutput device 510. The control device 700 manages information tobe outputted by the output device 510.The control device 800, the camera 600 and the outputdevice 610 are connected together by a network. The controldevice 800 is a device that controls the camera 600 and theoutput device 610. The control device 800 manages information tobe outputted by the output device 610.

[0106] Next, a process executed in the control system will bedescribed below by using a sequence diagram.Fig. 20 is a sequence diagram showing an example of theprocess executed in the control system in the fifth embodiment.(Step ST121) The camera 500 transmits an image obtained bycapturing an image of a plurality of people to the control device700.(Step ST122) The control device 700 calculates the visualrecognition rate by using the image. The calculation method ofthe visual recognition rate is the same as the calculation methodof the visual recognition rate in the second embodiment. Thecontrol device 700 judges that the visual recognition rate islower than a predetermined threshold value. Incidentally, thisvisual recognition rate is referred to also as a first visualrecognition rate.

[0107] (Step ST123) The control device 700 notifies the controldevice 800 that the visual recognition rate is low at the firstspot.(Step ST124) The camera 600 transmits an image obtained bycapturing an image of a plurality of people to the control device800.

[0108] (Step ST125) The control device 800 calculates the visualrecognition rate by using the image. The calculation method ofthe visual recognition rate is the same as the calculation methodof the visual recognition rate in the second embodiment. Thecontrol device 800 judges that the visual recognition rate islow. Incidentally, this visual recognition rate is referred toalso as a second visual recognition rate.(Step ST126) The control device 800 transmits atransmission request, requesting transmission of informationregarding the content currently outputted by the output device510, to the control device 700.

[0109] (Step ST127) The control device 700 transmits theinformation regarding the content currently outputted by theoutput device 510 to the control device 800.(Step ST128) The control device 800 executes control formaking the output device 610 output content different from thecontent currently outputted by the output device 510.Specifically, the control device 800 transmits the differentcontent and an output command for the different content to theoutput device 610.Accordingly, the different content is outputted to theoutput device 610.

[0110] The above description has given of the case where thevisual recognition rate is calculated by using an image. It isalso possible for the control device 700 to calculate the visualrecognition rate by using a video transmitted by the camera 500.It is also possible for the control device 800 to calculate thevisual recognition rate by using a video transmitted by thecamera 600. Incidentally, the calculation method of the visualrecognition rate is the same as the calculation method of thevisual recognition rate in the first modification of the secondembodiment.

[0111] According to the fifth embodiment, the control system iscapable of making people respond to a stimulus similarly to thefourth embodiment.

[0112] It is also possible for the control device 800 to transmita transmission request, requesting transmission of informationcurrently outputted by the output device 510, to the controldevice 700, when the first visual recognition rate is lower thanthe threshold value. By this, even when a person did not viewthe content at the first spot, the person becomes likely to viewthe content at the second spot. Thus, according to the fifthembodiment, the control system is capable of making peoplerespond to a stimulus.

[0113] The control device in any one of the first to fifthembodiments may also include at least one of a camera and anoutput device (e.g., display). Further, the functions of thecontrol device in any one of the first to fifth embodiments maybe implemented in a form of being distributed to a plurality ofdevices such as an input device like a camera, an output devicelike a display, and so forth. Furthermore, the control devicemay include a plurality of devices such as a camera and an outputdevice as mentioned above.

[0114] Features in the embodiments described above can beappropriately combined with each other.DESCRIPTION OF REFERENCE CHARACTERS

[0115] 100: control device, 100a: control device, 100b: controldevice, 101: processor, 102: volatile storage device, 103:nonvolatile storage device, 110: storage unit, 110a: storageunit, 110b: storage unit, 111: management table, 112: thresholdvalue table, 112a: threshold value table, 120: acquisition unit,120a: acquisition unit, 120b: acquisition unit, 130: controlunit, 130a: control unit, 130b: control unit, 200: camera, 300:output device, 400: control device, 500: camera, 510: outputdevice, 600: camera, 610: output device, 700: control device,800: control device.

Claims

1. A control device (100) for controlling an output device(300) that outputs a stimulus, the control device comprising: an acquisition unit (120) that acquires a video obtained by an image capturing device (200) by capturing images of a plurality of people existed in a place where movement in a plurality of directions is possible; and a control unit (130) that detects a moving people count as a number of people who moved in a first direction among the plurality of directions based on the video, calculates a ratio of the people who moved in the first direction by using the moving people count, and when a situation where the ratio is less than a predetermined threshold value is continuing for a predetermined set time, executes control for changing the stimulus currently outputted by the output device (300) to a different stimulus.

2. The control device according to claim 1, wherein the acquisition unit (120) acquires management information (111) that indicates a correspondence relationship between the currently outputted stimulus and a dissimilar stimulus having a same attribute as the currently outputted stimulus and dissimilar to the currently outputted stimulus, and the control unit (130) identifies the dissimilar stimulus based on the currently outputted stimulus and the management information (111) and executes control for changing the currently outputted stimulus to the dissimilar stimulus.

3. The control device according to claim 1 or 2, wherein the acquisition unit (120) acquires threshold value information (112), the control unit (130) identifies a user attribute as an attribute of a person included in the video based on the video and identifies a threshold value corresponding to the user attribute based on the threshold value information (112), and the predetermined threshold value is the identified threshold value.

4. The control device according to claim 1 or 2, wherein when the output device (300) is a display device, the control unit (130) executes control for changing content currently outputted by the display device to different content.

5. The control device according to claim 1 or 2, wherein when the output device (300) is a speaker, the control unit (130) executes control for changing sound currently outputted by the speaker to different sound.

6. The control device according to claim 1 or 2, wherein when the output device (300) is an air conditioner, the control unit (130) executes at least one of control for changing a direction of air currently outputted by the air conditioner to a different direction and control for changing wind power of the air conditioner.

7. The control device according to claim 1 or 2, wherein when the output device (300) is a smell generator, the control unit (130) executes control for changing a smell currently outputted by the smell generator to a different smell.

8. The control device according to claim 1 or 2, wherein when the output device (300) is a projector, the control unit (130) executes control for changing information currently outputted by the projector to different information.

9. The control device according to claim 1 or 2, wherein when the output device (300) is an illuminator, the control unit (130) executes control for changing illuminance, illumination color or an illumination angle of light currently outputted by the illuminator.

10. The control device according to claim 1 or 2, wherein when the output device (300) is a display device or a projector, the control device further comprises the display device or the projector.

11. A control device for controlling an output device (300) that outputs a stimulus, the control device (100a) comprising: an acquisition unit (120a) that acquires an image or a video obtained by an image capturing device (200) by capturing one or more images of a plurality of people and acquires management information (111) that indicates a correspondence relationship between a currently outputted stimulus and a dissimilar stimulus; and a control unit (130a) that calculates a visual recognition rate regarding the information currently outputted by the output device (300) based on the image or the video, when the visual recognition rate is lower than a predetermined threshold value, identifies the dissimilar stimulus based on the currently outputted stimulus and the management information (111) and executes control for changing the currently outputted stimulus to the dissimilar stimulus.

12. The control device according to claim 11, wherein the acquisition unit (120a) acquires threshold value information (112a), the control unit (130a) identifies a user attribute as an attribute of a person included in the image or the video based on the image or the video and identifies a threshold value corresponding to the user attribute based on the threshold value information (112a), and the predetermined threshold value is the identified threshold value.

13. The control device according to claim 11 or 12, wherein the plurality of people are existed in a place where movement in a plurality of directions is possible, and when the visual recognition rate based on the video is lower than the threshold value, the control unit (130b) detects a moving people count as a number of people who moved in a first direction among the plurality of directions based on the video, calculates a ratio of the people who moved in the first direction by using the moving people count, and when the ratio is less than a predetermined threshold value, executes control for changing the currently outputted stimulus to the dissimilar stimulus.

14. The control device according to claim 11 or 12, wherein the plurality of people are existed in a place where movement in a plurality of directions is possible, and when the visual recognition rate based on the video is higher than or equal to the threshold value, the control unit (130b) detects a moving people count as a number of people who moved in a first direction among the plurality of directions based on the video, calculates a ratio of the people who moved in the first direction by using the moving people count, and when the ratio is less than a predetermined threshold value, executes control for changing the currently outputted stimulus to the dissimilar stimulus.

15. A control device (100a,100b) for communicating with a display device that displays information and controlling an output device that outputs a stimulus, the control device (100a,100b) comprising: an acquisition unit (120a,120b) that acquires an image or a video obtained by an image capturing device (200) by capturing one or more images of a plurality of people; and a control unit (130a,130b) that calculates a visual recognition rate, as a ratio at which the information displayed by the display device is visually recognized due to the stimulus outputted by the output device, based on the image or the video, and when the visual recognition rate is lower than a predetermined threshold value, executes control for changing the stimulus currently outputted by the output device to a different stimulus without changing the information displayed by the display device.

16. The control device according to claim 15, wherein when the output device is a speaker, the control unit (130a,130b) executes control for changing sound currently outputted by the speaker to different sound.

17. The control device according to claim 15, wherein when the output device is an air conditioner, the control unit (130a,130b) executes at least one of control for changing a direction of air currently outputted by the air conditioner to a different direction and control for changing wind power of the air conditioner.

18. The control device according to claim 15, wherein when the output device is a smell generator, the control unit (130a,130b) executes control for changing a smell currently outputted by the smell generator to a different smell.

19. The control device according to claim 15, wherein when the output device is an illuminator, the control unit (130a,130b) executes control for changing illuminance, illumination color or an illumination angle of light currently outputted by the illuminator.

20. A control system comprising: an image capturing device (200); and a control device (100) for controlling an output device (300) that outputs a stimulus, wherein the control device (100) includes: an acquisition unit (120) that acquires a video obtained by the image capturing device (200) by capturing images of a plurality of people existed in a place where movement in a plurality of directions is possible; and a control unit (130) that detects a moving people count as a number of people who moved in a first direction among the plurality of directions based on the video, calculates a ratio of the people who moved in the first direction by using the moving people count, and when a situation where the ratio is less than a predetermined threshold value is continuing for a predetermined set time, executes control for changing the stimulus currently outputted by the output device (300) to a different stimulus.

21. A control system comprising: a first image capturing device (500) that is installed at a first spot and transmits an image or a video obtained by capturing one or more images of a plurality of people; a first output device (510) that is installed at the first spot; a second output device (610) that is installed at a second spot as a spot after the first spot; a control device (400) that manages information to be outputted by the first output device (510); and a second image capturing device (600) that is installed at the second spot and transmits an image or a video obtained by capturing one or more images of a plurality of people, wherein the control device (400) calculates a first visual recognition rate regarding information currently outputted by the first output device (510) based on the image or the video received from the first image capturing device (500), calculates a second visual recognition rate regarding information currently outputted by the second output device (610) based on the image or the video received from the second image capturing device (600), and when the first visual recognition rate and the second visual recognition rate are lower than a predetermined threshold value, executes control for making the second output device (610) output information different from the information currently outputted by the first output device (510).

22. A control system comprising: a first image capturing device (500) that is installed at a first spot and transmits an image or a video obtained by capturing one or more images of a plurality of people; a first output device (510) that is installed at the first spot; a first control device (700) that manages information to be outputted by the first output device (510); a second output device (610) that is installed at a second spot as a spot after the first spot; and a second control device (800), wherein the first control device (700) calculates a first visual recognition rate regarding information currently outputted by the first output device (510) based on the image or the video received from the first image capturing device (500), and when the first visual recognition rate is lower than a predetermined threshold value, notifies the second control device (800) that the first visual recognition rate is lower than the threshold value, when the first visual recognition rate is lower than the threshold value, the second control device (800) transmits a transmission request, requesting transmission of the information currently outputted by the first output device (510), to the first control device (700), the first control device (700) receiving the transmission request transmits the information currently outputted by the first output device (510) to the second control device (800), and the second control device (800) receiving the information currently outputted by the first output device (510) executes control for making the second output device (610) output information different from the information currently outputted by the first output device.

23. The control system according to claim 22, further comprising a second image capturing device (600) that is installed at the second spot, wherein the second control device (800) calculates a second visual recognition rate regarding information currently outputted by the second output device (610) based on an image or a video received from the second image capturing device (600), and when the first visual recognition rate and the second visual recognition rate are lower than the threshold value, transmits the transmission request to the first control device (700).

24. A control method performed by a control device (100) for controlling an output device (300) that outputs a stimulus, the control method comprising: acquiring a video obtained by an image capturing device (200) by capturing images of a plurality of people existed in a place where movement in a plurality of directions is possible; detecting a moving people count as a number of people who moved in a first direction among the plurality of directions based on the video; calculating a ratio of the people who moved in the first direction by using the moving people count; and when a situation where the ratio is less than a predetermined threshold value is continuing for a predetermined set time, executing control for changing the stimulus currently outputted by the output device (300) to a different stimulus.

25. A control method performed by a control device (100a,100b) for communicating with a display device that displays information and controlling an output device that outputs a stimulus, the control method comprising: acquiring an image or a video obtained by an image capturing device by capturing one or more images of a plurality of people; calculating a visual recognition rate, as a ratio at which the information displayed by the display device is visually recognized thanks to the stimulus outputted by the output device, based on the image or the video; and when the visual recognition rate is lower than a predetermined threshold value, executing control for changing the stimulus currently outputted by the output device to a different stimulus without changing the information displayed by the display device.