Control System

Abstract

To appropriately manage the behavior of users using facilities.SOLUTION: A control system according to an embodiment includes an acquisition unit, an identification unit, and an association unit. The acquisition unit acquires attribute information of users using a facility. The identification unit identifies a behavioral state of a user from sensing data in the facility. The association unit associates the behavioral state identified by the identification unit with attribute information acquired by the acquisition unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a control system. [Background technology]

[0002] Conventionally, there are lighting devices with cameras that are installed in facilities, etc. In the field of such lighting devices with cameras, for example, a technology has been proposed for managing inventory of stockpiles and the like using images captured by a camera inside a warehouse (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-54541 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the prior art, for example, proper management of the behavior of users who use the facility has not been taken into consideration.

[0005] The present invention has been made in view of the above, and has an object to provide a control system that can appropriately manage the behavior of users who use a facility. [Means for solving the problem]

[0006] A control system according to an embodiment includes an acquisition unit, an identification unit, and an association unit. The acquisition unit acquires attribute information of users who use a facility. The identification unit identifies the behavioral status of the users from sensing data within the facility. The association unit associates the attribute information acquired by the acquisition unit with the behavioral status identified by the identification unit. [Effects of the Invention]

[0007] According to the present invention, the behavior of users who use a facility can be appropriately managed. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an overview of the control system. [Figure 2] FIG. 2 is a block diagram of the information processing device. [Figure 3] FIG. 3 is a diagram illustrating an example of the behavior information DB. [Figure 4] FIG. 4 is a diagram showing an example of the facility information DB. [Figure 5] FIG. 5 is a flowchart showing a processing procedure executed by the server device. DETAILED DESCRIPTION OF THE INVENTION

[0009] The control system 1 according to the embodiment described below includes an acquisition unit 121 that acquires attribute information of a user U who uses the facility Sc, an identification unit 122 that identifies the behavioral status of the user U from sensing data within the facility Sc, and an association unit 123 that associates the attribute information acquired by the acquisition unit 121 with the behavioral status identified by the identification unit 122.

[0010] Furthermore, the control system 1 according to the embodiment described below includes a lighting unit 51 that changes the lighting mode in the facility Sc in accordance with the attribute information of the user U.

[0011] In the control system 1 according to the embodiment described below, the acquisition unit 121 acquires attribute information stored in the user terminal 100 of the user U through data communication with the user terminal 100.

[0012] Furthermore, in the control system 1 according to the embodiment described below, the acquisition unit 121 acquires information on whether or not the user U has been vaccinated as attribute information.

[0013] In the control system 1 according to the embodiment described below, the identification unit 122 identifies the degree of crowding of users U within the facility Sc as the behavioral situation.

[0014] Furthermore, the control system 1 according to the embodiment described below includes a generating unit 124 that generates a report in which the behavioral situation is weighted according to the attribute information, based on the processing result by the associating unit 123.

[0015] Hereinafter, a control system according to an embodiment will be described with reference to the drawings. The same components in the embodiments are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0016] First, an overview of a control system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an overview of the control system. As shown in Fig. 1, a control system 1 according to an embodiment includes a server device 10 and a plurality of lighting devices 50 installed in a facility Sc. Note that, although the following description will be given taking as an example a case where the facility Sc is a commercial facility, the facility Sc may also be any facility such as a school, factory, or office building.

[0017] The server device 10 is a processing device that analyzes camera images taken by a camera 52 of an illumination device 50 installed in the facility Sc, and analyzes the flow of people (hereinafter, referred to as people flow) within the facility Sc.

[0018] The lighting device 50 is installed on the ceiling of the facility Sc. As shown in FIG. 1, the lighting device 50 includes a lighting unit 51, a camera 52, and a communication unit 53. The lighting unit 51 includes a predetermined light source such as an LED (Light Emitting Diode) or a fluorescent lamp. The lighting unit 51 may also be an emergency light or a germicidal lamp.

[0019] Furthermore, camera 52 has a predetermined imaging element and captures, for example, an image of the floor surface from the ceiling of facility Sc. In this way, lighting device 50 is a lighting device with a camera that includes camera 52, and camera 52 can capture an overhead image of the inside of facility Sc.

[0020] Therefore, the camera 52 of the lighting device 50 can capture camera images with a bird's-eye view of the facility Sc, and the server device 10 can easily understand the behavior of each user U in the facility Sc by analyzing such camera images.

[0021] The communication unit 53 is a communication device for performing data communication with the user terminal 100 of the user U. For example, the user terminal 100 has an application (hereinafter simply referred to as an app) for performing data communication with the communication unit 53, and the communication unit 53 receives attribute information of the user U stored in the user terminal 100 by communicating with the app of the user terminal 100. In the following, a case will be described in which the attribute information is, for example, the presence or absence of a vaccine passport (described later), i.e., information regarding whether or not the user has been vaccinated. In addition, the attribute information may be, for example, information regarding the gender, age, etc. of the user U.

[0022] The attribute information may be information that can be identified from a camera image, such as whether a mask is being worn or the type of mask worn by the user U. The type of mask used here includes nonwoven masks, urethane masks, cloth masks, etc. Furthermore, the body temperature of the user U photographed by a thermographic camera may be used as attribute information.

[0023] In recent years, the spread of the novel coronavirus (COVID-19) has led to a decline in the use of commercial facilities by users U. In response to this, in order to prevent the spread of infection and restore economic activity, the issuance of vaccine passports to those who have been vaccinated against the novel coronavirus is being considered. Furthermore, for example, in addition to issuing vaccine passports on paper, it is also being considered to issue them as digital data to each user terminal 100.

[0024] For example, commercial facilities could implement campaigns using vaccine passports, such as offering certain benefits to users U who present their passports, which is expected to increase customer numbers while reducing the risk of infection spreading.

[0025] The control system 1 according to the embodiment proposes a new business model that combines vaccine passports and people flow analysis. For example, as shown in Fig. 1, first, the server device 10 acquires a camera image taken by the camera 52 from the lighting device 50 (step S1).

[0026] At this time, the server device 10 also acquires, for example, attribute information of the user U (information on whether or not the user has been vaccinated) that each lighting device 50 has acquired from the user terminal 100.

[0027] Next, the server device 10 analyzes the camera images to identify the behavioral status of the user U (step S2). The behavioral status here refers to, for example, the behavior of each user U within the facility Sc, and the server device 10 analyzes the camera images and tracks the user U to identify the behavior of the user U from the perspective of when and where the user U was.

[0028] In addition, the server device 10 can identify the behavioral status of each user U, thereby identifying the degree of crowding, such as whether or not the users U interact with each other.

[0029] Next, the server device 10 associates the information about the behavioral status of the user U with the attribute information of the user U (information about whether or not the user has been vaccinated) (step S3), and stores the information in the behavioral information DB.

[0030] Thereafter, for example, the server device 10 creates a report based on the information stored in the behavior information DB (step S4). For example, the server device 10 sets the priority of each user U according to the attribute information, and then generates the report.

[0031] For example, the server device 10 refers to the behavioral information DB, extracts other users U (e.g., close contacts) who may be infected because a virus-infected user U used the facility Sc, and generates a report.

[0032] At this time, the server device 10 may generate a report in which the priority of the user U is changed depending on whether or not the user has been vaccinated. This is because it is suggested that vaccinated people have a lower risk of developing serious symptoms than unvaccinated people.

[0033] That is, when generating a report for a public health center, the server device 10 may, for example, raise the priority of unvaccinated people, thereby urging the public health center to give priority to those who have not been vaccinated.

[0034] Furthermore, if the attribute information is the type of mask used by user U, the priority may be changed between users U wearing nonwoven masks and those wearing masks other than nonwoven masks or those not wearing masks at all. In this case, for example, a report on the presence or absence of crowding may be generated based on the behavioral status of users U, and if there are users U in the crowd who are wearing masks other than nonwoven masks or who are not wearing masks, a report may be generated that increases the priority of the corresponding users U.

[0035] Furthermore, if the attribute information is the body temperature of user U, a report may be generated that gives a higher priority to users U whose body temperature exceeds a predetermined threshold, i.e., users U who have come into contact with users U suspected of being infected with a virus.

[0036] Additionally, the server device 10 may generate a report on the proportion of vaccinated people among all users U, and notify the administrator of the facility Sc of the report.

[0037] In this way, the control system 1 according to the embodiment identifies the behavioral status of the user U in the facility Sc and associates the behavioral status with attribute information of the user U. Therefore, the control system 1 according to the embodiment appropriately manages the behavior of the user U who uses the facility Sc.

[0038] Furthermore, the control system 1 may be configured to cooperate with, for example, a POS (Point Of Sales System) system at each store in the facility Sc. That is, for example, the control system 1 may notify the store individually of whether or not a user U who uses each store has been vaccinated, thereby notifying the store of whether or not a campaign utilizing a vaccine passport is applicable to the user U.

[0039] For example, the control system 1 may notify whether or not a user U has been vaccinated by changing the lighting mode of the lighting device 50 installed in each store within the facility Sc depending on whether or not the user U has been vaccinated.

[0040] This allows the facility Sc to easily distinguish between users U who have been vaccinated and users U who have not, allowing various services to be implemented, such as omitting temperature checks for vaccinated users U.

[0041] In this way, the control system 1 according to the embodiment can improve the convenience of the facility Sc by providing services in cooperation with the facility Sc.

[0042] Next, a configuration example of the server device 10 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram of the server device 10. As shown in Fig. 2, the server device 10 includes a communication unit 110, a control unit 120, and a storage unit 130.

[0043] The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 transmits and receives information to and from each lighting device 50, etc. via a network such as various wireless communication networks, including 4G (Generation), 5G, LTE (Long Term Evolution), WiFi (registered trademark), wireless LAN (Local Area Network), etc., or various wired communication networks.

[0044] The storage unit 130 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 130 also has a sensing data DB 131, a behavior information DB 132, and a facility information DB 133.

[0045] The sensing data DB 131 is a database that stores sensing data within the facility Sc. The sensing data here includes, for example, camera images taken by the camera 52 of each lighting device 50, as well as carbon dioxide concentration and the body temperature of each user U detected by a thermographic camera. For example, the sensing data DB 131 stores the sensing data in association with information about the location and time at which the sensing was performed.

[0046] The behavior information DB 132 is a database that stores information about the behavior of each user U. Fig. 3 is a diagram showing an example of the behavior information DB 132. In the example shown in Fig. 3, the behavior information DB 132 stores information on items such as "user ID," "vaccination," and "behavior information" in association with each other.

[0047] "User ID" is an identifier for identifying each user U. "Vaccination" indicates whether or not the user U identified by the corresponding "User ID" has been vaccinated; for example, "1" is stored for a user U who has been vaccinated, and "0" is stored for a user U who has not been vaccinated.

[0048] The "behavior information" is information indicating the behavior of a user U identified by a corresponding "user ID" within the facility Sc. For example, the server device 10 adds information on a newly identified behavior to the "behavior information" as the behavioral situation of the user U is identified.

[0049] For example, if information about user U can be obtained along with the vaccine passport, such information may be associated with the "user ID" and stored in behavioral information DB 132. Note that the information about user U here may include, for example, user U's name, age, contact information, etc.

[0050] Returning to the explanation of Fig. 2, the following will explain the facility information DB 133. The facility information DB 133 is a database that stores various information related to facilities. Fig. 4 is a diagram showing an example of the facility information DB 133.

[0051] 4, the facility information DB 133 stores information on items such as "area ID," "last sterilization time," and "crowding history" in association with one another. The "area ID" is an identifier for identifying each area within the facility Sc.

[0052] The "last sterilization time" indicates the most recent time when the area identified by the corresponding "area ID" was sterilized. The "crowding history" is a history of the degree of crowding of users U (including personnel related to the facility Sc (store staff)) identified in the area identified by the corresponding "area ID."

[0053] Returning to the explanation of Fig. 2, the control unit 120 will be described. The control unit 120 is, for example, a controller, and is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like, executing various programs stored in a storage device inside the server device 10 using RAM as a working area.

[0054] 2, the control unit 120 includes an acquisition unit 121, an identification unit 122, an association unit 123, a generation unit 124, and an illumination control unit 125. The acquisition unit 121 acquires attribute information of a user U who uses the facility Sc.

[0055] For example, the acquisition unit 121 acquires information about the vaccine passport as attribute information from the user terminal 100 of the user U via the communication unit 53 (see FIG. 3) of the lighting device 50. For example, when the user U enters the facility Sc, the user terminal 100 may read a QR code (registered trademark) installed at the entrance, whereby information about the vaccine passport is transmitted from the user terminal 100 to the server device 10, and the acquisition unit 121 may acquire such information.

[0056] The acquisition unit 121 passes attribute information regarding whether each user U has been vaccinated to the association unit 123. The acquisition unit 121 also acquires sensing data within the facility Sc and stores it in the sensing data DB131.

[0057] At this time, for example, the acquiring unit 121 may acquire information about the body temperature of the user U from the sensing data as attribute information and pass it to the associating unit 123. Furthermore, the acquiring unit 121 may analyze, for example, a camera image from the sensing data, identify whether the user U is wearing a mask and the type of mask they are wearing, and acquire this as attribute information.

[0058] The identification unit 122 identifies the behavioral status of each user U from the sensing data within the facility Sc. For example, the identification unit 122 identifies the behavioral status of each user U by tracking each user U using camera images captured by the multiple cameras 52.

[0059] That is, the identification unit 122 virtually stitches together camera images from cameras 52 with adjacent imaging ranges to track the behavior of the user U across imaging ranges. This makes it possible to manage, for example, a series of movement histories of the user U from when he enters the facility Sc to when he leaves, using a single trajectory. For example, the identification unit 122 can manage the user U with a single user ID by writing the identified behavioral situation into the behavior information DB 132 each time the behavioral situation of the user U is identified.

[0060] Furthermore, for example, the identification unit 122 may identify the density according to the distribution status of each user U and write it in the "density history" field of the facility information DB 133. Additionally, for example, the identification unit 122 may identify whether or not sterilization work has been performed in each area from camera images and update the "final sterilization time" in the facility information DB 133. Note that the "final sterilization time" may be updated based on information entered by, for example, a store employee or a cleaning worker of the facility Sc. Note that the "final sterilization time" may be replaced with the "final cleaning time."

[0061] The associating unit 123 associates the attribute information acquired by the acquiring unit 121 with the behavioral situation identified by the identifying unit 122. For example, the associating unit 123 associates the attribute information with the behavioral situation by writing the attribute information received from the acquiring unit 121 into the "vaccination" item of the user U identified by the corresponding user ID in the behavioral information DB 132.

[0062] The generation unit 124 generates a report on the behavioral status of the user U based on the association result by the association unit 123. For example, the generation unit 124 generates a report by prioritizing unvaccinated users U among users U who satisfy predetermined conditions.

[0063] For example, based on instructions from a public health center, the generation unit 124 generates a report based on the behavioral history of a user U infected with a virus, including information on whether or not there are so-called close contacts, information on a list of close contacts, etc.

[0064] For example, the generation unit 124 generates a report by prioritizing unvaccinated users among users U in a crowded area identified using camera images. Furthermore, if there are users U wearing masks other than nonwoven masks among the crowded users U, the generation unit 124 may generate a report by prioritizing the users U who make up the crowded area. In other words, for example, for a crowded area where all users U are wearing nonwoven masks, the risk of infection is relatively low, so the priority of the report is lowered.

[0065] Furthermore, for example, a report may be generated based on the body temperature information of each user U, prioritizing users U whose body temperature exceeds a predetermined value, i.e., users U who have come into contact with users U suspected of being infected with a virus. In this case, for example, the generation unit 124 may generate a report that reflects information such as whether each user U is wearing a mask, their body temperature, etc.

[0066] Furthermore, for example, the generation unit 124 may generate a report that associates information regarding whether or not each user U among close contacts has been vaccinated. This allows the public health center to prioritize unvaccinated people, who are considered to have a relatively higher risk of developing serious symptoms compared to vaccinated people.

[0067] In addition, the generation unit 124 generates a report on the attendance rate of vaccine passport-related events and the vaccine passport ownership rate, and notifies the facility Sc administrator. By referring to such a report, the facility Sc administrator can easily understand the cost-effectiveness of the event, etc. Note that the event attendance rate here is, for example, the ratio of attendance on days when the event is held to attendance on days when the event is not held.

[0068] For example, as described above, when the control system 1 cooperates with a POS system, information on sales results may be acquired from the POS system, and a report on sales results depending on whether an event has occurred may be generated.

[0069] Furthermore, for example, if the lighting device 50 has a germicidal lamp, the generation unit 124 may generate a sterilization schedule using the germicidal lamp. For example, the generation unit 124 generates a sterilization schedule using the germicidal lamp according to the association result by the association unit 12. For example, the generation unit 124 generates a sterilization schedule using the germicidal lamp according to the behavioral status of each user U and information on whether or not the user has been vaccinated.

[0070] In this case, for example, the generation unit 124 generates a sterilization schedule such that the irradiation time of the germicidal lamp is longer in areas that are used more frequently by unvaccinated persons, and instructs each lighting device 50 to operate according to the sterilization schedule. Also, for example, the generation unit 124 generates a sterilization schedule such that the irradiation time of the germicidal lamp is relatively shorter in areas that are used more frequently by vaccinated persons and less frequently by unvaccinated persons. In other words, in this case, the facility Sc can be appropriately sterilized by extending the irradiation time of the germicidal lamp in spaces where the possibility of the virus being spread or attached is higher.

[0071] The lighting control unit 125 controls the lighting units 51 in accordance with the attribute information of the user U. For example, the lighting control unit 125 controls each lighting unit 51 so that the lighting mode changes between a vaccinated person and an unvaccinated person.

[0072] Specifically, the lighting control unit 125 instructs the corresponding lighting unit 51 to change the lighting mode when a user U enters a specified area, for example, depending on the current location of each user U identified by the identification unit 122 and whether or not each user U has been vaccinated.

[0073] This allows personnel at the facility Sc to easily grasp the attribute information of each user U based on differences in lighting conditions.

[0074] Next, a processing procedure executed by the server device 10 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the processing procedure executed by the server device 10.

[0075] 5, first, the server device 10 acquires attribute information of a user U of the facility Sc (step S101). Next, the server device 10 identifies the behavioral status of the user U based on the sensing data (step S102).

[0076] Next, the server device 10 associates attribute information with the behavioral status of the user U (step S103). Next, the server device 10 sets a priority for each user U (step S104), generates a report on the behavioral status of the user U (step S105), and ends the process.

[0077] As described above, the control system 1 includes an acquisition unit 121, an identification unit 122, and an association unit 123. The acquisition unit 121 acquires attribute information of a user U who uses the facility Sc. The identification unit 122 identifies the behavioral status of the user U from sensing data within the facility. The association unit 123 associates the attribute information acquired by the acquisition unit 121 with the behavioral status identified by the identification unit 122. Therefore, the control system 1 according to the embodiment can appropriately manage the behavior of the user U who uses the facility Sc.

[0078] In the above embodiment, the lighting mode of the lighting unit 51 is changed depending on whether or not a vaccination has been administered, but the present invention is not limited to this. That is, the lighting mode of the lighting unit 51 may be changed depending on attribute information arbitrarily set by the facility Sc.

[0079] For example, if the facility Sc is an amusement parlor such as a pachinko parlor, the attribute information may be set to age, and the lighting mode of the lighting unit 51 may be changed when a minor user U enters the facility Sc.

[0080] In the above-described embodiment, the case where attribute information of the user U himself / herself is acquired has been described, but the present invention is not limited to this. For example, whether or not the user U is accompanied by a person, and the type of the person accompanied by the person may be acquired as attribute information.

[0081] In the above-described embodiment, the server device 10 manages the entire control system 1 in an integrated manner, but the present invention is not limited to this. That is, some or all of the functions of the server device 10 may be provided in the lighting device 50.

[0082] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, as well as the invention described in the claims and their equivalents. [Explanation of symbols]

[0083] 1. Control System 10 Server device 50 Lighting equipment 51 Lighting Department 52 Camera 53 Communications Department 100 user terminals 121 Acquisition Department 122 Specific part 123 Mapping section 124 Generation part 125 Lighting control unit 131 Sensing Data DB 132 Behavior information DB 133 Facility Information DB Sc Facility U User

Claims

1. an acquisition unit that acquires attribute information of users who use the facility; an identification unit that identifies the behavioral status of the user from sensing data within the facility; a correlation unit that correlates the attribute information acquired by the acquisition unit with the behavioral situation identified by the identification unit; a communication unit that cooperates with a store terminal installed in a store of the facility and individually notifies the store terminal of attribute information of the user who uses the store based on a result of the association unit; a generation unit that generates a report on the behavioral status of the user based on the association result by the association unit; Equipped with The generation unit Generate the report extracting the users who have come into contact with the specific user within the facility. Control system.

2. a lighting unit that changes a lighting mode in the facility in accordance with the attribute information of the user; The control system of claim 1 , comprising:

3. The acquisition unit Acquiring the attribute information stored in the user terminal of the user through data communication with the user terminal.

3. A control system according to claim 1 or 2.

4. The acquisition unit acquiring information regarding whether or not the user has been vaccinated as the attribute information; 4. A control system according to claim 1, 2 or 3.

5. The identification unit Identifying the degree of crowding of the users within the facility as the behavioral situation; A control system according to any one of claims 1 to 4.

Images