Interest measurement system and simulation system

The interest level measurement system uses building cameras to identify and analyze user behavior, addressing the limitation of existing systems by measuring and simulating user interests without requiring pre-registered devices, enhancing building management and user guidance.

JP7593504B2Active Publication Date: 2024-12-03MITSUBISHI ELECTRIC CORP

Patent Information

Application Number
JP2023557868
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-11-02
Publication Date
2024-12-03
Estimated Expiration
2041-11-02

AI Technical Summary

Technical Problem

Existing interest level analysis systems cannot obtain information on users who do not have a pre-registered mobile device, limiting their ability to measure and analyze user interests in buildings.

Method used

An interest level measurement system that utilizes cameras installed in buildings to identify users, determine their arrival floors, and analyze their behavior and interests based on attributes and relationships with areas, generating interest level maps and simulating changes in user interests.

Benefits of technology

Enables the measurement and simulation of user interests in buildings for users without pre-registered mobile devices, providing insights into user behavior and preferences for improved building management and user guidance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593504000001
    Figure 0007593504000001
  • Figure 0007593504000002
    Figure 0007593504000002
  • Figure 0007593504000003
    Figure 0007593504000003
Patent Text Reader

Abstract

The present invention provides an interest level measurement system capable of obtaining information on user's interest in a building even from a user who does not possess a pre-registered mobile device, and a simulation system capable of simulating a change of the information. In an interest level measurement system (1) included in a simulation system (50), an action information acquisition unit (15) acquires pieces of information on the action of a user on an arrival floor on the basis of images photographed by cameras (12). An interest information acquisition unit (20) uses a relationship between the pieces of action information and attributes and arrangement for areas on the arrival floor to acquire interest information indicating the level of user's interest for each attribute. An interest information storage unit (21) stores the interest information together with time and location information for each user. A visualization processing unit (27) uses the information stored in the interest information storage unit (21) to generate an interest level map in which the distribution of levels of user's interest in a building (2) is visualized.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an interest measurement system and a simulation system. [Background technology]

[0002] Patent Document 1 discloses an example of an interest level analysis system that analyzes a user's interest level in an object based on a movement trajectory and a movement speed of the user within an effective range of the object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2006-133915 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the interest level analysis system of Patent Document 1, the movement trajectory of the user is acquired using a portable device such as an information terminal carried by the user. Therefore, interest level information cannot be obtained for users who do not carry a portable device such as a pre-registered information terminal.

[0005] The present disclosure relates to solving such problems. The present disclosure provides an interest measurement system that can obtain information on the interests of users in a building, even for users who do not possess a pre-registered mobile device, and a simulation system that can simulate changes in the information. [Means for solving the problem]

[0006] The interest measurement system according to the present disclosure includes an attribute storage unit that stores attributes for each area of ​​a plurality of floors of a building, a user identification unit that identifies a user in the building based on an image captured by at least one of a plurality of cameras installed in the building, a floor determination unit that determines an arrival floor of the user identified by the user identification unit based on an image captured by at least one of the plurality of cameras when the user identified by the user identification unit moves from a departure floor to an arrival floor among the plurality of floors using one or more elevator facilities installed in the building, and behavioral information representing the behavior of the user identified by the user identification unit at the arrival floor determined by the floor determination unit. an interest information acquisition unit that acquires, for a user identified by the user identification unit, interest information indicating a degree of interest of the user for each attribute based on a relationship between an arrangement and an attribute of an area on the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit together with information on a time and a location for each user; and a visualization processing unit that generates an interest level map that visualizes a distribution of the interest levels of users of the building on at least one of the multiple floors using the information stored in the interest information storage unit. The behavior information includes interest direction information indicating a direction showing the user's interest, and the interest information acquisition unit acquires the interest information of the user based on the area of ​​high interest of the user based on the user's direction indicated by the interest direction information and the correspondence between the attribute of the area. . The interest measurement system according to the present disclosure includes a first attribute storage unit that stores attributes for each area of ​​a plurality of floors of a first building, a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building, a floor determination unit that determines an arrival floor of the user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among the plurality of floors of the first building using one or more elevator facilities installed in the first building, and a floor determination unit that determines, for the user identified by the first user identification unit, behavior information representing the behavior of the user at the arrival floor determined by the floor determination unit, by capturing, by at least one of the plurality of first cameras. an interest information acquisition unit that acquires interest information representing a level of interest of the user for each attribute for the user identified by the first user identification unit, based on a relationship between the layout and attributes of the area on the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit, including time and location information for each user; a second attribute storage unit that stores attributes for each area for each of a plurality of floors of the second building; and a visualization processing unit that generates an interest level map that visualizes a distribution of the levels of interest of users of the second building on at least any of a plurality of floors of the second building, using information on the attributes stored in the second attribute storage unit and the information stored in the interest information storage unit. The behavior information includes interest direction information indicating a direction showing the user's interest, and the interest information acquisition unit acquires the interest information of the user based on the area of ​​high interest of the user based on the user's direction indicated by the interest direction information and the correspondence of the attributes of the area, and the visualization processing unit uses interest information stored in the interest information storage unit for one or more users specified in the input generation conditions to generate the interest map. . The interest measurement system according to the present disclosure includes an attribute storage unit that stores attributes for each area of ​​a plurality of floors of a first building, a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building, a floor determination unit that determines an arrival floor of the user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among the plurality of floors of the first building using one or more elevator facilities installed in the first building, and a behavior information acquisition unit that acquires behavior information representing the behavior of the user identified by the first user identification unit at the arrival floor determined by the floor determination unit based on the image captured by at least one of the plurality of first cameras. an interest information acquisition unit that acquires interest information indicating the interest level of the user for each attribute based on the relationship between the arrangement and attributes of areas on the arrival floor acquired by the behavior information acquisition unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and location information; a receiving unit that receives an image of a user of a third building from an external system applied to the third building; a third user identification unit that identifies a user based on the image received by the receiving unit; and a visualization processing unit that generates an interest level map that visualizes a distribution of the interest levels of users of the third building on floors of the third building whose attribute information has been determined among the multiple floors of the third building, using information about the user identified by the third user identification unit that is stored as interest information in the interest information storage unit and attribute information for at least any area of ​​the multiple floors of the third building determined based on the image received by the receiving unit. The behavior information includes interest direction information indicating a direction showing the user's interest, and the interest information acquisition unit acquires the interest information of the user based on the area of ​​high interest of the user based on the user's direction indicated by the interest direction information and the correspondence between the attribute of the area. . The interest measurement system according to the present disclosure includes an attribute storage unit that stores attributes for each area of ​​a plurality of floors of a first building, a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building, a floor determination unit that determines an arrival floor of the user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among the plurality of floors of the first building using one or more elevator facilities installed in the first building, and a floor determination unit that determines, for the user identified by the first user identification unit, behavior information representing the behavior of the user at the arrival floor determined by the floor determination unit based on the image captured by at least one of the plurality of first cameras. an interest information acquisition unit that acquires, for a user identified by the first user identification unit, interest information indicating a degree of interest of the user for each attribute based on a relationship between the layout and attributes of the area on the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit including time and location information for each user; a receiving unit that receives from an external system an image of a user who starts using one or more elevator facilities provided in a third building; a third user identification unit that identifies the user based on the image received by the receiving unit; and a transmitting unit that transmits, for the user identified by the third user identification unit, information on destination candidates with a high degree of interest of the user stored in the interest information storage unit to the external system. The behavior information includes interest direction information indicating a direction showing the user's interest, and the interest information acquisition unit acquires the interest information of the user based on the area of ​​high interest of the user based on the user's direction indicated by the interest direction information and the correspondence between the attribute of the area. .

[0007] The simulation system according to the present disclosure includes the above-mentioned interest measurement system, and a simulation processing unit that sets simulation conditions based on existing conditions stored in the interest information storage unit, and simulates changes in interest information based on new conditions that are obtained by changing the existing conditions acquired by the interest information acquisition unit. Effect of the Invention

[0008] According to the interest measurement system or simulation system of the present disclosure, even for users who do not possess a pre-registered mobile device, information on the interests of users in a building can be obtained, and changes in that information can be simulated. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a configuration diagram of a simulation system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a car operating panel according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of an area on a floor according to the first embodiment. [Figure 4A] FIG. 2 is a diagram showing an example of a camera arrangement according to the first embodiment. [Figure 4B] FIG. 2 is a diagram showing an example of a camera arrangement according to the first embodiment. [Figure 4C] FIG. 2 is a diagram showing an example of a camera arrangement according to the first embodiment. [Figure 5A] 4 is a diagram showing an example of behavioral information acquired by a behavioral information acquiring unit according to the first embodiment; FIG. [Figure 5B] 4 is a diagram showing an example of behavioral information acquired by a behavioral information acquiring unit according to the first embodiment; FIG. [Figure 5C] 4 is a diagram showing an example of behavioral information acquired by a behavioral information acquiring unit according to the first embodiment; FIG. [Figure 5D] 4 is a diagram showing an example of behavioral information acquired by a behavioral information acquiring unit according to the first embodiment; FIG. [Figure 5E] 4 is a diagram showing an example of behavioral information acquired by a behavioral information acquiring unit according to the first embodiment; FIG. [Figure 6] 4 is a table showing an example of determination by a floor determining unit according to the first embodiment. [Figure 7A] 5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 7B] 5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 7C]5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 7D] 5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 7E] 5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 7F] 5 is a diagram showing an example of determination by a floor determination unit according to the first embodiment. FIG. [Figure 8] 4 is a diagram showing an example of acquisition of behavioral information by the interest measurement system according to the first embodiment. FIG. [Figure 9A] 4 is a diagram showing an example of acquisition of behavioral information by the interest measurement system according to the first embodiment. FIG. [Figure 9B] 4 is a diagram showing an example of acquisition of behavioral information by the interest measurement system according to the first embodiment. FIG. [Figure 10A] 4 is a diagram showing an example of acquisition of interest information by the interest measurement system according to the first embodiment. FIG. [Figure 10B] 4 is a diagram showing an example of acquisition of interest information by the interest measurement system according to the first embodiment. FIG. [Figure 10C] 4 is a diagram showing an example of acquisition of interest information by the interest measurement system according to the first embodiment. FIG. [Figure 11] 4 is a diagram showing an example of acquisition of interest information by the interest measurement system according to the first embodiment. FIG. [Figure 12A] FIG. 2 is a diagram showing an example of destination presentation by the interest measurement system according to the first embodiment. [Figure 12B] FIG. 2 is a diagram showing an example of destination presentation by the interest measurement system according to the first embodiment. [Figure 13A] FIG. 2 is a diagram showing an example of destination presentation by the interest measurement system according to the first embodiment. [Figure 13B] FIG. 2 is a diagram showing an example of destination presentation by the interest measurement system according to the first embodiment. [Figure 14A] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 14B]FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 14C] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 14D] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 14E] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 15A] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 15B] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 15C] FIG. 4 is a diagram showing an example of setting simulation conditions in the simulation system according to the first embodiment. [Figure 15D] FIG. 4 is a diagram showing an example of a result of a simulation performed by the simulation system according to the first embodiment. [Figure 15E] FIG. 4 is a diagram showing an example of a result of a simulation performed by the simulation system according to the first embodiment. [Figure 16A] FIG. 2 is a diagram showing an example of an interest level map obtained by the interest level measurement system according to the first embodiment. [Figure 16B] FIG. 4 is a diagram showing an example of a result of a simulation performed by the simulation system according to the first embodiment. [Figure 17A] FIG. 2 is a diagram showing an example of a layout of a building according to the first embodiment. [Figure 17B] FIG. 4 is a diagram showing an example of a result of a simulation performed by the simulation system according to the first embodiment. [Figure 18] 4 is a flowchart showing an example of the operation of the interest measurement system according to the first embodiment. [Figure 19] 4 is a flowchart showing an example of the operation of the interest measurement system according to the first embodiment. [Figure 20A]4 is a flowchart showing an example of the operation of the interest measurement system according to the first embodiment. [Figure 20B] 4 is a flowchart showing an example of the operation of the interest measurement system according to the first embodiment. [Figure 21] 4 is a flowchart showing an example of the operation of the interest measurement system according to the first embodiment. [Figure 22] 4 is a flowchart showing an example of the operation of the simulation system according to the first embodiment. [Diagram 23] 1 is a hardware configuration diagram of a main part of a degree of interest measurement system and a simulation system according to a first embodiment. [Figure 24A] FIG. 11 is a diagram showing an example of destination presentation by the interest measurement system according to the second embodiment. [Figure 24B] FIG. 11 is a diagram showing an example of destination presentation by the interest measurement system according to the second embodiment. [Figure 24C] FIG. 11 is a diagram showing an example of destination presentation by the interest measurement system according to the second embodiment. [Figure 25A] FIG. 11 is a diagram showing an example of destination presentation by the interest measurement system according to the second embodiment. [Figure 25B] FIG. 11 is a diagram showing an example of destination presentation by the interest measurement system according to the second embodiment. [Figure 26] FIG. 11 is a configuration diagram of an interest measurement system according to a third embodiment. [Figure 27] FIG. 13 is a diagram showing an example of destination presentation by the interest measurement system according to the third embodiment. [Figure 28] FIG. 13 is a configuration diagram of an interest measurement system according to a fourth embodiment. [Figure 29] 13 is a diagram showing an example of a disclosure of a degree of interest map by the degree of interest measurement system in embodiment 4, or a simulation result of a change in the interest information. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present disclosure will be described with reference to the accompanying drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals, and duplicated descriptions are appropriately simplified or omitted.

[0011] Embodiment 1 FIG. 1 is a configuration diagram of a simulation system 50 according to the first embodiment.

[0012] The simulation system 50 includes a degree of interest measurement system 1. The degree of interest measurement system 1 is applied to a building 2 having multiple floors. The degree of interest measurement system 1 is a system that visualizes areas of the building 2 that have a high degree of interest of users of the building 2, for example, to the owner of the building 2. The users of the building 2 include, for example, visitors who visit the building 2, or employees who work in the building 2.

[0013] One or more lifting facilities are provided in the building 2. The lifting facilities are facilities used by users of the building 2 to move between multiple floors. In this example, the building 2 is provided with multiple lifting facilities. The lifting facilities are, for example, elevators 3, escalators 4, or stairs 5. An entrance / exit for the stairs 5 is provided on each floor of the building 2. A user who travels from the departure floor to the arrival floor using the stairs 5 starts using the stairs 5 at the entrance / exit for the departure floor. The user then completes using the stairs 5 at the entrance / exit for the arrival floor. The stairs 5 may be a slope that allows users to travel diagonally between floors.

[0014] In this example, multiple elevators 3 are applied to a building 2 as lifting equipment. Each elevator 3 is a transport device that transports users between multiple floors. A hoistway 6 for the elevator 3 is provided in the building 2. The hoistway 6 is a space that spans multiple floors. A landing for the elevator 3 is provided on each floor of the building 2. The landing for the elevator 3 is a space adjacent to the hoistway 6. Each elevator 3 includes a car 7, a control panel 8, and a hall operation panel 9. The car 7 is a device that transports users riding inside the car between multiple floors by traveling up and down the hoistway 6. The car 7 includes a car operation panel 10. The car operation panel 10 is a device that accepts user operations that specify the destination floor of the car 7. The control panel 8 is a device that controls the running of the car 7, for example, in response to a call registered in the elevator 3. The hall operation panel 9 is a device that accepts user operations that register a call in the elevator 3. The hall operating panel 9 is provided, for example, at the landing of each floor. The hall operating panel 9 may be shared among a plurality of elevators 3. A user who uses the elevator 3 to move from a departure floor to an arrival floor operates the hall operating panel 9, for example, at the landing of the departure floor to register a call. The user starts using the elevator 3 by getting on the car 7 from the landing of the departure floor. After that, the user completes the use of the elevator 3 by getting off the car 7 at the landing of the arrival floor. In the building 2 of this example, a group management device 11 that manages operations such as assignment of calls to a plurality of elevators 3 is provided. Here, in the building 2, a device that replaces the group management device as an independent device, or a device installed with software having the functions of the group management device as an independent device, may be provided. Part or all of the information processing functions for operation management may be provided in the control panel 8. Alternatively, part or all of the information processing functions for operation management may be provided in a server device capable of communicating with each elevator 3. The server device may be located either inside or outside the building 2. In addition, some or all of the information processing functions for operation management, etc. may be installed in a virtual machine on a cloud service that can communicate with each elevator 3.Some or all of the functions of information processing regarding operation management etc. may be realized by dedicated hardware, software, or a combination of dedicated hardware and software. In the following, each of the above-mentioned exemplary means for performing information processing regarding operation management etc. will be referred to as group management device 11 regardless of its configuration.

[0015] The escalator 4 is disposed between the upper and lower floors. The escalator 4 is a transport device that transports users between the upper and lower floors. An entrance and exit for the escalator 4 is provided on each floor of the building 2. A user traveling from a departure floor to an arrival floor using one or more escalators 4 starts using the escalator 4 from the entrance on the departure floor. The user may transfer between multiple escalators 4 between the departure floor and the arrival floor. The user then completes using the escalator 4 at the exit on the arrival floor.

[0016] A plurality of cameras 12 are provided in the building 2. Each camera 12 is a device that captures an image of the location where the camera 12 is provided. The images captured by each camera 12 include, for example, still images or videos. The format of the images captured by each camera 12 may be a compressed image format such as Motion JPEG, AVC, or HEVC. Alternatively, the format of the images captured by each camera 12 may be an uncompressed image format. Each camera 12 is equipped with a function for outputting the captured images to an external device. In this example, the cameras 12 are synchronized with each other so that images captured at the same time can be acquired as images at the same time.

[0017] In this example, the multiple cameras 12 include a camera 12 provided on each floor. The multiple cameras 12 include a camera 12 provided inside the car 7 of the elevator 3. The multiple cameras 12 include a camera 12 provided at the entrance of the escalator 4. The multiple cameras 12 include a camera 12 provided at the entrance of the staircase 5. The multiple cameras 12 may include a camera 12 provided outdoors, such as at the entrance, perimeter, or courtyard of the building 2, as well as the camera 12 provided on each floor. The multiple cameras 12 may include a camera 12 provided at the landing of the elevator 3 as well as the camera 12 provided on each floor. The multiple cameras 12 may include a camera 12 provided at a portion before the entrance of the escalator 4 as well as the camera 12 provided at the entrance of the escalator 4. The multiple cameras 12 may include a camera 12 provided at a portion before the entrance of the staircase 5 as well as the camera 12 provided at the entrance of the staircase 5.

[0018] The interest measurement system 1 may include some or all of the multiple cameras 12. Alternatively, some or all of the multiple cameras 12 may be devices external to the interest measurement system 1. The interest measurement system 1 provides guidance by information processing based on images acquired from each camera 12. The interest measurement system 1 includes an attribute storage unit 13, a user identification unit 14, a behavioral information acquisition unit 15, a behavioral information storage unit 16, an elevator equipment determination unit 17, a consistency processing unit 18, a floor determination unit 19, an interest information acquisition unit 20, an interest information storage unit 21, a destination presentation unit 22, a call registration unit 23, and a visualization processing unit 27 as parts responsible for information processing. In this example, the attribute storage unit 13, the user identification unit 14, the behavioral information acquisition unit 15, the behavioral information storage unit 16, the elevator equipment determination unit 17, the consistency processing unit 18, the floor determination unit 19, the interest information acquisition unit 20, the interest information storage unit 21, the destination presentation unit 22, and the call registration unit 23 of the interest measurement system 1 are mounted on the group management device 11. Here, a part or all of the parts responsible for information processing in the interest measurement system 1 may be mounted on an external server device capable of communication with the group management device 11. Also, a part or all of the parts responsible for information processing in the interest measurement system 1 may be mounted on an external server device capable of communication with the server device installed in the building 2. Also, a part or all of the parts responsible for information processing in the interest measurement system 1 may be implemented by processing or storage resources on a cloud service.

[0019] The attribute storage unit 13 is a part that stores information. In the attribute storage unit 13, attributes for each area of ​​each floor of the building 2 are stored. The area of ​​each floor is a part that occupies a part or all of the floor. The area of ​​each floor is, for example, a part where a tenant of the floor resides. The area of ​​each floor may be, for example, a part of a store operating on the floor. The attribute storage unit 13 stores information that specifies an area, for example, as a range of coordinates on each floor. The area is not limited to a two-dimensional plane, but may be a high-dimensional space such as three dimensions. In addition, the attribute of the area represents one or more things, events, people, etc. The attribute of the area is, for example, the type of store, or the type of goods or services handled in the store, if the area is a store. The attribute of the area may be, for example, the name of the store, or the name of goods or services handled in the store, if the area is a store. The attribute of the area may be, for example, the person in the office, if the area is an office. That is, the attribute of an area is the goal of the user. Each area may have multiple attributes. One or more attributes of each area may be assigned by a human or may be assigned using AI (Artificial Intelligence).

[0020] The user identification unit 14 is equipped with a function for identifying users of the building 2 based on an image captured by at least one of the cameras 12. The user identification unit 14 identifies the user by, for example, comparing the facial information of the user extracted from the image with existing information, if any, by two-dimensional facial recognition, and confirms the identification of the user. When there is no existing information, such as when the user is a first-time user, the user identification unit 14 may newly register the facial information of the user extracted from the image. Here, for example, facial features such as the nose, ears, eyes, mouth, cheeks, chin, and neck are used as the facial information. In addition, in order to prevent the misuse of facial information, the user identification unit 14 may acquire information such as the iris or pupil of the eye. When the pupil of the eye is not circular or elliptical but has an irregular shape, or when the iris information is determined to be abnormal, the user identification unit 14 may detect the risk of acquiring false facial information created by AI or the like, or the risk of acquiring facial information in a state where the user is wearing black sunglasses that block the iris, and may issue an alert or the like.

[0021] The behavioral information acquisition unit 15 is equipped with a function of acquiring behavioral information of a user identified by the user identification unit 14. The behavioral information of a user is, for example, time-series data of information representing the location of the user. The behavioral information is not limited to three-dimensional information combining a two-dimensional plane and a time axis, but may be higher-dimensional information combining a higher-dimensional space such as three dimensions and a time axis. The location of the user includes, for example, information such as the floor on which the user is located, the coordinates of the user on the floor, and the orientation of the user. When the user is using any elevator facility, the location of the user may include information identifying the elevator facility. The behavioral information as time-series data includes, for example, information on the location of the user acquired at predetermined time intervals. The behavioral information acquisition unit 15 acquires the behavioral information of the user based on an image captured by at least one of the cameras 12. The behavioral information acquisition unit 15 continuously updates the behavioral information of the user, for example, at predetermined time intervals.

[0022] The behavioral information storage unit 16 is a part that stores information. The behavioral information storage unit 16 stores the behavioral information acquired by the behavioral information acquisition unit 15 for each user identified by the user identification unit 14. In this example, the behavioral information storage unit 16 stores, in association with each other, identification information unique to the user that is necessary for identification by the user identification unit 14, the behavioral information of the user, and information on the time and place at which the behavioral information was acquired.

[0023] The elevator equipment determination unit 17 has a function of determining which elevator equipment will be used by a user identified by the user identification unit 14. The elevator equipment determination unit 17 determines which elevator equipment will be used based on images captured by at least one of the cameras 12. For example, when a user starts to use an elevator equipment at a departure floor, the elevator equipment determination unit 17 determines that elevator equipment is the elevator equipment to be used by the user.

[0024] The consistency processing unit 18 is equipped with a function for achieving consistency between the identification of a user by the user identification unit 14 and the determination of the elevator equipment used by the elevator equipment determination unit 17. The consistency process is performed, for example, as follows. The user identification unit 14 may erroneously identify different users as the same user. In this case, the elevator equipment determination unit 17 may simultaneously determine two or more elevator equipment as the elevator equipment used by the user identified by the user identification unit 14 as the same user. Since the same person cannot use two or more elevator equipments at the same time, the consistency processing unit 18 requests the user identification unit 14 to correct the identification of the user. At this time, the user identification unit 14 identifies the users who were erroneously identified as the same user as different users. When identifying users as different from each other, the user identification unit 14 extracts differences in the feature amounts of the users from the acquired images to improve the accuracy of identifying the users and reconfirm the identification of the different users. The user identification unit 14 may make adjustments such as narrowing the range of features that are determined to be the same user depending on the difference in the extracted features. The user identification unit 14 may improve the accuracy of identifying a user based on the difference in features extracted by other methods.

[0025] The floor determination unit 19 is equipped with a function for determining the arrival floor of a user identified by the user identification unit 14. The arrival floor of a user is a floor at which the user, who is using the elevator facility, has completed use of the elevator facility. For example, when a user is using elevator 3, the arrival floor of the user is the floor at which the user disembarks from elevator 3. The floor determination unit 19 determines the arrival floor based on an image captured by at least one of the cameras 12. For example, when the user completes use of the elevator facility at any floor, the floor determination unit 19 determines that floor as the arrival floor of the user.

[0026] The interest information acquisition unit 20 is equipped with a function for acquiring interest information for a user identified by the user identification unit 14. The interest information of a user is information that indicates the degree of interest of the user for each attribute attached to an area. The interest information acquisition unit 20 acquires interest information based on the user's behavior on the arrival floor. Here, the user's behavior includes information such as the user's stay time on the arrival floor and the interest direction, which is the direction in which the user shows interest on the arrival floor. In this example, the interest information acquisition unit 20 acquires interest information based on the user's behavior analyzed by the information stored in the attribute storage unit 13, and the behavior information acquired by the behavior information acquisition unit 15 or the behavior information stored in the behavior information storage unit 16. One piece of interest information indicates the presence or absence of interest, and the other piece indicates the level of interest. The level of interest is analyzed using either or both of the period during which the user showed interest in the attribute attached to the area in the interest direction and the stay time as elements. The interest information acquisition unit 20 adds information each time information from each floor is added to each user. The interest information acquiring unit 20 sorts the degree of interest obtained as a result of analysis based on updated information in order of priority each time.

[0027] The interest information storage unit 21 is a part that stores information. Interest information is stored for each user in the interest information storage unit 21. In this example, the interest information storage unit 21 stores identification information unique to a user, the interest information of the user, and information on the time and place when the interest information was acquired in association with each other.

[0028] The destination presentation unit 22 is equipped with a function of presenting a destination to a user based on the interest information stored in the interest information storage unit 21. For example, the destination presentation unit 22 presents an area having an attribute of high interest to the user as a destination. The destination information presented by the destination presentation unit 22 includes, for example, the attribute of the destination, a destination floor which is a floor including the destination, or a route from the user's current position to the destination. The destination presentation unit 22 presents to the user, for example, by video. The video displayed by the destination presentation unit 22 includes, for example, characters, still images, or images. The video may be, for example, a two-dimensional video displayed by a display device such as a display, a projection device such as a projector, or the like. Alternatively, the video may be a spatial video displayed in three dimensions. The video may be, for example, displayed inside the car 7 of the elevator 3, or at the landing of the elevator 3, the entrance and exit of the escalator 4, or the entrance and exit of the stairs 5, or the like. The display device may be, for example, a light indicating the destination, a liquid crystal display, an organic electro-luminescence (EL) display, a light-emitting film, an LED display (LED: Light Emitting Diode), a projector, or a three-dimensional (3D) display. Alternatively, the destination presenting unit 22 may present the destination to the user by, for example, sound. A device that emits sound, such as a speaker, is disposed, for example, inside the car 7 of the elevator 3, or at the landing of the elevator 3, the entrance and exit of the escalator 4, or the entrance and exit of the stairs 5.

[0029] The call registration unit 23 has a function of registering a call to a destination floor presented by the destination presentation unit 22 in the elevator 3 that the user is to start using. Here, the call registration unit 23 may determine whether or not to register a call to a destination floor presented to a user according to a priority order analyzed using some or all of the factors of the user's behavior in response to the presentation, that is, the duration of stay, the presence or absence of interest, and the level of interest. The call registration unit 23 registers the call in the elevator 3 in which the user has boarded the car 7, for example. When the call registration unit 23 is an external device to the group management device 11, the call registration unit 23 may input control information for registering the call to the group management device 11.

[0030] The visualization processing unit 27 is a part that has a function of generating an interest level map. The interest level map is information that visualizes, for example, the distribution of the interest levels of users in the building 2. The visualization processing unit 27 generates the interest level map using information stored in the interest information storage unit 21. The visualization processing unit 27 visualizes, for example, the distribution of the interest levels on any floor of the building 2 as an interest level map. In the interest level map, the distribution of the interest levels is visualized by information such as a table, a graph, or a diagram. The visualization processing unit 27 may generate the interest level map including the information stored in the behavior information storage unit 16. The visualization processing unit 27 may generate the interest level map including information on the destination that the destination presentation unit 22 actually presented to the user. When the behavior information is visualized, an evaluation from the user's perspective may be performed by moving the time and tracing the behavior of each user in the building, for example, whether the guidance of the destination presentation unit 22 is appropriate, or whether there is congestion that causes irritation. The visualization processing unit 27 may generate an interest level map including classification information such as the user's gender or age, or both, or other information. The generated interest level map is not limited to a three-dimensional map with the interest level as an axis on the two-dimensional bird's-eye view map, and may be higher-dimensional information such as a three-dimensional video so that more detailed actions and interest levels can be visualized in an easy-to-understand manner.

[0031] The interest measurement system 1 includes an operation display unit 28. The operation display unit 28 has a function of displaying information processed in the interest measurement system 1 to, for example, the owner of the building 2. The display function is implemented, for example, by a monitor, a projector, an LED display, a smartphone, smart glasses, a VR display, an AR display, an MR display, or a stereoscopic (3D) display. The operation display unit 28 also has a function of emitting sound as necessary as an auxiliary or alternative to the display. The operation display unit 28 has a function of accepting an operation by, for example, the owner of the building 2. The operation function is implemented, for example, by a button, a keyboard, a touch panel, eye tracking, a sensor, or voice recognition. The operation display unit 28 may be an external device of the interest measurement system 1. The operation display unit 28 may be a device separate from the visualization processing unit 27 and other parts of the interest measurement system 1. Alternatively, the operation display unit 28 may be a device integrated with a part such as the visualization processing unit 27 of the interest measurement system 1. The operation display unit 28 displays information such as an interest map generated in the interest measurement system 1. The operation display unit 28 accepts, for example, an operation for generating an interest map in the interest measurement system 1. The operation display unit 28 may display using any display method as long as it is a display mechanism that can be recognized by the owner (corporation or person) of the building 2, the manager (corporation or person) of the tenants of the building 2, or their representative (corporation or person), the manufacturer (corporation or person) of the interest measurement system 1, or a maintenance person (corporation or person), or an AI or robot that replaces these corporations or people. The operation display unit 28 may also provide sound or voice as a substitute for or supplement to the display. The operation display unit 28 may accept operations using any mechanism that can be operated by the owner (corporation or individual) of building 2, the manager (corporation or individual) of the tenants of building 2, or their agent (corporation or individual), or the manufacturer (corporation or individual) of the interest measurement system 1, or a maintenance person (corporation or individual), or an AI, robot, software, or hardware that replaces these corporations or individuals.Hereinafter, the subject of these operations may be referred to as the “owner, etc.” Operations such as generating an interest level map are performed, for example, by the owner of the building 2. At this time, the operation display unit 28 may also receive, for example, an operation of inputting conditions for generating the interest level map.

[0032] The owner of the building 2 or the like can have the interest measurement system 1 automatically calculate, for example, the rent for the building 2 according to the market price from information such as the interest map displayed by the operation display unit 28. Here, the market price for the rent is, for example, the correspondence between the level of interest and the rent set according to the location of the building. The owner of the building 2 or the like can use the calculated rent as an aid in making decisions regarding the management of the building 2 or the like. The owner of the building 2 or the like can also use information such as the interest map as a decision material for improving the value of the building 2. In addition, there may be a user in the building 2 who exhibits suspicious behavior that deviates from the tendencies of the main users. The owner of the building 2 or the like can use information such as the interest map displayed by the operation display unit 28 to avoid risks such as theft or accidents by, for example, paying attention to users who exhibit suspicious behavior. This can improve the safety of the building 2 or the like.

[0033] The simulation system 50 includes a simulation processing unit 29 as a part responsible for information processing. The simulation processing unit 29 is equipped with a function of setting simulation conditions and simulating changes in the interest information acquired by the interest information acquisition unit 20 in the building 2. In this example, the simulation processing unit 29 is mounted on a server device capable of communicating with the devices of the interest measurement system 1 such as the group management device 11. Note that a part or all of the parts responsible for information processing in the simulation system 50 may be mounted on the devices of the interest measurement system 1 such as the group management device 11. Also, a part or all of the parts responsible for information processing in the simulation system 50 may be a device separate from the operation display unit 28 of the interest measurement system 1. Also, a part or all of the parts responsible for information processing in the simulation system 50 may be a device integrated with the operation display unit 28 of the interest measurement system 1. Also, a part or all of the parts responsible for information processing in the simulation system 50 may be mounted on an external server device capable of communicating with the server device provided in the building 2. In addition, part or all of the parts of the simulation system 50 that are responsible for information processing may be implemented using processing or storage resources on a cloud service.

[0034] The operation display unit 28 displays, for example, the results of a simulation in the simulation system 50. The results of the simulation show, for example, changes in an interest level map. The results of the simulation may also include information on the rent calculated according to the market price from information on the changed interest level map. The operation display unit 28 accepts, for example, operations for setting simulation conditions in the simulation system 50 and starting a simulation. The operations are performed, for example, by the owner of the building 2. As a result, the results of the simulation in the simulation system 50 can be used as more reliable information for making decisions to further increase the value of the building 2.

[0035] FIG. 2 is a diagram showing an example of the car operating panel 10 according to the first embodiment.

[0036] The car operation panel 10 includes a display panel 10a and a plurality of destination buttons 10b. The display panel 10a is a display device that displays information to passengers riding inside the car 7. The display panel 10a displays, for example, the running direction of the car 7 and the current floor. Each destination button 10b corresponds to one of the floors. Each destination button 10b is a button that accepts an operation to specify the corresponding floor as the destination floor. Each destination button 10b has a light-emitting device (not shown) that lights up when operated by a user, for example. In this example, the light-emitting device is a device whose light emission brightness, color tone, whether or not to flash, and flashing speed are variable.

[0037] FIG. 3 is a diagram showing an example of an area on a floor according to the first embodiment. In FIG. 3, a floor map for one of the floors is shown.

[0038] The floor shown in FIG. 3 includes multiple areas, each of which is a store. One of the areas is a store P that sells items P1 and P2. One of the areas is a store Q that sells items Q1 and Q2. One of the areas is a store R that provides services R1 and R2.

[0039] At this time, the attribute storage unit 13 stores, for example, the store name "Store P" and the product names "P1" and "P2" as attributes of the area of ​​Store P. If the products P1 and P2 are food products and Store P is a food store, the attribute storage unit 13 may store, for example, the store type "food store" and the product type "food products" as attributes of the area.

[0040] 4A to 4C are diagrams showing examples of the arrangement of cameras 12 according to the first embodiment.

[0041] As shown in Fig. 4A, one of the cameras 12 is disposed inside the car 7 of the elevator 3. The camera 12 is attached, for example, to the upper part of a wall or to the ceiling. The camera 12 is disposed, for example, in a position where it can capture an image of the face of a user getting into the car 7. In addition, one of the cameras 12 is disposed at the landing of the elevator 3. The camera 12 is attached, for example, to the upper part of a wall or to the ceiling.

[0042] As shown in Fig. 4B, any of the cameras 12 is disposed at the entrance of the escalator 4. Alternatively, any of the cameras 12 may be disposed on the wall surface of the inclined portion in front of the entrance of the escalator 4. The camera 12 is attached to, for example, the upper part of a wall or the ceiling. The camera 12 may also be attached to a pole provided at the entrance.

[0043] As shown in Fig. 4C, any of the cameras 12 is disposed at the entrance of the stairs 5. Alternatively, any of the cameras 12 may be disposed on a wall surface of a slope in front of the entrance of the stairs 5. The camera 12 is attached to, for example, the upper part of a wall or the ceiling. The camera 12 may also be attached to a pole provided at the entrance.

[0044] Next, an example of the behavioral information will be described with reference to FIG. 5A to 5E are diagrams showing examples of behavioral information acquired by the behavioral information acquiring unit 15 according to the first embodiment.

[0045] The behavioral information acquisition unit 15 extracts the feature amount of the user from, for example, the image used by the user identification unit 14 to identify the user. The behavioral information acquisition unit 15 may use the feature amount extracted by the user identification unit 14. The feature amount of the user includes, for example, information on the positions of feature points such as the nose, ears, eyes, mouth, cheeks, chin, neck, and both shoulders of the face. The behavioral information acquisition unit 15 acquires the behavioral information of the user based on the extracted feature amount. In this example, the behavioral information acquisition unit 15 acquires information including interest direction information as information on the position of the user included in the behavioral information of the user. Here, the behavioral information acquisition unit 15 continuously acquires the behavioral information of the user by tracking the user identified by the user identification unit 14. The behavioral information acquisition unit 15 may track the position of the identified user by, for example, a method such as moving object tracking. The behavioral information acquisition unit 15 may continuously acquire the behavioral information of the user who is no longer reflected in the image due to movement by tracking the user.

[0046] The interest direction information is an example of information on a direction indicating the interest of a user. The interest direction information is information expressed using at least three feature amounts of the user's shoulders and nose. The interest direction information may be expressed using other feature amounts as necessary. In the interest direction information, the direction of the user's interest is expressed as a direction from the midpoint of the line segment connecting the positions of the shoulders to the position of the nose. Here, the nose of the user as a feature amount used in the interest direction information may be captured regardless of whether it is covered by a mask or the like, that is, whether the user's naked nose itself is reflected in the image. The shoulder of the user as a feature amount used in the interest direction information may be captured regardless of whether it is covered by clothing or the like, that is, whether the user's naked shoulder itself is reflected in the image. Similarly, for other feature amounts of organs such as ears, eyes, mouth, cheeks, chin, and neck, the feature amount of the organ may be captured regardless of whether the user's naked organ itself is reflected in the image. The interest direction information may be expressed using feature amounts of the shoulders and nose obtained using the user's skeletal information, for example. Moreover, the interest direction information may be expressed using other feature amounts obtained using skeletal information.

[0047] FIG. 5A shows an example of an image of a user seen from above. In this way, the direction of interest of the user is represented by interest direction information acquired based on the image of the user. FIG. 5B shows an example of an image in which the face direction and the body direction do not match. In this way, the direction of interest of the user is an extension of the direction from the midpoint of the line segment connecting the positions of both shoulders of the user to the nose. FIG. 5C shows an example of an image of a user seen from behind. When the nose of the user is not shown in the image, the behavioral information acquisition unit 15 may complement the image from the acquired image information to complement the nose. Alternatively, the behavioral information acquisition unit 15 may estimate the position of the nose based on other feature points or the like. Alternatively, the behavioral information acquisition unit 15 may specify the position of the nose by synthesizing images captured by the multiple cameras 12. The behavioral information acquisition unit 15 specifies the position of the nose by any one of these multiple methods or a combination of these multiple methods. In this way, the direction of interest of the user is represented as an extension of the direction from the midpoint of the line segment connecting the positions of both shoulders to the position of the nose. FIG. 5D shows an example of an image of a user seen from the side. When one of the user's shoulders is not shown in the image, the behavioral information acquisition unit 15 may complement the other shoulder by image complementation from the acquired image information. Alternatively, the behavioral information acquisition unit 15 may estimate the position of the shoulder not shown in the image based on other feature points or the like. Alternatively, the behavioral information acquisition unit 15 may identify the positions of both shoulders by synthesizing images taken by multiple cameras 12. The behavioral information acquisition unit 15 identifies the positions of both shoulders by any one of these multiple methods or a combination of these multiple methods. In this way, the direction showing the user's interest is expressed as an extension of the direction from the midpoint of the line segment connecting the positions of both shoulders to the position of the nose.

[0048] As shown in FIG. 5E, the information on the direction indicating the user's interest may be extracted by, for example, image processing by AI mounted on the behavioral information acquisition unit 15. The image processing by AI is, for example, processing by a machine learning method using an image as an input. A model for deriving behavioral information from the user's image is learned by the machine learning method. The behavioral information acquisition unit 15 acquires behavioral information from the user's image based on the learned model. The behavioral information acquisition unit 15 may perform supervised learning using, for example, a set of the user's image and interest direction information obtained from the image as teacher data. Here, the interest direction information obtained from the image may be interest direction information obtained from the positions of both shoulders and the nose. At this time, the behavioral information acquisition unit 15 outputs the interest direction information using the user's image as an input based on the result of the learning. The behavioral information acquisition unit 15 may extract the feature amount of the image by deep learning or the like. In FIG. 5E, an example of the importance of the feature amount of the image is shown by a shade of color. Alternatively, the behavioral information acquisition unit 15 may extract the information on the direction indicating the user's interest from the image by other machine learning methods such as unsupervised learning or reinforcement learning.

[0049] Next, an example of determining the arrival floor will be described with reference to FIG. FIG. 6 is a table showing an example of determination by the floor determining unit 19 according to the first embodiment. An example of determining the arrival floor of a user using elevator 3 that is operating upward from the first floor is shown in Figure 6. In this example, the elevator 3 operates downward to the first floor, and then starts operating upward from the first floor. Note that the arrival floor is determined in the same way when operating upward from another floor, and when operating downward.

[0050] User A, who is traveling from the 1st floor to the 4th floor, registers a call with elevator 3 by operating hall control panel 9 on the 1st floor. User A then boards car 7 of elevator 3 that has arrived at the 1st floor. After boarding car 7, user A operates car control panel 10 to specify the 4th floor as the destination floor.

[0051] When the cage 7 of the elevator 3 departs from the first floor, the user identification unit 14 identifies the user who is in the cage 7 based on the image captured by the camera 12 inside the cage 7. In this example, only user A is in the cage 7. At this time, the user identification unit 14 identifies user A as the user who is in the cage 7. The elevator equipment determination unit 17 determines that the elevator equipment used by user A is the elevator 3. The floor determination unit 19 compares the user who was in the cage 7 when it departed from the floor where it stopped immediately before with the user who was in the cage 7 when it departed from the first floor, and determines the departure floor and arrival floor of the user. At this time, the floor where the cage 7 stopped immediately before is any floor above the first floor where it stopped during the downward operation. The floor determination unit 19 determines that the departure floor of user A, who was not in the cage 7 when it departed from the floor where it stopped immediately before and was in the cage 7 when it departed from the first floor, is the first floor.

[0052] When the elevator equipment determination unit 17 determines the elevator equipment used by user A, the consistency processing unit 18 performs a consistency process for obtaining consistency for user A. For example, if the elevator equipment determination unit 17 determines that user A has already used another elevator equipment at the same time, the consistency processing unit 18 causes the user identification unit 14 to identify multiple users who were erroneously identified as the same user as different users. When identifying users as different from each other, the user identification unit 14 extracts differences in the feature amounts of the users from the acquired images to improve the accuracy of identifying the users, and reconfirms the identification of the different users. The consistency processing unit 18 performs a similar consistency process for other users.

[0053] User B, who is moving from the second floor to the fifth floor, registers a call to the elevator 3 by operating the hall operation panel 9 on the second floor. After that, user B gets into the car 7 of the elevator 3 that has arrived at the second floor. User B who has gotten into the car 7 specifies the fifth floor as the destination floor by operating the car operation panel 10. User C, who is moving from the second floor to the fourth floor, arrives at the elevator 3 on the second floor. Since the call has already been registered by user B from the hall operation panel 9 on the second floor, user C who has arrived at the hall does not perform an operation to register the destination floor on the hall operation panel 9. In addition, user C does not need to have a mobile terminal such as a smartphone, card, or tag that accepts an operation to register the destination floor. After that, user C gets into the car 7 of the elevator 3 that has arrived at the second floor. Since the fourth floor has already been specified as the destination floor by user A, user C who has gotten into the car 7 does not perform an operation to register the destination floor on the car operation panel 10.

[0054] When the car 7 of the elevator 3 departs from the second floor, the user identification unit 14 identifies the users who are in the car 7 based on the image captured by the camera 12 inside the car 7. In this example, user A, user B, and user C are in the car 7. At this time, the user identification unit 14 identifies user A, user B, and user C as the users who are in the car 7. The elevator equipment determination unit 17 determines that the elevator equipment used by user B is the elevator 3. The floor determination unit 19 compares the users who were in the car 7 when it departed from the first floor, which is the floor where the elevator 3 stopped immediately before, with the users who were in the car 7 when it departed from the second floor, to determine the departure floor and arrival floor of the users. The floor determination unit 19 determines that the departure floor of user B and user C, who were not in the car 7 when it departed from the first floor and were in the car 7 when it departed from the second floor, is the second floor.

[0055] User D, who is traveling from the 3rd floor to the 6th floor, registers a call with elevator 3 by operating hall control panel 9 on the 3rd floor. After that, user A gets into car 7 of elevator 3 that has arrived at the 3rd floor. After getting into car 7, user D operates car control panel 10 to specify the 6th floor as the destination floor.

[0056] When the car 7 of the elevator 3 departs from the third floor, the user identification unit 14 identifies the users who are in the car 7 based on the image captured by the camera 12 inside the car 7. In this example, user A, user B, user C, and user D are in the car 7. At this time, the user identification unit 14 identifies user A, user B, user C, and user D as the users who are in the car 7. The elevator equipment determination unit 17 determines that the elevator equipment used by user D is the elevator 3. The floor determination unit 19 compares the users who were in the car 7 when it departed from the second floor, which is the floor where the elevator 3 stopped immediately before, with the users who were in the car 7 when it departed from the third floor, to determine the departure floor and arrival floor of the users. The floor determination unit 19 determines that the departure floor of user D, who was not in the car 7 when it departed from the second floor and was in the car 7 when it departed from the third floor, is the third floor.

[0057] User A and user C get off from car 7 of elevator 3 on the 4th floor.

[0058] When the car 7 of the elevator 3 departs from the 4th floor, the user identification unit 14 identifies the users who are in the car 7 based on the image captured by the camera 12 inside the car 7. In this example, user B and user D are in the car 7. At this time, the user identification unit 14 identifies user B and user D as the users who are in the car 7. The floor determination unit 19 compares the users who were in the car 7 when it departed from the 3rd floor, which is the floor where the elevator 3 stopped immediately before, with the users who were in the car 7 when it departed from the 4th floor, to determine the departure floor and arrival floor of the users. The floor determination unit 19 determines the arrival floor of user A and user C, who were in the car 7 when it departed from the 3rd floor and were not in the car 7 when it departed from the 4th floor, to be the 4th floor. In this way, even for user C who has not performed the operation to register the destination floor on the hall operating panel 9, the car operating panel 10, or a mobile terminal such as a smartphone, card, or tag, the interest measurement system 1 can obtain information on the departure floor and arrival floor based on images captured by the camera 12 inside the car 7.

[0059] User B gets off from car 7 of elevator 3 on the 5th floor.

[0060] When the car 7 of the elevator 3 departs from the 5th floor, the user identification unit 14 identifies the users who are in the car 7 based on the image captured by the camera 12 inside the car 7. In this example, only user D is in the car 7. At this time, the user identification unit 14 identifies only user D as the user who is in the car 7. The floor determination unit 19 compares the users who were in the car 7 when it departed from the 4th floor, which is the floor where the elevator 3 most recently stopped, with the users who were in the car 7 when it departed from the 5th floor, to determine the departure floor and arrival floor of the users. The floor determination unit 19 determines the arrival floor of user B, who was in the car 7 when it departed from the 4th floor and was not in the car 7 when it departed from the 5th floor, to be the 5th floor.

[0061] User D gets off from car 7 of elevator 3 on the 6th floor.

[0062] When the car 7 of the elevator 3 departs from the 6th floor, the user identification unit 14 identifies the user who is in the car 7 based on the image captured by the camera 12 inside the car 7. In this example, no user is in the car 7. At this time, the user identification unit 14 does not identify any user as a user who is in the car 7. The floor determination unit 19 compares the user who was in the car 7 when it departed from the 5th floor, which is the floor where the elevator 3 stopped immediately before, with the user who was in the car 7 when it departed from the 6th floor, to determine the departure floor and arrival floor of the user. The floor determination unit 19 determines the arrival floor of user D, who was in the car 7 when it departed from the 5th floor and was not in the car 7 when it departed from the 6th floor, to be the 6th floor.

[0063] Next, another example of determining the arrival floor will be described with reference to FIG. 7A to 7F are diagrams showing examples of determination by the floor determining unit 19 according to the first embodiment. 7 shows an example of determining the arrival floor of a user who has used multiple escalators 4 operating upward. The arrival floor is determined in the same way when one escalator 4 operating upward is used and when one or more escalators 4 operating downward are used. The arrival floor is also determined in the same way when stairs 5 are used.

[0064] As shown in FIG. 7A, user A traveling from the first floor to the fourth floor gets on escalator 4, which runs upward between the first and second floors, from the first floor.

[0065] When user A riding on escalator 4 enters the range captured by camera 12 installed at the exit on the second floor, i.e., when user A enters the frame of camera 12, user identification unit 14 identifies user A based on the image captured by camera 12. Lifting equipment determination unit 17 determines that the lifting equipment used by user A is the escalator 4. Floor determination unit 19 determines that the departure floor of user A is the first floor where the entrance to escalator 4 is located.

[0066] As shown in Fig. 7B, user A transfers from the second floor to escalator 4, which operates upward between the second and third floors. User B, who travels from the second floor to the fifth floor, transfers from the second floor to escalator 4, which operates upward between the second and third floors. User C, who travels from the second floor to the fourth floor, transfers from the second floor to escalator 4, which operates upward between the second and third floors.

[0067] When user A enters the frame of camera 12 installed at the exit on the third floor, user identification unit 14 identifies user A based on the image captured by camera 12. When user A is identified by camera 12 installed at the exit on the third floor before a preset time has elapsed since user A was identified by camera 12 installed at the exit on the second floor, floor determination unit 19 determines that user A has changed escalators 4 at the second floor.

[0068] When user B enters the frame of camera 12 installed at the exit on the third floor, user identification unit 14 identifies user B based on the image captured by camera 12. Lifting equipment determination unit 17 determines that the lifting equipment used by user B is the escalator 4. Floor determination unit 19 determines that the departure floor of user B is the second floor where the entrance to escalator 4 is located.

[0069] When user C enters the frame of camera 12 installed at the exit on the third floor, user identification unit 14 identifies user C based on the image captured by camera 12. Lifting equipment determination unit 17 determines that the lifting equipment used by user C is the escalator 4. Floor determination unit 19 determines that the departure floor of user C is the second floor where the entrance to escalator 4 is located.

[0070] As shown in FIG. 7C, user A transfers from the 3rd floor to escalator 4 that operates upward between the 3rd and 4th floors. User B transfers from the 3rd floor to escalator 4 that operates upward between the 3rd and 4th floors. User C transfers from the 3rd floor to escalator 4 that operates upward between the 3rd and 4th floors. User D, who is traveling from the 3rd floor to the 6th floor, transfers from the 3rd floor to escalator 4 that operates upward between the 3rd and 4th floors.

[0071] When user A enters the frame of camera 12 installed at the exit on the fourth floor, user identification unit 14 identifies user A based on the image captured by camera 12. When user A is identified by camera 12 installed at the exit on the fourth floor before a preset time has elapsed since user A was identified by camera 12 installed at the exit on the third floor, floor determination unit 19 determines that user A has changed escalators 4 at the third floor.

[0072] When user B enters the frame of camera 12 installed at the exit on the fourth floor, user identification unit 14 identifies user B based on the image captured by camera 12. When user B is identified by camera 12 installed at the exit on the fourth floor before a preset time has elapsed since user B was identified by camera 12 installed at the exit on the third floor, floor determination unit 19 determines that user B has changed escalators 4 at the third floor.

[0073] When user C enters the frame of camera 12 installed at the exit on the fourth floor, user identification unit 14 identifies user C based on the image captured by camera 12. When user C is identified by camera 12 installed at the exit on the fourth floor before a preset time has elapsed since user C was identified by camera 12 installed at the exit on the third floor, floor determination unit 19 determines that user C has changed escalators 4 at the third floor.

[0074] When user D enters the frame of camera 12 installed at the exit on the fourth floor, user identification unit 14 identifies user D based on the image captured by camera 12. Lifting equipment determination unit 17 determines that the lifting equipment used by user D is the escalator 4. Floor determination unit 19 determines that the departure floor of user D is the third floor where the entrance to escalator 4 is located.

[0075] As shown in FIG. 7D, user A gets off escalator 4 from the exit on the 4th floor. User B transfers to escalator 4, which operates upward between the 4th and 5th floors, at the 4th floor. User C gets off escalator 4 from the exit on the 4th floor. User D transfers to escalator 4, which operates upward between the 4th and 5th floors, at the 4th floor.

[0076] When user A is identified by the camera 12 installed at the exit on the fourth floor and a preset time has elapsed but user A is not identified by the camera 12 installed at the exit on the fifth floor, the floor determination unit 19 determines that the arrival floor of user A is the fourth floor.

[0077] When user B enters the frame of camera 12 installed at the exit on the fifth floor, user identification unit 14 identifies user B based on the image captured by camera 12. When user B is identified by camera 12 installed at the exit on the fifth floor before a preset time has elapsed since user B was identified by camera 12 installed at the exit on the fourth floor, floor determination unit 19 determines that user A has changed escalators 4 at the fourth floor.

[0078] When user C is not identified by the camera 12 installed at the exit on the fifth floor even after a preset time has elapsed since user C was identified by the camera 12 installed at the exit on the fourth floor, the floor determination unit 19 determines that the arrival floor of user C is the fourth floor.

[0079] When user D enters the frame of camera 12 installed at the exit on the fifth floor, user identification unit 14 identifies user D based on the image captured by camera 12. When user D is identified by camera 12 installed at the exit on the fifth floor before a preset time has elapsed since user D was identified by camera 12 installed at the exit on the fourth floor, floor determination unit 19 determines that user D has changed escalators 4 at the fourth floor.

[0080] As shown in Fig. 7E, user B gets off escalator 4 from the exit on the 5th floor. User D transfers to escalator 4, which runs upward between the 5th and 6th floors, at the 5th floor and moves on.

[0081] When user B is not identified by the camera 12 installed at the exit on the sixth floor even after a preset time has elapsed since user B was identified by the camera 12 installed at the exit on the fifth floor, the floor determination unit 19 determines that the arrival floor of user B is the sixth floor.

[0082] When user D enters the frame of camera 12 installed at the exit on the 6th floor, user identification unit 14 identifies user D based on the image captured by camera 12. When user D is identified by camera 12 installed at the exit on the 6th floor before a preset time has elapsed since user D was identified by camera 12 installed at the exit on the 5th floor, floor determination unit 19 determines that user D has changed escalators 4 at the 5th floor.

[0083] As shown in FIG. 7F, user D gets off escalator 4 from the exit on the sixth floor.

[0084] When user B is identified by camera 12 installed at the exit of the escalator 4 and user D is not identified by camera 12 installed at the exit of the escalator 4 even after a preset time has elapsed, floor determination unit 19 determines that the arrival floor of user B is the 6th floor.

[0085] Since users get on and off the escalator 4 at their own timing, the floor determination unit 19 manages information on the status of getting on and off for each user.

[0086] Also, while an example of determining the arrival floor of a user of escalator 4 has been described using Fig. 7, the arrival floor of a user of stairs 5 is determined in a similar manner. The difference is that users of escalator 4 can move between floors without walking, but users of stairs 5 move between floors by walking. For users of escalator 4 and users of stairs 5, user identification by user identification unit 14, user exclusion processing by matching processing unit 18, and determination of the start floor and end floor of use of the elevator facility by camera 12 are performed in the same manner, including the process flow.

[0087] Next, an example of acquiring behavior information on the arrival floor will be described with reference to Fig. 8 and Fig. 9. Also, an example of acquiring interest information on the arrival floor will be described with reference to Fig. 10. 8, 9A, and 9B are diagrams showing examples of acquisition of behavioral information by the interest measurement system 1 according to the first embodiment. 10A to 10C are diagrams showing an example of acquisition of interest information by the interest measurement system 1 according to the first embodiment.

[0088] The bird's-eye view map of the arrival floor shown in FIG. 8, FIG. 9, and FIG. 10 is generated based on images taken by a plurality of cameras 12 installed on the arrival floor, for example. The bird's-eye view map is an image obtained by pasting together a plurality of images taken of the arrival floor at the same time on a plane, and synthesizing the images so that no inconsistency occurs in the peripheral parts of the overlapping images. In this case, the bird's-eye view map may include an invisible area. The invisible area is an area that cannot be photographed by any of the cameras 12. The invisible area may be, for example, the inside of the elevator shaft after the car 7 of the elevator 3 moves from the arrival floor, a toilet installed on the arrival floor, or an area that is known not to be used by users. The bird's-eye view map is generated in advance based on images acquired at a time when there are no users, such as at night or early in the morning. The bird's-eye view map may be updated, for example, once a day, or may be updated as appropriate. The images used to generate the overhead map are preferably taken at the same time by multiple cameras 12 at the arrival floor because there is a possibility that users may be captured in the images, but the overhead map does not necessarily have to be generated from images all taken at the same time. The overhead map may be generated from multiple images taken at different times in which users are not captured.

[0089] In FIG. 8, an example of a user who has taken elevator 3 and arrived at the arrival floor is shown.

[0090] The behavior information acquisition unit 15 starts acquiring behavior information, for example, when a user arrives at an arrival floor. The behavior information acquisition unit 15 determines that a user has arrived at an arrival floor, for example, when the floor determination unit 19 determines the arrival floor of any user. The behavior information acquisition unit 15 acquires an overhead map of the arrival floor when the user arrives at the arrival floor.

[0091] In this example, the behavioral information acquisition unit 15 arranges information represented by at least three feature amounts of the user, namely, both shoulders and the nose, acquired based on the image on the bird's-eye view map. In this way, the coordinates of the user on the bird's-eye view map at the arrival floor are acquired. The behavioral information acquisition unit 15 adds the information acquired in this way to the behavioral information as time-series data, as information representing the user's arrangement.

[0092] Then, after a preset time interval has elapsed, the behavior information acquisition unit 15 acquires new information representing the location of the user. The behavior information acquisition unit 15 adds the newly acquired information to the behavior information as time-series data. In this way, the behavior information acquisition unit 15 continuously updates the behavior information of the user.

[0093] As shown in Fig. 9A, when a user frames out into an invisible area such as a restroom, the behavior information acquisition unit 15 starts measuring the time that has elapsed since the user frames out. During this time, the behavior information acquisition unit 15 suspends acquisition of behavior information about the user. Thereafter, as shown in Fig. 9B, when the user frames in from the invisible area before a preset time has elapsed since the user frames out, the behavior information acquisition unit 15 continues acquisition of behavior information about the user.

[0094] When a user moves from the arrival floor to another floor, the behavior information acquisition unit 15 identifies the movement of the user in cooperation with the camera 12 inside the car 7 of the elevator 3, the camera 12 of the escalator 4, the camera 12 of the stairs 5, and the multiple cameras 12 on the other floors. When a preset time has elapsed since the user went out of frame while moving to a certain floor and the user is no longer connected to the multiple cameras 12, the behavior information acquisition unit 15 records, for example, the time and place where the user last went out of frame. At this time, the behavior information acquisition unit 15 may, as necessary, display the location on the bird's-eye view map and alert the user by an alarm or the like.

[0095] The behavioral information storage unit 16 stores, for each user, the behavioral information acquired by the behavioral information acquisition unit 15. The behavioral information storage unit 16 accumulates and stores multiple pieces of behavioral information for the same user.

[0096] The interest information acquiring unit 20 acquires the interest information of the user every time the behavior information acquiring unit 15 completes acquisition of the behavior information of the user at the arrival floor.

[0097] 10A, the interest information acquiring unit 20 superimposes information indicating the location of the user, which is included in the behavior information on the arrival floor, on the bird's-eye view map of the arrival floor. In this example, the interest information acquiring unit 20 superimposes a triangle consisting of three coordinate points of at least three feature amounts of both shoulders and the nose, which are included in the behavior information as time-series data, and a direction from the midpoint of the line segment connecting the two shoulders toward the nose, on the bird's-eye view map of the arrival floor.

[0098] As shown in FIG. 10B, the interest information acquisition unit 20 identifies and acquires the area and attributes on the extension line of the direction from the midpoint of the line segment connecting the two shoulders toward the nose, which are included in the behavior information as time-series data. The interest information acquisition unit 20 extends the user's direction represented in each piece of interest direction information forward of the user. The interest information acquisition unit 20 detects the intersection points of multiple half lines extended forward of the user. The interest information acquisition unit 20 identifies the area and attributes where the intersection points are concentrated as a range of high interest of the user. At this time, the interest information acquisition unit 20 may include information on the level of interest of the user according to the density of the intersection points, for example, in the interest information of the user. The interest information acquisition unit 20 reads the attributes of the area identified as the range of high interest of the user from the attribute storage unit 13. The interest information acquisition unit 20 includes the read attributes in the interest information as attributes of high interest of the user. At this time, the interest information acquisition unit 20 associates the read attributes with the information on the level of interest of the user and acquires them.

[0099] As shown in FIG. 10C, the interest information acquisition unit 20 generates a user's trajectory by connecting interest direction information on the bird's-eye view map. The interest information acquisition unit overlays the time when the user was at each point of the user's trajectory on the bird's-eye view map. When tracing the trajectory generated in this way, a place where the time points are dense may appear. Such a place corresponds to a place where the user spent a long time. The interest information acquisition unit 20 may include the place where the user spent a long time as an element of the interest information of the user.

[0100] The interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user. When the interest information acquisition unit 20 acquires interest information about a user for which interest information has already been stored, the interest information storage unit 21 may update the stored interest information. For example, the interest information storage unit 21 may add information on the level of interest for each attribute calculated by the interest information acquisition unit 20 to the stored information on the level of interest for each attribute. By sequentially updating the interest information for each user, the accuracy of the interest information recorded by the interest information storage unit 21 is further improved.

[0101] Another example of acquiring interest information at the arrival floor will be described with reference to FIG. FIG. 11 is a diagram showing an example of acquisition of interest information by the interest measurement system 1 according to the first embodiment.

[0102] The interest information acquisition unit 20 may acquire the interest of a certain user in another user as interest information. The interest information between users is acquired, for example, when the users are employees in the building 2. The interest information between users corresponds to, for example, the amount of communication between the users, such as the frequency or time. In this example, the interest information acquisition unit 20 calculates the interest information between users based on the contact time between the users. The contact information is the time that the users continuously stay in the same area.

[0103] FIG. 11 shows the trajectories of user A and user B. In FIG. 11, the trajectories of each user are displayed on a three-dimensional space-time spanned by two-dimensional spatial coordinates representing the position on the bird's-eye view map and a time axis perpendicular to the bird's-eye view map. In this example, user A stays in a certain area in building 2. While user A stays in the area, user B enters the area. User B talks with user A in the area and then leaves the area. At this time, interest information acquisition unit 20 calculates the contact time of user A and user B as the time from when user B enters the area to when he leaves. Interest information acquisition unit 20 acquires interest information such that the longer the contact time, the higher the interest level of user A and user B in each other.

[0104] Next, an example of presenting a destination to a user will be described with reference to FIG. 12 and FIG. 12A and 12B, and 13A and 13B are diagrams showing examples of destination presentation by the interest measurement system 1 according to the first embodiment.

[0105] FIG. 12 shows an example of a building 2 to which the interest measurement system 1 is applied.

[0106] 12A shows a building 2 on a certain day. In this building 2, store P, which sells items P1 and P2, is located in the fourth floor area. Store Q, which sells items Q1 and Q2, is located in the third floor area. Store R, which provides services R1 and R2, is located in the second floor area.

[0107] By this date, the interest measurement system 1 has acquired interest information for users A, B, and C. The interest information storage unit 21 stores product P1 as the attribute with the highest interest for user A. The interest information storage unit 21 stores store Q as the attribute with the highest interest for user B. The interest information storage unit 21 stores service R2 as the attribute with the highest interest for user C.

[0108] In FIG. 12B, the same building 2 is shown at a later date. By this date, store P, which sells item P1, has moved to the second floor area. Store R has also closed down. Store S, which offers services S1 and R2, has opened in the fourth floor area.

[0109] User A, who used the building 2 again on this day, is identified by the user identification unit 14 by images captured by the multiple cameras 12 installed on the first floor or the camera 12 in the car 7 of the elevator 3 that the user rode in. At this time, the destination presentation unit 22 reads interest information about user A from the interest information storage unit 21. In this example, the destination presentation unit 22 presents the area with the most interesting attribute to the user as a destination. That is, the area with the most interesting attribute is presented preferentially. For this reason, the destination presentation unit 22 acquires the item P1 as the attribute with the most interesting attribute of user A. The destination presentation unit 22 extracts an area having the item P1 as an attribute from the attribute storage unit 13. In this example, the destination presentation unit 22 extracts the area on the second floor where the relocated P store is located. The destination presentation unit 22 presents the extracted area to user A as a destination.

[0110] Furthermore, user B, who used building 2 again on this day, is identified by user identification unit 14 by images taken by multiple cameras 12 installed on the first floor or by the camera 12 at the exit of escalator 4 taken before getting off after boarding. At this time, similar to the presentation to user A, destination presentation unit 22 presents the area on the third floor where store Q is located as a destination based on the interest information. Furthermore, user C, who used building 2 again on this day, is identified by user identification unit 14 by images taken by multiple cameras 12 installed on the first floor or by the camera 12 of staircase 5 taken before arriving at the arrival floor after starting to use staircase 5. At this time, similar to the presentation to user A, destination presentation unit 22 presents the area on the fourth floor where store S, which provides service R2, is located as a destination based on the interest information.

[0111] For a user using the escalator 4 or the stairs 5, the destination presentation unit 22 presents the destination floor including the destination area and the route to the destination area, for example, by video or audio. At this time, the destination presentation unit 22 may also present to the user the attribute that the user is most interested in, which was used to extract the user's destination. For example, the destination presentation unit 22 may present information such as "Store Q is to the left of the exit on the third floor" to user B. In addition, the destination presentation unit 22 may present information such as "Store S, which provides service R2, is in front of the exit on the fourth floor" to user C. This allows the presentation of destinations to users without using personal information such as the user's name.

[0112] Fig. 12 shows an example of the presentation of the destination through the car operation panel 10. In this example, the second floor is presented as the destination floor to user A who is in the car 7. Note that, although Fig. 12 shows an example of the case where the car operation panel 10 is used, if a mobile terminal such as a smartphone carried by a user can directly or indirectly communicate with the elevator 3, alerting the user, registering a call, providing guidance, and the like may be performed through the mobile terminal in the same way as in the case where it is performed through the car operation panel 10.

[0113] As shown in FIG. 13A, the destination presentation unit 22 flashes the light-emitting device of the destination button 10b corresponding to the second floor to present a notice to the user A before registering the second floor as the destination floor. At this time, the destination presentation unit 22 may also display an image such as "Store P, which handles item P1, is on the second floor" on a display device such as the display panel 10a. The destination presentation unit 22 may also present audio guidance on a built-in speaker of a display device such as the display panel 10a. Here, for example, when a preset time has elapsed since the presentation by the flashing of the light-emitting device was started, the call registration unit 23 automatically registers a call with the presented floor as the destination floor in the elevator 3 in which the user A is riding. At this time, none of the destination buttons 10b may be operated. Immediately after the call is automatically registered, the destination presentation unit 22 ends the presentation of the destination floor guidance by the flashing of the light-emitting device of the destination button 10b corresponding to the second floor. Also, for example, immediately after the destination button 10b is operated and the call is registered, the destination presentation unit 22 ends the presentation of the destination floor guidance by blinking the light-emitting device of the destination button 10b corresponding to the second floor.

[0114] Thereafter, as shown in Fig. 13B, the light-emitting device of the destination button 10b corresponding to the floor designated as the destination floor lights up. At this time, the call registration is confirmed. For example, when the destination button 10b corresponding to the destination floor presented by the destination presentation unit 22 is operated, when the car 7 stops at the destination floor, the destination presentation unit 22 may present guidance such as a video or audio showing information such as "P store is on the right side after getting off the elevator 3 at this floor."

[0115] The destination presentation unit 22 may continue presenting the destination when the destination button 10b corresponding to a floor other than the presented destination floor is operated. Alternatively, for example, when there is only one user in the car 7, the destination presentation unit 22 may end presenting the destination when the destination button 10b corresponding to a floor other than the presented destination floor is operated.

[0116] In addition, the destination presentation unit 22 may present the destination floor without blinking the light-emitting device of the destination button 10b. For example, the destination presentation unit 22 may present the destination floor to the user by changing the brightness of the light-emitting device of the destination button 10b corresponding to the destination floor, or by changing the color tone of the light-emitting device.

[0117] In this example, information on the destination actually presented to the user by the destination presentation unit 22 is stored in the behavioral information storage unit 16 or the interest information storage unit 21, etc., in association with the user's behavioral information or interest information, or information such as the place or time when the destination was presented.

[0118] Next, an example of visualization of the distribution of interest levels will be described with reference to FIG. 14A to 14E are diagrams showing examples of interest maps generated by the interest measurement system 1 according to the first embodiment.

[0119] The visualization processing unit 27 generates an interest map by integrating interest information for each user of the building 2, as shown in Fig. 14A, for example. At this time, the generation of an interest map for all users from the first time to the second time on any floor of the building 2 is specified based on the interest map generation conditions determined by operation of the operation display unit 28 by the owner of the building 2 or the like. Here, the first time and the second time are times specified in the generation conditions. The first time and the second time may be different times on the same day, or may be times on different dates.

[0120] The visualization processing unit 27 reads interest information stored in the interest information storage unit 21 including time and location information for all users on the floor of the building 2 between the first time and the second time specified in the generation condition. The visualization processing unit 27 integrates the interest information by, for example, aggregating the level of interest for each user in the read interest information for the location of the floor, that is, for each area and attribute. For example, when the level of interest is acquired for each attribute, the visualization processing unit 27 may aggregate the sum of the level of interest for each attribute for each area of ​​the floor. Thereby, the interest map is generated as, for example, a diagram in which a three-dimensional graph of the level of interest is superimposed on an overhead map of the floor. The generated interest map is displayed to the owner of the building 2 on the operation display unit 28.

[0121] Alternatively, as shown in Fig. 14B, for example, the visualization processing unit 27 generates an interest level map for each user of the building 2. At this time, the generation of an interest level map for a specific user from a first time to a second time on any floor of the building 2 is specified from an interest level map generation condition determined by an operation on the operation display unit 28 by the owner of the building 2 or the like. In the generation condition, for example, a specific user A is specified.

[0122] The visualization processing unit 27 reads the interest information of user A stored in the interest information storage unit 21 including time and location information between the first time and the second time specified in the generation condition. The visualization processing unit 27 generates a degree of interest map, for example, as a diagram in which a three-dimensional graph of the level of interest of user A is superimposed on an overhead map of the floor. The generated degree of interest map is displayed to the owner of the building 2, etc., on the operation display unit 28.

[0123] 14C , for example, the visualization processing unit 27 is instructed to generate an interest level map including behavioral information about the user A on any floor of the building 2 from a first time to a second time based on an interest level map generation condition determined by an owner of the building 2 or the like operating the operation display unit 28. The visualization processing unit 27 may generate an interest level map including behavioral information about the user.

[0124] Alternatively, the visualization processing unit 27 is instructed to generate a degree of interest map including behavioral information of users who fit certain classification information from a first time to a second time on any floor of the building 2, based on a generation condition of the degree of interest map determined by an operation on the operation display unit 28 by an owner of the building 2 or the like. The visualization processing unit 27 may generate a degree of interest map including behavioral information of a plurality of users.

[0125] The visualization processing unit 27 reads the interest information of the user A stored in the interest information storage unit 21 including the time and location information between the first time and the second time specified in the generation condition. The visualization processing unit 27 also reads the behavioral information of the user A stored in the behavioral information storage unit 16 including the time and location information between the first time and the second time specified in the generation condition. The visualization processing unit 27 generates a degree of interest map, for example, as a diagram in which a three-dimensional graph of the level of interest of the user A and the trajectory of the user A are superimposed on an overhead map of the floor. If the user A uses the floor multiple times, the degree of interest map may include multiple trajectories of the user A. In this example, the visualization processing unit 27 generates a degree of interest map including an area in which the user A has a high degree of interest. The area in which the user A has a high degree of interest is, for example, store P that handles the product P1. The generated degree of interest map is displayed to the owner of the building 2 on the operation display unit 28.

[0126] The interest level map may also display classification information of user A. The classification information of user A includes, for example, information such as the frequency of user A's use of building 2, gender, age group, time of use, day of the week of use, and weather at the time of use. The interest level map may display only one of user A's trajectory or classification information.

[0127] Alternatively, the visualization processing unit 27 may generate an interest map including behavior information or interest information of multiple users, as shown in Fig. 14D, for example. The multiple users may be some or all of the users of the building 2 who satisfy a certain condition specified in the generation condition of the interest map. For example, the generation of an interest map for users who showed interest in a specific attribute from among users on any floor of the building 2 from the first time to the second time is specified from the generation condition of the interest map determined by operation of the operation display unit 28 by the owner of the building 2, etc. In the generation condition, for example, an item P1 is specified as the specific attribute.

[0128] The visualization processing unit 27 reads the interest information and behavior information stored in the interest information storage unit 21 and the behavior information storage unit 16, including time and location information, for all users on the floor of the building 2 between the first time and the second time specified in the generation condition. Based on the read interest information, the visualization processing unit 27 extracts users whose interest level in the item P1 is higher than a certain threshold determined by operating the operation display unit 28. In this example, five users, user A, user B, user C, user D, and user E, are extracted. Based on the read behavior information, the visualization processing unit 27 generates an interest level map, for example, as a diagram in which the trajectory of each extracted user is superimposed on an overhead map of the floor. In this example, an interest level map is generated as a diagram in which the trajectory of each user is superimposed on multiple overhead maps of the same floor.

[0129] Alternatively, the visualization processing unit 27 may generate an interest level map by extracting users who exhibit behaviors that deviate from the tendencies of main users among a plurality of users, as shown in Fig. 14E for example. For example, the owner of the building 2 or the like specifies the generation of an interest level map for users who exhibit behaviors that deviate from the tendencies of main users among users on any floor of the building 2 based on the interest level map generation conditions determined through operation on the operation display unit 28.

[0130] The visualization processing unit 27 reads the interest information and behavior information stored in the interest information storage unit 21 and the behavior information storage unit 16, including the time and location information, for all users of the floor specified in the generation conditions. The visualization processing unit 27 extracts users whose behavior deviates from the tendency of the main users based on the interest information read in. The extraction conditions may be specified in the generation conditions of the interest level map. The extraction conditions are, for example, conditions based on a distribution that represents the tendency of the main users to use the facility. The distribution is, for example, the time period during which the users use the facility. The degree of agreement with the distribution is determined based on, for example, how far the usage pattern of each user is from the average value of the distribution in units of standard deviation σ. The visualization processing unit 27 extracts, for example, users who use the facility at a time that is 3σ or more away from the average time of the distribution of the user's usage time period. At this time, the visualization processing unit 27 extracts, for example, users in the late night time period. Regardless of the average and standard deviation shown in this example, users whose behavior deviates from the tendency of the main users may be extracted by various statistical methods.

[0131] In this example, two users, user J and user K, are extracted. Each store in the building 2 is closed during the late night hours. User J behaves regularly inside the building 2 with high frequency and does not show a high level of interest biased to a specific area. User J can be presumed to be a security guard circulating inside the building 2. The owner of the building 2 or the like can confirm whether user J is a security guard or not by checking the time when user J is active and the working status of the security guard. On the other hand, user K uses the building 2 with low frequency and shows a level of interest biased to a specific area. In addition, the trajectory of user K shows irregular and suspicious behavior. At this time, user K may be a suspicious person who has invaded the building 2. In this case, the owner of the building 2 or the like can grasp the intrusion of a suspicious person. The visualization processing unit 27 may detect a user who shows behavior that deviates from the tendency of main users at any time, regardless of the operation of the owner of the building 2 or the like. When the visualization processing unit 27 detects the user, the operation display unit 28 may notify the owner of the building 2 or the like. This can prevent damage such as theft in the building 2 in advance.

[0132] Next, an example of a simulation of changes in interest information will be described with reference to FIG. 15A and 15B are diagrams showing examples of the interest map generated by the interest measurement system 1 according to the first embodiment. FIG. 15C is a diagram showing an example of setting simulation conditions in the simulation system 50 according to the first embodiment. 15D and 15E are diagrams showing examples of the results of a simulation performed by the simulation system 50 according to the first embodiment.

[0133] The owner of building 2 or the like refers to the interest level map generated by visualization processing unit 27, for example, as shown in FIG. 15A, by operation display unit 28. In this example, the interest level map is generated by integrating interest information of all users on a specific day designated by the owner of building 2 or the like. For example, the first time is set to the opening time of building 2 on the specific day, and the second time is set to the closing time of building 2 on the specific day. The interest level map is generated for the second floor, which is a specific floor of building 2.

[0134] Store P, which sells product P1, is located on the second floor of building 2. Also located on the same floor are store Q, which sells product Q1, and store R, which sells service R1. Also located on the second floor of building 2 are stores S and T. According to the interest map, the interest level of stores S and T is low. In other words, stores S and T have low customer attraction power. In this case, if the interest level of stores S and T can be increased, the value of building 2 may be increased.

[0135] The owner of the building 2 or the like refers to the trajectory of the users in the building 2 shown by the interest map, for example, as shown in FIG. 15B. In this example, the trajectories of users A, B, and C are visualized. By this date, the interest measurement system 1 has acquired interest information of users A, B, and C. The interest information storage unit 21 stores item P1 as an attribute of high interest for user A. The interest information storage unit 21 stores store Q as an attribute of high interest for user B. The interest information storage unit 21 stores service R1 as an attribute of high interest for user C. On the day when the interest map was generated, user A went to store P, which handles item P1. On this day, user B went to store Q and acted near item Q1. On this day, user C went to store R, which handles service R1. The owner of building 2, for example, can consider a layout that will further increase the value of building 2 based on information such as the level of interest and trajectories of users ascertained through the interest map.

[0136] The owner of building 2 or the like uses a simulation by simulation system 50 to consider the layout. The owner of building 2 or the like sets the simulation conditions, for example, through the operation display unit 28 or the like. The owner of building 2 or the like edits the layout of the second floor of building 2 as the simulation conditions, for example, as shown in FIG. 15C. In the edited layout of this example, one-way traffic is set in the passage adjacent to store T. In addition, in the edited layout, the locations of store Q and store S are swapped. After setting the simulation conditions by editing the layout, the owner of building 2 or the like causes the simulation system 50 to start the simulation, for example, through the operation display unit 28 or the like.

[0137] The simulation processing unit 29 performs a simulation, for example, as follows.

[0138] The simulation processing unit 29 sets users to be the targets of the simulation. For example, the simulation processing unit 29 sets all or part of the users specified by the generation conditions of the interest level map as the targets of the simulation. In this example, the simulation processing unit 29 sets users A, B, and C as the targets of the simulation. The simulation processing unit 29 may add virtual users who are highly interested in attributes of a specific area, for example, to the targets of the simulation. The simulation processing unit 29 may add one or more virtual users to the targets of the simulation. At this time, classification information, such as age and gender, may be assigned to each of the virtual users. The virtual users to be added, as well as the classification information and interest information, are specified, for example, in the simulation conditions. In addition, conditions outside the building 2, such as weather, may be specified in the simulation conditions. The conditions outside the building 2 are used, for example, for selecting users to be the targets of the simulation and adding virtual users.

[0139] The simulation processing unit 29 sets a destination area in the building 2 for each user who is the subject of the simulation. For example, for a user who actually acts on the second floor of the building 2, the simulation processing unit 29 sets the area that the user actually went to on the second floor as the destination area. The area that the user went to has, for example, an attribute of a destination area in which each user had a high level of interest. The destination area may include an elevator facility as the start or end point of a trajectory on the second floor. The destination area may include an invisible area such as a toilet. When there are multiple destination areas for a user, the simulation processing unit 29 sets the order of the destination areas. For example, the order may be set in descending order of interest, or may be set so that the travel distance on the second floor becomes shorter.

[0140] The simulation processing unit 29 generates simulated behavioral information on the second floor for each user to be simulated. For example, for a user who actually acted on the second floor of the building 2, when there is no edited portion of the layout on the trajectory of the user, the simulation processing unit 29 generates simulated behavioral information based on the actual trajectory of the user on the second floor in the same manner as the processing in the behavioral information acquisition unit 15. Alternatively, the simulation processing unit 29 sets the trajectory of the user in the order in which the destination areas are set for each user. At this time, the simulation processing unit 29 sets the trajectory of the user, for example, assuming that the user moves between one or more destination areas without making a detour. The simulation processing unit 29 may disturb the trajectory of the user by using a random number or the like. The simulation processing unit 29 may set the trajectory of the user by using a known technique such as a people flow simulation. The simulation processing unit 29 generates simulated behavioral information based on the set trajectory in the same manner as the processing in the behavioral information acquisition unit 15. Here, the simulation processing unit 29 generates simulated behavior information by assuming that the user's interest direction information is forward, regardless of whether it is to the left or right, of the trajectory set for the user.

[0141] The simulation processing unit 29 generates simulated interest information for each user who is the subject of the simulation, in the same manner as the processing in the interest information acquiring unit 20, based on the simulated generated behavior information.

[0142] The simulation processing unit 29 generates the results of the simulation as an interest level map, similar to the processing in the visualization processing unit 27, based on the simulated generated behavior information and interest information.

[0143] The simulation processing unit 29 calculates the difference between the result of the simulation and the information stored in the interest information storage unit 21. The simulation processing unit 29 calculates the difference, for example, by taking the difference in distribution of the level of interest between the result of the simulation and the actually acquired interest information.

[0144] FIG. 15D is a diagram showing an example of a trajectory for each user as a result of a simulation. In this example, since there is no edited layout on the trajectories of user A and user C, the simulated trajectories of user A and user C are the same as the actual trajectories. On the other hand, since the layout of store Q, which user B visited, has been edited, user B's trajectory is set to reach store Q through an aisle adjacent to store T. Here, since the aisle is set to be one-way, user B's trajectory is set to pass through different aisles on the way to store Q and on the way back from store Q. At this time, the interest direction of user B moving around the second floor is directed toward store S and store T. In this case, the interest level in store S and store T is increased.

[0145] 15E is a diagram showing the distribution of interest levels on the second floor as a result of the simulation. In this way, the interest level map that visualizes changes in interest information allows the owner of building 2 and others to understand the impact of layout editing on the interest levels.

[0146] The simulation system 50 may simulate, across a plurality of floors, a change in the interest information of a user who moves across a plurality of floors. Another example of a simulation of a change in interest information across a plurality of floors will be described with reference to Fig. 16 . FIG. 16A is a diagram showing an example of the interest map generated by the interest measurement system 1 according to the first embodiment. FIG. 16B is a diagram showing an example of a result of the simulation performed by the simulation system 50 according to the first embodiment.

[0147] As shown in FIG. 16A, in the building 2 of this example, Pa store, Pb store, Pc store, Pd store, Pe store, and Pf store are located on the first floor. Pc store sells product Pc1. Qa store, Qb store, Qc store, Qd store, Qe store, and Qf store are located on the second floor. Qa store sells product Qa1. Qb store sells product Qb1. Qc store sells product Qc1. Ra store, Rb store, Rc store, Rd store, and Re store are located on the third floor. Ra store sells product Ra1. Rb store sells product Rb1. In the building 2, a toilet is provided on the third floor. In the building 2, the fourth floor is an office floor. Elevators 3a and 3b, as well as stairs 5, are provided as elevators for users of the building 2 to use to move between the first to fourth floors. An escalator 4 is provided as an elevator that users of building 2 can use to move between the first to third floors.

[0148] The trajectories of each user, including user A, user B, and user C, are stored in the behavior information storage unit 16 as behavior information.

[0149] According to the trajectory of user A, after entering building 2 from the entrance, user A uses elevator 3a to move from the first floor to the second floor. User A then shows interest in item Qa1 at store Qa on the second floor. User A then uses escalator 4 to move from the second floor to the third floor. User A then stops by the restroom on the third floor. User A then shows interest in item Ra1 at store Ra on the third floor. User A then uses elevator 3b to move from the third floor to the first floor. User A then leaves building 2 from the entrance.

[0150] According to the trajectory of user B, after entering building 2 from the entrance, user B uses elevator 3b to move from the first floor to the third floor. User B then stops by the restroom on the third floor. User B then shows interest in item Rb1 at store Rb on the third floor. User B then uses elevator 3b to move from the third floor to the second floor. User B then shows interest in item Qb1 at store Qb on the second floor. User B then uses elevator 3b to move from the second floor to the first floor. User B then leaves building 2 from the entrance.

[0151] According to the trajectory of user C, after entering building 2 through the entrance, user C shows interest in item Pc1 at Pc store on the first floor. User C then uses escalator 4 to move from the first floor to the second floor. User C then shows interest in item Qc1 at Qc store on the second floor. User C then uses elevator 3a to move from the second floor to the first floor. User C then exits building 2 through the entrance.

[0152] By overlaying such user trajectories on an overhead map of each floor, sparse areas where the density of user trajectories is low are visualized. In FIG. 16A, the sparse areas are indicated by dashed-dotted frames. FIG. 16A shows that there is room for improvement in Building 2, such as congestion around the entrances and exits, low usage of escalator 4 compared to elevator 3, and many sparse areas on each floor. The owner of Building 2 and others will consider the layout of each floor of Building 2 to address these issues.

[0153] The owner of building 2 or the like uses a simulation by simulation system 50 to consider the layout. The owner of building 2 or the like sets the simulation conditions, for example, via operation display unit 28 or the like. The owner of building 2 or the like edits the layout of the first to third floors of building 2 as the simulation conditions, for example, as shown in Fig. 16B. Note that in this example, the fourth floor, which is an office floor, and the users of the fourth floor are excluded from the target of the simulation.

[0154] In the edited layout of the first floor of this example, one-way traffic is set at each of the entrance and exit. In the edited layout, a panel that guides users from the entrance to the Pa store, which was in the sparse area, is provided. In the edited layout, the Pe store is placed in a location adjacent to the Pa store, which was in the sparse area. In the edited layout, the Pb store, the Pd store, and the Pf store, which were in the sparse area, are concentrated and placed in a location adjacent to the Pe point. In the edited layout, a rest area is placed in a location overlooking the Pb store, the Pd store, and the Pf store, which were in the sparse area. In the edited layout of this example, the escalator 4 is limited to uphill operation. In the edited layout, the elevators 3a and 3b are limited to downhill operation. In the edited layout of the second floor of this example, the Qc store, the Qd store, the Qe store, and the Qf store, which were in the sparse area, are concentrated and placed in a location near the escalator 4. In the edited layout of the second floor in this example, an entrance leading to the Qf store is provided, and an exit leading to the Qc store is provided. These are the settings of the entrances and exits to be passed through in the layout of the second floor. In the edited layout of the third floor in this example, the Rc store, the Rd store, and the Re store, which were in sparse areas, are concentrated and placed in a concentrated manner. In the edited layout of the third floor in this example, an entrance leading to the Re store is provided, and an exit leading to the Rc store is provided. These are the settings of the entrances and exits to be passed through in the layout of the third floor. Note that in this example, elevators 3a and 3b are not limited to down-bound operation for users on the fourth floor, which is an office floor.

[0155] After setting the simulation conditions by editing the layout, the owner of the building 2 or the like causes the simulation system 50 to start the simulation via the operation display unit 28, for example.

[0156] The simulation processing unit 29 performs a simulation across multiple floors in the same manner as the simulation on a single floor. The simulation processing unit 29 sets users to be the targets of the simulation. For example, the simulation processing unit 29 sets multiple users, including user A, user B, and user C, excluding users on the fourth floor, as targets of the simulation. The simulation processing unit 29 sets attributes of high interest in the building 2 for each of the users to be the targets of the simulation. The simulation processing unit 29 generates simulated behavior information on the first, second, and third floors for each of the users to be the targets of the simulation. The simulation processing unit 29 generates simulated interest information for each of the users to be the targets of the simulation, in the same manner as the processing in the interest information acquisition unit 20, based on the simulated behavior information.

[0157] In this example, the effect of alleviating congestion near the entrance and exit by making the entrance and exit one-way is simulated. In addition, by concentrating the stores that were in the sparse area, the interest of users is more likely to be directed to each store. In addition, by guiding the movement route of users to the stores that were in the sparse area, the interest of the users is more likely to be directed to the stores. In addition, by arranging a rest area in a location facing the stores that were in the sparse area, the interest of users is more likely to be directed to each store. The simulation system 50 simulates the effect of increasing the interest level in the sparse area by such changes. In addition, the effect of leveling out the utilization rate of each lifting facility such as the elevator 3 and the escalator 4 by restricting the movement direction of users is simulated.

[0158] The interest measurement system 1 may be used for managing the work environment of employees in the building 2. The simulation system 50 may be used for improving the work environment of employees in the building 2. An example of acquiring interest information of employees in the building 2 as users and simulating changes in the interest information will be described with reference to Fig. 17 . FIG. 17A is a diagram showing an example of the layout of the building 2 according to the first embodiment. FIG. 17B is a diagram showing an example of a result of the simulation performed by the simulation system 50 according to the first embodiment.

[0159] As shown in FIG. 17A, in the building 2 of this example, the first, second, and third floors are store floors. In the building 2, the fourth floor is an office floor where employees work. In the building 2, the management office, the store staff room, the warehouse, and the common area are provided on the fourth floor. In the building 2, a corridor with a wall is provided between the management office and the store staff room. In the management office, desks are provided where users W and Y perform clerical work. Users W and Y are employees who are involved in the management work of the building 2. In the store staff room, desks are provided where users X and Z perform clerical work. User X is an employee who is involved in the work of the store P located in the building 2. User Z is an employee who is involved in the work of the store Q located in the building 2. In the warehouse, the item P1 and the like are stored as inventory in the inventory management area of ​​the store P. The common area is a place that is used regardless of the affiliation of the user. The common area is, for example, a kitchenette or a break room.

[0160] The interest information acquisition unit 20 acquires interest information of users based on the behavioral information of the users. The interest information acquisition unit 20 acquires interest information among users based on, for example, contact time in an area included in the common area.

[0161] In this example, the interest information storage unit 21 stores user X and user Y as subjects of high interest for user W. For user X, the interest information storage unit 21 stores item P1 in the inventory management area of ​​store P and user Z as attributes of high interest for user X. For user Y, the interest information storage unit 21 stores user Y's desk in the management office and user W as attributes of high interest for user Y. For user Z, the interest information storage unit 21 stores user Z's desk in the store staff room and user X as attributes of high interest for user Z.

[0162] The owner of the building 2 or the like can understand the movement lines of the employees, the work efficiency of the employees, the state of interaction between the employees, etc. by referring to the interest level map generated by the visualization processing unit 27 on the operation display unit 28. The owner of the building 2 or the like can consider a layout that will further improve the working environment of the employees based on the state understood by the interest level map in this way.

[0163] The owner of building 2 or the like uses a simulation by simulation system 50 to consider the layout. The owner of building 2 or the like sets the simulation conditions, for example, through operation display unit 28 or the like. The owner of building 2 or the like edits the layout of the fourth floor of building 2 as the simulation conditions, for example, as shown in FIG. 17B. Note that in this example, the first, second, and third floors, which are store floors, are excluded from the simulation.

[0164] In the layout of the fourth floor after editing in this example, an inventory management area including item P1 of store P is placed in the warehouse at the side of the store staff room. In the layout after editing, the wall of the passage is removed so that the management office and the store staff room can move back and forth. In the layout after editing, the desk of user X is placed so as to be close to the inventory management area including item P1 of store P, which is of high interest. In the layout after editing, the desk of user W is placed so as to be close to the desk of user X, who is of high interest. In the layout after editing, the desk of user Y is placed so as to be close to the desk of user W, who is of high interest. In the layout after editing, the desk of user Z is placed so as to be close to the desk of user X, who is of high interest. In addition, in the layout after editing, the desks of users who are highly interested in each other are spaced apart by a distance set within a range that allows them to talk to each other. This makes it possible to avoid crowding of users without impeding their conversations.

[0165] The simulation processing unit 29 performs a simulation across multiple floors, similar to the simulation for users on a store floor. The simulation processing unit 29 sets users to be the targets of the simulation. For example, the simulation processing unit 29 sets multiple users including user W, user X, user Y, and user Z as the targets of the simulation. The simulation processing unit 29 sets attributes of high interest in the building 2 for each of the users to be the targets of the simulation. The simulation processing unit 29 generates simulated behavior information on the fourth floor for each of the users to be the targets of the simulation. The simulation processing unit 29 simulates, for example, the time the user spends at each location, such as a desk, according to a frequency distribution acquired based on the behavior information of the user. When the attribute of high interest of a user is other users, the simulation processing unit 29 simulates, for example, moving to a range where the user can interact with the other users. The simulation processing unit 29 generates simulated interest information for each of the users to be the targets of the simulation, similar to the processing in the interest information acquisition unit 20, based on the simulated behavior information.

[0166] In this example, the time spent moving around the office floor can be reduced by arranging the inventory management area, which stores items of high interest, and the desks of the users who work there closer together. The time spent moving around for the purpose of conversation can be reduced by arranging the desks of users who are highly interested in each other closer together. The time spent moving around for the purpose of conversation can be reduced by removing walls in the corridors. The effects of these changes in improving work efficiency are simulated by the simulation system 50.

[0167] The interest level measurement system 1 may be used for attendance management of employees in the building 2. In this case, the interest level measurement system 1 includes an attendance management unit (not shown). For example, the attendance management unit of the interest level measurement system 1 determines a day on which an employee uses any elevator as the day on which the employee uses the elevator. The attendance management unit of the interest level measurement system 1 determines the first time on the day on which the employee uses the elevator to arrive at the fourth floor as the attendance time of the employee on the day on which the employee uses the elevator. The attendance management unit of the interest level measurement system 1 determines the last time on the day on which the employee uses the elevator to depart from the fourth floor as the departure time of the employee on the day on which the employee uses the elevator. The attendance management unit of the interest level measurement system 1 performs these determination processes based on, for example, behavioral information stored in the behavioral information storage unit 16.

[0168] Next, an example of the operation of the interest measurement system 1 will be described with reference to FIGS. 18, 19, 20A and 20B, and 21 are flowcharts showing examples of the operation of the interest measurement system 1 according to the first embodiment.

[0169] FIG. 18 shows an example of the operation of the interest measurement system 1 relating to the determination of the arrival floor when a user uses the elevator 3.

[0170] In step S101, the user identification unit 14 identifies a user who enters the car 7 of the elevator 3 when the door of the car 7 is open. Thereafter, the operation of the interest measurement system 1 proceeds to step S102.

[0171] In step S102, the processing of the interest measurement system 1 starts when the car 7 of the elevator 3 departs from any floor. Here, the departure of the car 7 from any floor is, for example, when the door of the car 7 closes at the floor. After that, the operation of the interest measurement system 1 proceeds to step S103.

[0172] In step S103, the user identification unit 14 confirms the identification of the user who is in the car 7 of the elevator 3. After that, the operation of the interest measurement system 1 proceeds to step S104.

[0173] In step S104, the user identification unit 14 judges whether or not there is a user inside the car 7. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S105. If the judgment result is No, the user identification unit 14 determines that there is no user inside the car 7, and the operation of the interest measurement system 1 proceeds to step S107.

[0174] In step S105, the elevator equipment determination unit 17 determines that the elevator equipment used by the user identified by the user identification unit 14 in the car 7 of the elevator 3 is the elevator 3. After that, the operation of the interest measurement system 1 proceeds to step S106.

[0175] In step S106, the consistency processing unit 18 performs consistency processing on the user identified by the user identification unit 14. Thereafter, the operation of the interest degree measurement system 1 proceeds to step S107.

[0176] In step S107, the floor determination unit 19 stores the riding status of the car 7 of the elevator 3 based on the result of identification by the user identification unit 14. The riding status of the car 7 includes, for example, whether or not a user is riding in the car 7, and information for identifying the user if a user is riding in the car 7. Thereafter, the operation of the interest measurement system 1 proceeds to step S108.

[0177] In step S108, the floor determination unit 19 determines the departure floor and arrival floor of the user based on the boarding status stored in step S107 and the boarding status stored immediately before that. After that, the operation of the interest measurement system 1 proceeds to step S109.

[0178] In step S109, after the car 7 of the elevator 3 stops at any floor, the operation of the interest measurement system 1 proceeds to step S101.

[0179] FIG. 19 shows an example of the operation of the interest measurement system 1 relating to the determination of the arrival floor when a user uses the escalator 4.

[0180] In step S201, the processing of the degree of interest measurement system 1 starts when a user enters the frame of the camera 12 installed at the exit of any of the escalators 4. After that, the operation of the degree of interest measurement system 1 proceeds to step S202.

[0181] In step S202, the user identification unit 14 identifies the user riding on the escalator 4 and confirms the identification of the user. After that, the operation of the interest measurement system 1 proceeds to step S203.

[0182] In step S203, the user identification unit 14 determines whether or not there is a user riding on the escalator 4. If the determination result is Yes, the operation of the interest degree measurement system 1 proceeds to step S204. If the determination result is No, the operation of the interest degree measurement system 1 proceeds to step S201.

[0183] In step S204, the floor determination unit 19 determines whether the identified user is a user who has changed escalators 4. For example, if a preset time has not elapsed since the user went out of the frame of the camera 12 arranged at the exit of another elevator 3, the floor determination unit 19 determines that the user is a user who has changed escalators 4. If the determination result is No, the operation of the interest measurement system 1 proceeds to step S205. If the determination result is Yes, the operation of the interest measurement system 1 proceeds to step S208.

[0184] In step S205, the elevator-facility determination unit 17 determines that the elevator facility used by the user identified by the user identification unit 14 at the escalator 4 is the escalator 4. Thereafter, the operation of the interest measurement system 1 proceeds to step S206.

[0185] In step S206, the consistency processing unit 18 performs consistency processing on the user identified by the user identification unit 14. Thereafter, the operation of the interest degree measurement system 1 proceeds to step S207.

[0186] In step S207, the floor determination unit 19 determines that the floor where the entrance to the escalator 4 is provided is the departure floor of the user.

[0187] In step S208, when the user goes out of the frame of the camera 12 installed at the exit of the escalator 4, the floor determination unit 19 starts measuring the time from when the user goes out of the frame. After that, the operation of the interest measurement system 1 proceeds to step 209.

[0188] In step S209, the floor determination unit 19 determines whether a timeout has occurred, that is, whether the user has not entered the frame of the camera 12 of the next escalator 4 since the user went out of the frame and a preset time has elapsed. If the determination result is No, the operation of the interest measurement system 1 proceeds to step S209 again. On the other hand, if the determination result is Yes, the operation of the interest measurement system 1 proceeds to step 210. Note that if the user enters the frame of the camera 12 of another disembarking floor other than the next escalator 4 before the timeout occurs, the operation of the interest measurement system 1 may proceed to step S210.

[0189] In step S210, the floor determination unit 19 determines the floor where the exit of the escalator 4 is provided as the arrival floor of the user. After that, the operation of the interest measurement system 1 proceeds to step 201.

[0190] Even when the user uses the stairs 5, the interest measurement system 1 determines the arrival floor and the like by a similar process.

[0191] FIG. 20 shows an example of the operation of the interest measurement system 1 related to acquisition of behavior information and interest information of a user at the arrival floor.

[0192] 20A, the processing of the interest degree measurement system 1 starts when the arrival floor of the user is determined. After that, the operation of the interest degree measurement system 1 proceeds to step S302.

[0193] In step S302, the user specification unit 14 judges whether or not there is an overhead map of the arrival floor. If the judgment result is No, the operation of the interest measurement system 1 proceeds to step S303. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S305.

[0194] In step S303, the behavior information acquisition unit 15 starts acquiring images from the camera 12 arranged on the arrival floor. After that, the operation of the interest measurement system 1 proceeds to step S304.

[0195] In step S304, the behavior information acquisition unit 15 generates an overhead map from the acquired image. After that, the operation of the interest measurement system 1 proceeds to step S305.

[0196] In step S305, the user identification unit 14 judges whether the user who arrived at the arrival floor was identified on the bird's-eye view map. If the judgment result is No, the operation of the interest measurement system 1 proceeds to step S301. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S306.

[0197] In step S306, the interest measurement system 1 acquires behavioral information and interest information for the user identified in step S305. If multiple users are identified in step S305, the interest measurement system 1 may acquire behavioral information and interest information for the multiple users in parallel. After that, the operation of the interest measurement system 1 proceeds to step S301.

[0198] FIG. 20B shows an example of the contents of the process in step S306 in FIG. 20A.

[0199] In step S401, the behavioral information acquisition unit 15 acquires information on the location of the identified user. In this example, the behavioral information acquisition unit 15 acquires information on the coordinates of at least three feature amounts of the user, namely, both shoulders and a nose. The behavioral information acquisition unit 15 may acquire information on the coordinates of other feature amounts of the user. Thereafter, the operation of the interest measurement system 1 proceeds to step S402.

[0200] In step S402, the behavior information acquisition unit 15 judges whether the user has entered the elevator facility. Note that entering the elevator facility is considered to be out of the frame when viewed from the floor where the user was. If the judgment result is No, the operation of the interest measurement system 1 proceeds to step S403. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S405.

[0201] In step S403, the behavior information acquisition unit 15 judges whether the user has framed out from the invisible area or the entrance of the building 2. If the judgment result is No, the operation of the interest measurement system 1 proceeds to step S401. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S404.

[0202] In step S404, the behavior information acquisition unit 15 judges whether a timeout has occurred, that is, whether a preset time has elapsed since the user framed out from the invisible area or the entrance of the building 2. If the judgment result is No, the operation of the interest measurement system 1 proceeds to step S401. If the judgment result is Yes, the operation of the interest measurement system 1 proceeds to step S405.

[0203] In step S405, the behavioral information acquisition unit 15 completes the acquisition of the behavioral information. The behavioral information storage unit 16 stores the acquired behavioral information for each user as time-series data. After that, the operation of the interest measurement system 1 proceeds to step S406.

[0204] In step S406, the interest information acquiring unit 20 extracts areas in which the user has a high degree of interest, based on the behavioral information of the user. After that, the operation of the interest measurement system 1 proceeds to step S407.

[0205] In step S407, the interest information acquisition unit 20 refers to the attributes of the area in which the user has a high level of interest from the attribute storage unit 13. The interest information acquisition unit 20 acquires interest information based on the information on the user's level of interest and the referenced attribute information. The interest information storage unit 21 stores the acquired interest information for each user. At this time, the interest information storage unit 21 may update the interest information for each user with the acquired interest information. Thereafter, the operation of the interest level measurement system 1 proceeds to step S408.

[0206] In step S408, the interest measurement system 1 outputs a warning sound or an alert, etc., as necessary. The warning sound or the alert is output, for example, when the user's frame-in and frame-out are inconsistent. The case where the user's frame-in and frame-out are inconsistent includes, for example, when a frame-in user is not determined to be out of the frame, or when a frame-out user is determined to be out of the frame. If it is not necessary to output a warning sound or an alert, the process of step S408 may be omitted. Thereafter, the operation of the interest measurement system 1 related to obtaining the behavioral information and interest information for each user ends.

[0207] FIG. 21 shows an example of the operation of the interest measurement system 1 for visualizing the already measured interests of a user.

[0208] In step S501, the visualization processing unit 27 accepts an input of conditions for generating a degree of interest map, for example, via the operation display unit 28. Thereafter, the operation of the degree of interest measurement system 1 proceeds to step S502.

[0209] In step S502, the visualization processing unit 27 reads interest information and behavior information about users of the building 2 at the time specified in the generation conditions from the interest information storage unit 21 and the behavior information storage unit 16. Thereafter, the operation of the interest measurement system 1 proceeds to step S503.

[0210] In step S503, the visualization processing unit 27 narrows down the users whose interest information and behavior information have been read based on the conditions specified in the generation conditions. After that, the operation of the interest measurement system 1 proceeds to step S504.

[0211] In step S504, the visualization processing unit 27 performs a calculation for visualizing the interest information based on the interest information and behavior information of the users narrowed down based on the generation conditions. The calculation for visualization includes, for example, a calculation for converting the interest information into a numerical value for visualizing the interest information by a graph. The calculation includes, for example, a calculation for tallying up the interest levels of multiple users by location. Thereafter, the operation of the interest measurement system 1 proceeds to step S505.

[0212] In step S505, the visualization processing unit 27 generates an interest degree map using the result of the calculation for visualization. The process of generating the interest degree map includes, for example, a process of superimposing a graph representing the interest information and an overhead map. After that, the operation of the interest degree measurement system 1 ends.

[0213] Next, an example of the operation of the simulation system 50 relating to a simulation of a user's actions and interests under non-existent conditions will be described with reference to FIG. Fig. 22 is a flowchart showing an example of the operation of the simulation system 50 according to the embodiment 1. The process in Fig. 22 is started after the process in Fig. 21 has been performed, for example.

[0214] In step S601, the simulation processing unit 29 accepts input of simulation conditions, for example, via the operation display unit 28. In inputting the simulation conditions, for example, the existing conditions in FIG. 21 are used. Also, new conditions different from the conditions in FIG. 21 are input. This makes the difference in the input of the simulation conditions clear. Thereafter, the operation of the simulation system 50 proceeds to step S602.

[0215] In step S602, the simulation processing unit 29 reads interest information and behavior information from the interest information storage unit 21 and behavior information storage unit 16 according to the input simulation conditions, for example, similar to the conditions in FIG. 21. In addition, new conditions different from the conditions in FIG. 21 include, for example, modification, change, addition, or deletion of panels or entrances and exits on the movement route that guide the destination location or behavior. In addition, new conditions different from the conditions in FIG. 21 also include, for example, rearrangement of stores or interior walls. The rearrangement also moves the associated areas and their attributes. At this time, the rearrangement is not limited to the movement of each store, but may be the movement of a part of the area of ​​the store and its attributes. For example, when adding a virtual user, it is confirmed that one or more pieces of high interest information of the user, their attributes, the time of entering the entrance, etc. are specified. The users to be the targets of the simulation may be narrowed down to users who directly or indirectly satisfy certain conditions, for example. Here, the simulation processing unit 29 determines that all of the conditions input in step S601 are acceptable for performing the simulation. If there is a problem with the simulation conditions, the operation of the simulation system 50 proceeds to step S601 so that the conditions can be reset. On the other hand, if there is no problem with the simulation conditions, the simulation system 50 confirms the input conditions and proceeds to the operation of step S603.

[0216] In step S603, the simulation processing unit 29 simulates and generates behavior information for each user in the building 2. After that, the operation of the simulation system 50 proceeds to step S604.

[0217] In step S604, the simulation processing unit 29 generates simulated interest information for each of the users for which the behavior information has been generated. After that, the operation of the simulation system 50 proceeds to step S605.

[0218] In step S605, the simulation processing unit 29 sends the result of the simulation based on the simulated generated behavior information and interest information to the visualization processing unit 27. After that, the operation of the simulation system 50 proceeds to step S606.

[0219] In step S606, the visualization processing unit 27 generates two interest level maps, one for the existing condition and the other for the new condition, using the result of the calculation using the existing condition and the result of the calculation by the simulation processing unit 29 under a new condition different from the condition in Fig. 21. The process of generating the interest level maps includes, for example, a process of superimposing a graph representing the information of interest and an overhead map. Thereafter, the visualization processing unit 27 sends the two interest level maps, one for the existing condition and the other for the new condition, to the simulation processing unit 29. Thereafter, the operation of the simulation system 50 proceeds to step S607.

[0220] In step S607, the simulation processing unit 29 calculates the difference between the two interest level maps of the existing condition and the new condition, and sends it again to the visualization processing unit 27. This visualizes the interest level maps of the existing condition and part or all of the new condition, and the difference. After that, the operation of the simulation system 50 ends.

[0221] As an example, the visualization of two interest maps, an existing one and a new one, and their difference have been given so far, but the simulation processing unit 29 can calculate not only two interest maps and their difference, but also a plurality of interest maps and their differences. Therefore, it is possible to consider various new conditions and derive optimal conditions.

[0222] In addition, the simulation processing unit 29 automatically calculates the rent for the new conditions according to the market price, based on the interest map as a simulation result of the new conditions. Here, the rent for the new conditions is the rent for each tenant existing under the new conditions. The calculated rent is used, for example, to consider the optimal conditions among various new conditions.

[0223] As described above, the interest measurement system 1 according to the first embodiment includes the attribute storage unit 13, the user identification unit 14, the floor determination unit 19, the behavioral information acquisition unit 15, the interest information acquisition unit 20, the interest information storage unit 21, and the visualization processing unit 27. The attribute storage unit 13 stores attributes for each area for each floor of the building 2. The user identification unit 14 identifies a user in the building 2 based on an image captured by at least one of the cameras 12 installed in the building 2. When the identified user moves from the departure floor to the arrival floor using any of the elevator facilities, the floor determination unit 19 determines the arrival floor of the user based on an image captured by any of the cameras 12, including at least the camera 12 inside the car 7 of the elevator 3, the camera 12 at the disembarking floor of the escalator 4, or the camera 12 at the floor where the user finishes using the stairs 5. The behavioral information acquisition unit 15 acquires behavioral information representing the behavior of the identified user at the determined arrival floor based on an image captured by at least one of the cameras 12. The interest information acquisition unit 20 acquires interest information representing the interest level of the identified user for each attribute based on the layout of areas on the determined arrival floor, the attributes of the areas, and the relationship between the behavior information. The interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and location information. The visualization processing unit 27 uses the information stored in the interest information storage unit 21 to generate an interest level map that visualizes the distribution of the interest levels of users in the building 2 on at least any floor.

[0224] With this configuration, the user is identified, the arrival floor is determined, and behavior information is acquired based on the image captured by the camera 12 installed in the building 2, so that behavior information on the arrival floor is acquired even for users who do not operate the equipment of the elevator facility. In addition, interest information is acquired based on the behavior information of the user. Therefore, interest information is acquired as information on the interests of the user of the building 2 who does not possess a pre-registered mobile device. In addition, interest information is acquired similarly for users who do not operate the equipment of the elevator facility. In addition, even in a building 2 in which an elevator 3, an escalator 4, and a staircase 5 are mixed, the interest degree measurement system 1 manages the boarding and alighting history by integrating these as elevator facilities, so that the interest information of the user is acquired more reliably. In addition, since the interest degree measurement system 1 manages the boarding and alighting history of the elevator facility, interest information can be acquired across multiple floors in the building 2. The interest information acquired in this way is visualized by the interest degree map generated by the visualization processing unit 27, so that the owner of the building 2 and the like can obtain information for making decisions such as improving the value of the building 2 or avoiding the risk of undesirable events occurring in the building 2.

[0225] The visualization processing unit 27 may generate an interest level map for each user of the building 2. Furthermore, the visualization processing unit 27 may integrate the interest information for each user of the building 2 to generate an interest level map. The visualization processing unit 27 may generate an interest level map including behavior information for each user of the building 2.

[0226] With this configuration, the interest map is generated with the required level of detail according to the purpose of the owner of the building 2. Therefore, the owner of the building 2 can more efficiently obtain information for making decisions on improving the value of the building 2 or avoiding risks in the building 2.

[0227] The interest measurement system 1 also includes a destination presentation unit 22. When the user identification unit 14 identifies a user who is about to start using any elevator facility, the destination presentation unit 22 presents areas with attributes having a higher interest level as destinations to the user with higher priority. The destination presentation by the equipment destination presentation unit is based on the interest information stored in the interest information storage unit 21 and the attribute information stored in the attribute storage unit 13 for the user. At this time, the visualization processing unit 27 may generate an interest map including information on the destinations actually presented by the destination presentation unit 22. The destination information is displayed superimposed on information such as the user's trajectory, for example.

[0228] With this configuration, the owner of the building 2 or the like can understand the influence on the interest of users of the destinations presented by the destination presentation unit 22. Therefore, the owner of the building 2 or the like can obtain information for making decisions to improve the value of the building 2 or to avoid risks in the building 2 more efficiently.

[0229] In addition, in the case where a plurality of elevator facilities are provided as one or more elevator facilities in the building 2, the interest measurement system 1 includes an elevator facility determination unit 17 and a matching processing unit 18. When the user identified by the user identification unit 14 starts using one of the elevator facilities, the elevator facility determination unit 17 determines the elevator facility used by the user based on an image captured by at least one of the cameras 12. Here, the elevator facility determination unit 17 may simultaneously determine two or more elevator facilities as facilities used by a user identified by the user identification unit 14 as the same user. In this case, the matching processing unit 18 causes the user identification unit 14 to identify the users using the two or more elevator facilities as different users. When identifying the users as different users, the user identification unit 14 extracts differences in the features of the users from the acquired images to improve the accuracy of identifying the users and reconfirm the identification of the different users.

[0230] With this configuration, the accuracy of identifying the user is improved, and guidance to the user is therefore provided more reliably.

[0231] The interest measurement system 1 also includes a call registration unit 23. The call registration unit 23 registers a call to a destination floor including the destination presented by the destination presentation unit 22 in the elevator 3, which is an elevator facility.

[0232] With this configuration, users can travel to their destination without operating the elevator equipment, which increases convenience for users.

[0233] Furthermore, the interest information acquiring unit 20 acquires the interest information of the user every time the behavior information acquiring unit 15 completes acquisition of the behavior information of the user at the arrival floor.

[0234] With this configuration, the interest information reflects the user's behavior at the arrival floor in real time, so the interest measurement system 1 can provide guidance that quickly reflects the user's interests.

[0235] The interest measurement system 1 includes a behavioral information storage unit 16. The behavioral information storage unit 16 stores the behavioral information acquired by the behavioral information acquisition unit 15 for each user. At this time, the interest information acquisition unit 20 may read the behavioral information for each user from the behavioral information storage unit 16 at a preset timing. The interest information acquisition unit 20 acquires the interest information of the user based on the read behavioral information. Here, the preset timing is, for example, a preset time in a time period when there are few users in the building 2, such as at night. Since the processing such as acquiring the interest information is performed in a time period when there are few users, the processing load in the interest measurement system 1 is distributed over time. In addition, when the interest information acquisition unit 20 or the interest information storage unit 21 is mounted on a device connected from a device in the building 2 through a network, the transmission of the behavioral information to the interest information acquisition unit 20 or the interest information storage unit 21 is performed in a time period when the communication load of the network is low. Therefore, even when the communication capacity of the network is low, the communication load of the network can be suppressed.

[0236] In addition, when the user has a portable information terminal equipped with a wireless communication function, the user identification unit 14 may supplementarily use identification information acquired from the information terminal by wireless communication. The information terminal carried by the user may be, for example, a smartphone. For example, inside the cage 7 of the elevator 3, electromagnetic waves from the outside are blocked. At this time, it is highly likely that the electromagnetic waves received inside the cage 7 of the elevator 3 are electromagnetic waves from the information terminal of the user riding inside the cage 7. By supplementarily using such information, the user identification unit 14 can increase the accuracy of identifying the user. When the user has an information terminal, the destination presentation unit 22 may present the destination by transmitting information to be displayed on the information terminal. At this time, the destination presentation unit 22 may transmit information without identifying the recipient, for example, by broadcast communication of a wireless beacon provided at the landing of the elevator 3.

[0237] Moreover, the simulation system 50 according to the first embodiment includes the interest measurement system 1 and a simulation processing unit 29. The simulation processing unit 29 receives input of the existing conditions and the new conditions, and determines whether there is any problem in performing the simulation. Moreover, the simulation processing unit 29 simulates the user's behavior information and also simulates the interest information. Then, the simulation processing unit 29 sends the results of the simulated generated behavior information and interest information to the visualization processing unit 27, and generates two interest level maps for the existing condition and the new condition. These interest level maps are sent to the visualization processing unit 27. The simulation processing unit 29 performs a difference calculation and sends the result to the visualization processing unit 27. In this way, two interest maps, one for existing conditions and one for new conditions, and the differences between them, can be visualized.

[0238] With this configuration, it becomes possible to simulate changes in information on user interests under simulation conditions even for users of building 2 who do not possess a pre-registered mobile device. This allows the owner of building 2 and others to consider in advance the impact of measures to improve the value of building 2 or avoid risks in building 2.

[0239] Next, an example of the hardware configuration of the interest measurement system 1 and a simulation system 50 including the same will be described with reference to FIG. FIG. 23 is a hardware configuration diagram of the main parts of the interest measurement system 1 and the simulation system 50 according to the first embodiment.

[0240] The functions of the interest measurement system 1 and the simulation system 50 may be realized by a processing circuit. The processing circuit includes at least one processor 100a and at least one memory 100b. The processing circuit may include at least one dedicated hardware 200 together with the processor 100a and the memory 100b or in place of them.

[0241] When the processing circuit includes a processor 100a and a memory 100b, the functions of the interest measurement system 1 and the simulation system 50 are realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware is written as a program. The program is stored in the memory 100b. The processor 100a realizes the functions of the interest measurement system 1 and the simulation system 50 by reading and executing the program stored in the memory 100b.

[0242] The processor 100a is also called a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP. The memory 100b is composed of, for example, a non-volatile or volatile semiconductor memory such as a RAM, a ROM, a flash memory, an EPROM, or an EEPROM. Here, the processor 100a and the memory 100b may or may not be separated. For example, the processor 100a may include the memory 100b. Also, a device in which the processor 100a and the memory 100b are integrated may be used.

[0243] Where the processing circuitry comprises dedicated hardware 200, the processing circuitry may be implemented, for example, as a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof, or equivalent circuitry capable of performing the processing.

[0244] Each function of the interest measurement system 1 and the simulation system 50 can be realized by a processing circuit. Alternatively, each function of the interest measurement system 1 and the simulation system 50 can be realized collectively by a processing circuit. Some of the functions of the interest measurement system 1 and the simulation system 50 may be realized by dedicated hardware 200, and the other parts may be realized by software or firmware. In this way, the processing circuit realizes each function of the interest measurement system 1 and the simulation system 50 by the dedicated hardware 200, software, firmware, or a combination of these.

[0245] In each of the embodiments described below, differences from the examples disclosed in the other embodiments will be described in detail. For features not described in each of the embodiments below, any feature of the examples disclosed in the other embodiments may be adopted.

[0246] Embodiment 2 In the interest measurement system 1 of this example, guidance is provided according to the level of interest included in the interest information. The destination information presented by the destination presenting unit 22 as the guidance at this time may be included in the interest map generated by the visualization processing unit 27. 24A to 24C, 25A and 25B are diagrams showing examples of destination presentation by the interest measurement system 1 according to the second embodiment.

[0247] FIG. 24 shows an example of a building 2 to which the interest measurement system 1 is applied.

[0248] 24A shows building 2 on a certain day. In this building 2, store P, which sells product P1, and store S, which offers service S1, are located in the fourth floor area. Store Q, which sells product Q1, and store T, which sells product T1, are located in the third floor area. Store R, which offers service R1, and store U, which sells product U1, are located in the second floor area.

[0249] By this date, the interest measurement system 1 has acquired interest information for users A, B, and C. For user A, the interest information storage unit 21 stores product P1 as the attribute with the highest interest level, and service S1 as the attribute with the second highest interest level. For user B, the interest information storage unit 21 stores store Q as the attribute with the highest interest level, and store T as the attribute with the second highest interest level. For user C, the interest information storage unit 21 stores service R1 as the attribute with the highest interest level, and store U as the attribute with the second highest interest level.

[0250] In FIG. 24B, the same building 2 is shown at a later date. By this date, store P, which sells item P1, has moved to the second floor area. Store R has also closed down. Store V, which offers service R1, has opened in the fourth floor area.

[0251] User A, who used the building 2 again on this day, is identified by the user identification unit 14 at the elevator 3 landing on the first floor. At this time, the destination presentation unit 22 reads interest information about user A from the interest information storage unit 21. In this example, the destination presentation unit 22 presents areas with attributes of higher interest to the user as destinations with higher priority. For this reason, the destination presentation unit 22 acquires item P1 as the attribute of highest interest of user A, and service S1 as the attribute of next highest interest. The destination presentation unit 22 extracts areas having item P1 as an attribute from the attribute storage unit 13. In this example, the destination presentation unit 22 extracts the area on the second floor where the relocated P store is located as the destination with the highest priority. In addition, the destination presentation unit 22 extracts areas having service S1 as an attribute from the attribute storage unit 13. In this example, the destination presentation unit 22 extracts the area on the fourth floor where the S store is located as the destination with the next highest priority. The destination presentation unit 22 presents the extracted area to the user A as a destination.

[0252] As shown in FIG. 24C, users B and C who used the building 2 again on the same day are identified by the user identification unit 14 at the elevator 3 landing on the first floor. At this time, the destination presentation unit 22 reads interest information for each of users B and C from the interest information storage unit 21. When presenting destinations to multiple users at the same time, the destination presentation unit 22 presents the area of ​​the attribute of the highest interest of each user as the destination. For this reason, the destination presentation unit 22 acquires store Q as the attribute of the highest interest of user B. The destination presentation unit 22 extracts the area of ​​store Q as an attribute from the attribute storage unit 13. In this example, the destination presentation unit 22 extracts the area on the third floor where store Q is located as a destination to be presented to user B. In addition, the destination presentation unit 22 acquires service R1 as the attribute of user C that is the highest interest of user C. The destination presentation unit 22 extracts the area of ​​store V that provides service R1 as an attribute from the attribute storage unit 13. In this example, the destination presentation unit 22 extracts the area on the fourth floor where store V is located as a destination to be presented to user C.

[0253] 25 shows an example of presentation of destinations via the car operating panel 10. In this example, the third and fourth floors are presented as destination floors to users B and C who are in the car 7.

[0254] As shown in FIG. 25A, the destination presentation unit 22 flashes the light-emitting devices of the destination buttons 10b corresponding to the third and fourth floors to present a notice to the user B and the user C before registering the third and fourth floors of the destination floors. At this time, the destination presentation unit 22 may also display an image such as "Store Q is on the third floor, and Store V providing service R1 is on the fourth floor" on a display device such as the display panel 10a. The destination presentation unit 22 may also present audio guidance through a built-in speaker of a display device such as the display panel 10a. Here, for example, immediately after a preset time has elapsed since the start of presentation by flashing the light-emitting devices and the call has been automatically registered, the destination presentation unit 22 ends the presentation of the destination floor guidance by flashing the light-emitting devices of the destination buttons 10b corresponding to the third and fourth floors. Also, for example, immediately after the destination button 10b is operated and the call is registered, the destination presentation unit 22 ends the presentation of the destination floor guidance by blinking the light-emitting devices of the destination button 10b corresponding to the third and fourth floors.

[0255] For example, when the destination button 10b corresponding to the 3rd floor is operated by the user B to register a call, the light-emitting device of the destination button 10b corresponding to the floor designated as the destination floor lights up as shown in FIG. 25B. Here, when the destination button 10b corresponding to the 4th floor, which is the presented destination floor, is not operated, the destination presentation unit 22 may continue presenting the destination floor by blinking the light-emitting device of the destination button 10b corresponding to the 4th floor. At this time, after a preset time has elapsed since the presentation by blinking the light-emitting device started, the call registration unit 23 automatically registers a call with the 4th floor as the destination floor in the elevator 3 in which the user C is riding. Immediately after the call with the 4th floor as the destination floor is automatically registered, the light-emitting device of the destination button 10b corresponding to the 4th floor lights up.

[0256] Here, if the floor that user B or user C wants to go to is not the automatically registered destination floor, user B or user C can cancel the destination button 10b of the automatically registered destination floor and register another destination floor. For example, when the destination button 10b corresponding to the third floor is canceled, user B and user C get off at the remaining destination floor, the fourth floor. This allows user B or user C to change the floor at which they get off, regardless of their level of interest. At this time, the floor at which they get off is determined for user B and user C. This makes it possible to acquire behavioral information and interest information for user B and user C at the floor at which they get off.

[0257] When presenting multiple destinations to user A, the destination presentation unit 22 may present the destination floors by blinking multiple destination buttons 10b each corresponding to a destination floor such as the 2nd floor and the 4th floor. At this time, the destination presentation unit 22 may cause the destination buttons 10b to adjust the blinking, color tone, or brightness of the light-emitting device, or the speed of change thereof, depending on the priority of the destination.

[0258] Here, for example, if no destination floor is specified until a preset time has elapsed since the start of presentation by blinking of the light-emitting device, the call registration unit 23 automatically registers a call for the second floor, which has been presented as the destination floor with the highest priority, in the elevator 3 in which user A is riding. If the floor that user A wants to go to is not one of the automatically registered destination floors, user A may cancel the destination button 10b of the automatically registered destination floor and register another destination floor.

[0259] Embodiment 3 In the interest measurement system 1 of this example, information on the degree of interest is acquired across a plurality of buildings 2 and guidance is provided to the user. FIG. 26 is a configuration diagram of a degree of interest measurement system 1 according to the third embodiment.

[0260] In the interest measurement system 1, as parts responsible for information processing, an attribute storage unit 13, a user identification unit 14, a behavioral information acquisition unit 15, a behavioral information storage unit 16, an elevator equipment determination unit 17, a floor determination unit 19, an interest information acquisition unit 20, a destination presentation unit 22, and a call registration unit 23 are applied to each building 2. These parts perform operations such as user identification, acquisition of behavioral information and interest information, presentation of destinations, and call registration in each building 2.

[0261] The interest measurement system 1 includes a central management device 24. The central management device 24 is a device that integrates and manages information such as interest information acquired in multiple buildings 2. The central management device 24 is, for example, one or more server devices. A part or the whole of the central management device 24 may be mounted on a virtual machine on a cloud service. The central management device 24 includes a consistency processing unit 18, an interest information storage unit 21, and a visualization processing unit 27. In this example, the operation display unit 28 is, for example, an information processing terminal that can communicate with the central management device 24.

[0262] In this example, the simulation processing unit 29 of the simulation system 50 is mounted on the central management unit 24. The simulation processing unit 29 may be one or a plurality of server devices capable of communicating with the central management unit 24. Alternatively, a part or the whole of the simulation processing unit 29 may be a virtual machine on a cloud service.

[0263] The consistency processing unit 18 is equipped with a function for making consistency of user identification by the user identification unit 14 applied to each building 2. The consistency processing is performed, for example, as follows. The user identification unit 14 applied to each building 2 may mistakenly identify different users as the same user. The user identification units 14 applied to different buildings 2 may simultaneously identify the same user as each other. Since the same person cannot exist in two or more buildings 2 at the same time, the consistency processing unit 18 requests the user identification unit 14 applied to each building 2 to correct the user identification. At this time, the user identification unit 14 applied to each building 2 identifies the users who were mistakenly identified as the same user as different users. When identifying users as different from each other, the user identification unit 14 extracts the difference in the feature amount of the users from the acquired image, improves the accuracy of identifying the users, and reconfirms the identification of the different users. In addition, the consistency processing unit 18 may also perform a process of ensuring consistency between the identification of a user by the user identification unit 14 and the determination of the elevator equipment used by the user by the elevator equipment determination unit 17 for each building 2.

[0264] The interest information storage unit 21 integrates and stores for each user the interest information acquired in each building 2. The interest information storage unit 21 stores, for example, identification information unique to a user, the interest information of the user, and information on the time and place when the interest information was acquired in association with each other.

[0265] The visualization processing unit 27 is equipped with a function of generating a degree of interest map for each building 2. The visualization processing unit 27 generates the degree of interest map by using information stored in the interest information storage unit 21. For example, when the interest information storage unit 21 stores the interest information of a user acquired in any of the buildings 2, the visualization processing unit 27 may generate a degree of interest map for other buildings 2 that the user has not used. At this time, for example, the level of interest is acquired for each attribute as the interest information of the user. For example, the visualization processing unit 27 assigns the level of interest for each attribute of the user to each area of ​​the floor for which the degree of interest map is generated according to the attribute of the area of ​​the floor. Note that the visualization processing unit 27 may generate a degree of interest map for a building 2 that the user has used. The visualization processing unit 27 may generate a degree of interest map for any of the buildings 2 by using the interest information acquired in the multiple buildings 2. The visualization processing unit 27 may generate a degree of interest map including the information stored in the behavior information storage unit 16 of each building 2. The visualization processing unit 27 may generate the interest level map including information on the destinations actually presented to the user by the destination presentation unit 22 of each building 2. The visualization processing unit 27 may generate the interest level map including classification information such as the gender or age of the user, or both, or other information.

[0266] The simulation processing unit 29 is equipped with a function of setting simulation conditions and simulating changes in the interest information acquired by the interest information acquisition unit 20 in each building 2. The simulation processing unit 29 performs a simulation using information stored in the interest information storage unit 21. For example, when the interest information storage unit 21 stores interest information of a user acquired in any building 2, the simulation processing unit 29 may perform a simulation for another building 2 that the user has not used. The simulation processing unit 29 sets users in the building 2 to be the subject of the simulation and, for example, users of other buildings 2 based on the simulation conditions. The simulation processing unit 29 acquires information on the users of the other buildings 2 to be the subject of the simulation that are highly interested in attributes of a specific area from the interest information storage unit 21, and sets an entrance and a start time. The simulation processing unit 29 generates simulated behavioral information in the building 2 for each user. The simulation processing unit 29 generates simulated interest information for each user for whom behavioral information has been generated. Based on the simulated behavioral information and interest information, the simulation processing unit 29 generates a result of the simulation as an interest level map for the building 2. The simulation processing unit 29 may use the interest information acquired for the multiple buildings 2 to perform a simulation for any one of the buildings 2, or for multiple buildings 2 simultaneously.

[0267] Next, an example of presenting a destination to a user will be described with reference to FIG. FIG. 27 is a diagram showing an example of destination presentation by the degree of interest measurement system 1 according to the third embodiment.

[0268] FIG. 27 shows an example of a plurality of buildings 2 to which the interest measurement system 1 is applied.

[0269] In this example, multiple buildings 2 are shown on a certain day. User A has used one of the buildings, 2a, multiple times up to this day. User A will use the other building, 2b, for the first time on this day. In building 2a, store P, a supermarket, is located on the fourth floor. In building 2b, store Q, a supermarket, is located on the second floor.

[0270] By this date, the interest measurement system 1 has acquired interest information of the user A who used the building 2a. Here, the building 2a from which the user's interest information and the like are acquired is an example of the first building. The first camera is the camera 12 arranged in the first building. The first attribute storage unit is the attribute storage unit 13 applied to the first building. The first user identification unit is the user identification unit 14 applied to the first building. The interest information acquisition unit 20 of the building 2a transmits the acquired interest information to the interest information storage unit 21 of the central management device 24. The interest information storage unit 21 integrates the interest information received from the interest information acquisition unit 20 of the building 2a and stores it for each user. The interest information storage unit 21 may integrate and store the interest information received from the interest information acquisition unit 20 applied to the other buildings 2 of the building 2a and the building 2b. The interest information storage unit 21 stores the supermarket as the attribute with the highest interest level for the user A who used the building 2a and the like.

[0271] User A, who uses building 2b for the first time on this day, is identified by the user identification unit 14 of building 2b at the elevator 3 landing on the first floor. At this time, the destination presentation unit 22 of building 2b reads interest information about user A from the interest information storage unit 21. In this example, the destination presentation unit 22 presents the area with the most interesting attribute to the user as a destination. For this reason, the destination presentation unit 22 acquires supermarket as the attribute with the most interesting attribute of user A. The destination presentation unit 22 extracts an area having supermarket as an attribute from the attribute storage unit 13 of building 2b. In this example, the destination presentation unit 22 extracts the area on the second floor of building 2b where store Q is located. The destination presentation unit 22 presents the extracted area to user A as a destination. The call registration unit 23 of the building 2b registers a call to a destination floor in the elevator 3, for example, when a user who has boarded the car 7 of the elevator 3 in the building 2b does not operate the car operation panel 10. Here, the building 2b in which the destination is presented to the user is an example of the second building. The second camera is the camera 12 arranged in the second building. The second user identification unit is the user identification unit 14 applied to the second building. The second attribute storage unit is the attribute storage unit 13 applied to the second building. The second building does not have to be a building that the user A uses for the first time. User interest information may have been acquired in the second building in the past.

[0272] As described above, the interest measurement system 1 according to the third embodiment includes the attribute storage unit 13 and the user identification unit 14 corresponding to each building 2, the floor determination unit 19, the behavioral information acquisition unit 15, the interest information acquisition unit 20, the interest information storage unit 21, the destination presentation unit 22, and the visualization processing unit 27. Each attribute storage unit 13 stores attributes for each area of ​​each floor of the corresponding building 2. Each user identification unit 14 identifies a user in the corresponding building 2 based on an image captured by at least one of the cameras 12 installed in the building 2. The floor determination unit 19 determines the arrival floor of the user based on an image captured by at least one of the cameras 12 when the user identified in any of the buildings 2 moves from the departure floor to the arrival floor using the elevator facility of the building 2. The behavioral information acquisition unit 15 acquires behavioral information representing the behavior of the user at the determined arrival floor for the user identified in any of the buildings 2 based on an image captured by at least one of the cameras 12. The interest information acquisition unit 20 acquires interest information representing the interest level of the user for each attribute for a user identified in any of the buildings 2, based on the layout of areas on the determined arrival floor, the attributes of the areas, and the relationship between the behavior information. The interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and location information. The visualization processing unit 27 generates an interest level map using the attribute information stored in the attribute storage unit 13 corresponding to any of the buildings 2 and the information stored in the interest information storage unit 21. The interest level map generated here visualizes the distribution of the interest levels of users of the building 2 on at least any of the floors of the building 2.

[0273] With this configuration, the user is identified, the arrival floor is determined, and behavior information is acquired based on the images captured by the cameras 12 installed in each of the buildings 2, so that behavior information on the arrival floor is acquired even for users who do not operate the elevator equipment. In addition, interest information is acquired based on the user's behavior information. Therefore, interest information is acquired as information on the interests of users of the building 2 who do not possess a pre-registered mobile device. In addition, interest information is acquired even for users who do not operate the elevator equipment. In addition, even in a building 2 in which an elevator 3, an escalator 4, and a staircase 5 are mixed, the interest measurement system 1 manages the boarding and alighting history by integrating these as elevator equipment, so that the interest information of the user is acquired more reliably. The interest information acquired in this way is visualized by the interest map generated by the visualization processing unit 27, so that the owner of the building 2 and the like can obtain information for making decisions such as increasing the value of the building 2 or avoiding the risk of undesirable events occurring in the building 2. In addition, since the interest information of a user is shared among a plurality of buildings 2, the interest measurement system 1 can generate an interest map even for a building 2 that the user has not used.

[0274] In this example, an attribute storage unit 13 is provided for each building 2. On the other hand, in cases where the attribute storage unit 13 is implemented on a server device or a cloud service, the attribute storage units 13 that store information about each building 2 may be integrated into a single attribute storage unit 13 or attribute storage units 13 that are less than the number of buildings 2. Also, in this example, a user identifying unit 14 is provided for each building 2. On the other hand, in cases where the user identifying unit 14 is implemented on a server device or a cloud service, the user identifying units 14 that store information about each building 2 may be integrated into a single user identifying unit 14 or into user identifying units 14 that are less than the number of the buildings 2. Similarly, with regard to functional units such as the floor determination unit 19, the behavior information acquisition unit 15, the behavior information memory unit 16, the interest information acquisition unit 20, the interest information memory unit 21, and the visualization processing unit 27, when some or all of these functional units are implemented on a server device or a cloud service, the functional units for each building 2 may be integrated into a single functional unit or into fewer functional units than the number of buildings 2.

[0275] Embodiment 4 In this example, the interest measurement system 1 cooperates with an external system 99. For example, when an owner of a first building to which the interest measurement system 1 is applied is different from an owner of another third building to which the external system 99 is applied, and a contract is concluded between these owners to disclose the interest map or the simulation results, the interest map of the third building by the interest measurement system 1 for the first building, or the simulation results of the change in the interest information of the third building, may be disclosed to the owner of the third building. FIG. 28 is a configuration diagram of a degree of interest measurement system 1 according to the fourth embodiment.

[0276] The external system 99 is a system outside the interest measurement system 1. The external system 99 is applied to a building 2 to which the interest measurement system 1 is not applied. In the building 2 to which the external system 99 is applied, a plurality of cameras 12 for photographing users are arranged. The external system 99 has a memory unit 99a. The memory unit 99a records and updates images of each area of ​​the building 2 to which the external system 99 is applied daily. The external system 99 transmits images without people, for example, updated images of each area of ​​each floor acquired late at night, to the interest measurement system 1. In addition, the external system 99 transmits images taken by each camera 12 of the building 2 to which the external system 99 is applied to the interest measurement system 1 continuously, for example, from morning to night. The images transmitted here do not need to be particularly processed. The external system 99 receives information on guidance such as potential destinations without specifying the user from the interest measurement system 1 that identifies the user by receiving the image. The external system 99 performs guidance processing such as presenting destinations based on the information received from the interest measurement system 1.

[0277] The central management device 24 includes a receiving unit 25, a transmitting unit 26, a user identifying unit 14, a matching processing unit 18, an interest information storage unit 21, and a visualization processing unit 27. The receiving unit 25 and the transmitting unit 26 are units that communicate with an external system 99. In this example, the central management device 24 provides an interface to the external system 99. In this example, the operation display unit 28 is an information processing terminal capable of communicating with the central management device 24, or the like.

[0278] In this example, the simulation processing unit 29 of the simulation system 50 is mounted on the central management unit 24. The simulation processing unit 29 may be one or a plurality of server devices capable of communicating with the central management unit 24. Alternatively, a part or the whole of the simulation processing unit 29 may be a virtual machine on a cloud service.

[0279] Next, an example of providing interest information to an external system 99 will be described with reference to FIG. FIG. 29 is a diagram showing an example of the disclosure of the interest map by the interest measurement system 1 according to the fourth embodiment or a simulation result of the change in the interest information.

[0280] 29 shows an example of a building 2c to which the interest measurement system 1 is applied and a building 2d to which the external system 99 is applied. The building 2d to which the external system 99 is applied is an example of a third building. Information on guidance such as potential destinations to the external system 99 is transmitted from the interest measurement system 1 to the building 2d.

[0281] In this example, buildings 2c and 2d are shown on a certain day. User A has used building 2c multiple times up to this day. User A will use building 2d for the first time on this day. In building 2c, clothing store P is located on the fourth floor. In building 2d, clothing store Q is located on the second floor.

[0282] By this date, the interest measurement system 1 has acquired interest information of user A who has used the building 2c, etc. Here, the building 2c from which the user's interest information, etc. is acquired is an example of the first building. The interest information storage unit 21 stores "clothing store" as the attribute with the highest interest level for user A who has used the building 2c, etc.

[0283] For example, before dawn on this day, the external system 99 transmits images of each area on each floor of the building 2d in advance to the interest measurement system 1. The interest measurement system 1 that receives the images generates an overhead map of the building 2d in advance, similar to the one shown in FIG.

[0284] User A, who uses building 2d for the first time on this day, is photographed by a camera 12 installed in building 2d. The camera 12 is placed, for example, at the landing of elevator 3. An external system 99 transmits an image of user A to the central management device 24.

[0285] The receiving unit 25 of the central management device 24 receives an image of the user A from the external system 99. The user identification unit 14 of the central management device 24 identifies the user A based on the image received from the external system 99. The user identification unit 14 of the central management device 24, which identifies the user based on the image received from the external system 99, is an example of a third user identification unit. After identifying the user A, the user identification unit 14 of the central management device 24 determines the coordinates of the user A on the bird's-eye map of the building 2d. In addition, the transmitting unit 26 reads interest information about the identified user A from the interest information storage unit 21, identifies the most interesting attribute corresponding to each area of ​​each floor on the bird's-eye map of the building 2d as interest information, and transmits destination candidates in the building 2d to the external system 99. The transmitting unit 26 transmits information indicating that the most interesting attribute of the user A, who is the user identified by the image, is a clothing store to the external system 99.

[0286] The external system 99 receives destination candidates in the building 2d from the central management device 24. In this example, the external system 99 receives that the attribute that user A is most interested in among the area of ​​the building 2d and its attributes is clothing stores. Therefore, the external system 99 presents Store Q, which is a clothing store, as a destination to user A who is using the building 2d. Note that the building 2d to which the external system 99 is applied does not have to be a building that user A uses for the first time.

[0287] In this example of the interest measurement system 1, the interest information acquisition unit 20 determines the attributes of the area on the bird's-eye map, such as a clothing store, based on an image received by the receiving unit 25 from the external system 99. At this time, the interest information acquisition unit 20 acquires the interest information of the user of the building 2d based on the correspondence between the area and the attribute determined in this way. The visualization processing unit 27 generates an interest map for one or more floors in the building 2d based on the correspondence between the area and the attribute determined in this way and the interest information of the user. In addition, the simulation processing unit 29 simulates the change in the interest information of the building 2d based on the correspondence between the area and the attribute determined in this way and the interest information of the user. Information such as the interest map and the results of the simulation are disclosed in the form of information that cannot be processed, regardless of the medium and communication method, based on a contract with the owner of the third building, etc.

[0288] As described above, the interest measurement system 1 according to the fourth embodiment includes the attribute storage unit 13, the user identification unit 14 corresponding to the building 2 to which the interest measurement system 1 is applied, the floor determination unit 19, the behavior information acquisition unit 15, the interest information acquisition unit 20, the interest information storage unit 21, the user identification unit 14 of the central management device 24, the receiving unit 25, the transmitting unit 26, and the visualization processing unit 27. The attribute storage unit 13 stores attributes for each area for each floor of the corresponding building 2. The user identification unit 14 identifies a user in the corresponding building 2 based on an image captured by at least one of the cameras 12 installed in the building 2. The floor determination unit 19 determines the arrival floor of the user based on an image captured by at least one of the cameras 12 when the identified user moves from the departure floor to the arrival floor using any of the elevator facilities. The behavior information acquisition unit 15 acquires behavior information representing the behavior of the identified user at the determined arrival floor based on an image captured by at least one of the cameras 12. The interest information acquisition unit 20 acquires interest information representing the interest level of the identified user for each attribute based on the layout of the areas at the determined arrival floor, the attributes of the areas, and the relationship of the behavior information. The interest information storage unit 21 stores the interest information acquired by the interest information acquisition unit 20 for each user, including time and location information. The receiving unit 25 sequentially receives from the external system 99 images required for generating an overhead map of each area of ​​each floor in the building 2d to which the external system 99 is applied, and images of users who start using the elevator facility. The user identification unit 14 of the central management device 24 identifies the user based on the images received by the receiving unit 25. The visualization processing unit 27 generates an interest level map of the building 2d using information stored as interest information in the interest information storage unit 21 for the users identified by the user identification unit 14 of the central management device 24, and attribute information for at least any area of ​​the multiple floors of the building 2d determined based on the image received by the receiving unit 25. The interest level map generated here visualizes the distribution of the interest levels of users of the building 2d on floors, of the multiple floors of the building 2d, whose attribute information has been determined.The transmitting unit 26 transmits guidance information such as destination candidates to the external system 99 for the user identified by the user identification unit 14 of the central management device 24. The effect of the guidance can be confirmed from the images sequentially sent to the receiving unit 25. The interest map of the building 2d or the simulation result of the change can be disclosed by contract with the owner of the third building. For example, by disclosing the interest map that simultaneously measures the mutual movement with the adjacent building, it becomes possible to consider a more efficient flow of people. In addition, by simulating the change for each adjacent building, it becomes possible to consider a flow of people that is beneficial to both the first building and the third building, even if the owners are different between the first building and the third building. Furthermore, when discovering a suspicious person, it is easy to issue an alert by checking the complex route and suspicious behavior of the adjacent buildings at once, which can deter the owner from committing a crime. Here, the first building and the third building may or may not be adjacent to each other.

[0289] With this configuration, the user is identified, the arrival floor is determined, and behavior information is acquired based on the image captured by the camera 12 installed in the building 2, so that behavior information at the arrival floor is acquired even for users who do not operate the elevator equipment. In addition, interest information is acquired based on the user's behavior information. Therefore, interest information is acquired even for users who do not operate the elevator equipment. Therefore, interest information is acquired as information on the interests of users of the building 2 who do not possess a pre-registered mobile device. In addition, the interest measurement system 1 does not request other identification information of the user's image from the external system 99. Therefore, the interest measurement system 1 can guide each user to the area in the building 2d that has the most interesting attributes, without providing personal information such as a name that identifies the user to the external system 99.

[0290] In this example of the interest measurement system 1 and the external system 99, an attribute storage unit 13 is provided for each building 2. On the other hand, when the attribute storage unit 13 is implemented on a server device or a cloud service, the attribute storage units 13 that store information about each building 2 may be integrated into a single attribute storage unit 13 or a number of attribute storage units 13 that is less than the number of buildings 2. In addition, in the interest measurement system 1 and the external system 99 of this example, a user identification unit 14 is provided for each building 2. On the other hand, in cases where the user identification unit 14 is implemented on a server device or a cloud service, the user identification units 14 that store information about each building 2 may be integrated into a single user identification unit 14 or into user identification units 14 that are less than the number of the buildings 2. Similarly, with regard to functional units such as the floor determination unit 19, the behavior information acquisition unit 15, the behavior information memory unit 16, the interest information acquisition unit 20, the interest information memory unit 21, and the visualization processing unit 27, when some or all of these functional units are implemented on a server device or a cloud service, the functional units for each building 2 may be integrated into a single functional unit or into fewer functional units than the number of buildings 2. [Industrial Applicability]

[0291] The interest measurement system and simulation system according to the present disclosure can be applied to buildings having multiple floors. [Explanation of symbols]

[0292] 1 Interest measurement system, 2, 2a, 2b, 2c, 2d Building, 3, 3a, 3b Elevator, 4 Escalator, 5 Stairs, 6 Hoistway, 7 Cage, 8 Control panel, 9 Landing operation panel, 10 Cage operation panel, 10a Display panel, 10b Destination button, 11 Group management device, 12 Camera, 13 Attribute memory unit, 14 User identification unit, 15 Behavior information acquisition unit, 16 Behavior information memory unit, 17 Lift equipment determination unit, 18 Consistency processing unit, 19 Floor determination unit, 20 Interest information acquisition unit, 21 Interest information memory unit, 22 Destination presentation unit, 23 Call registration unit, 24 Central management device, 25 Receiving unit, 26 Transmitting unit, 27 Visualization processing unit, 28 Operation display unit, 29 simulation processing unit, 50 simulation system, 99 external system, 99a storage unit, 100a processor, 100b memory, 200 dedicated hardware

Claims

1. an attribute storage unit that stores attributes of each area for each of a plurality of floors of a building; a user identification unit that identifies a user in the building based on an image captured by at least one of a plurality of cameras installed in the building; a floor determination unit that determines an arrival floor of a user identified by the user identification unit based on an image captured by at least one of the plurality of cameras when the user moves from a departure floor to an arrival floor among the plurality of floors using one or more elevator facilities provided in the building; and a behavior information acquisition unit that acquires behavior information representing the behavior of the user identified by the user identification unit at the arrival floor determined by the floor determination unit based on an image captured by at least one of the plurality of cameras; an interest information acquisition unit that acquires, for a user identified by the user identification unit, interest information that indicates the interest level of the user for each attribute based on a relationship between the area layout and attributes of the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and location information; a visualization processing unit that generates an interest level map by using the information stored in the interest information storage unit, the interest level map visualizing a distribution of the interest levels of the building users on at least any of the plurality of floors; Equipped with The behavioral information includes interest direction information that indicates the direction of the user's interest, the interest information acquisition unit acquires interest information of the user based on an area of ​​high interest of the user based on a direction of the user represented by interest direction information and a correspondence between attributes of the area; Interest measurement system.

2. Automatically calculate the rent for the building based on the interest map. The interest measurement system according to claim 1 .

3. The visualization processing unit generates the interest level map for each user of the building.

3. The interest measurement system according to claim 1 or 2.

4. The visualization processing unit generates the interest level map for each classification information of the building users.

3. The interest measurement system according to claim 1 or 2.

5. The visualization processing unit generates the interest level map by integrating interest information for each user of the building.

3. The interest measurement system according to claim 1 or 2.

6. The visualization processing unit generates the interest level map including behavior information for each user of the building. The interest measurement system according to any one of claims 1 to 5.

7. a destination presentation unit that presents areas having attributes with a higher degree of interest as destinations to the user on the basis of the interest information stored in the interest information storage unit and the attribute information stored in the attribute storage unit about the user when the user identification unit identifies the user who is about to start using any of the one or more elevator facilities, with a higher priority Equipped with The visualization processing unit generates the interest level map by including information on the destinations actually presented by the destination presentation unit. The interest measurement system according to any one of claims 1 to 6.

8. When the one or more lifting facilities include a plurality of lifting facilities, a lift facility determination unit that, when a user identified by the user identification unit starts using any one of the plurality of lift facilities, determines which lift facility the user will use based on an image captured by at least one of the plurality of cameras; and a consistency processing unit that, when the elevator equipment determination unit simultaneously determines that two or more elevator equipment pieces are used by a user identified by the user identification unit as the same user, causes the user identification unit to extract differences in feature quantities and identify the users using the two or more elevator equipment pieces as different users; The interest measurement system according to claim 1 , comprising:

9. When the user of the building is an employee who works on a work floor that is one of the plurality of floors, An attendance management section that performs attendance management of the employees based on the behavioral information. Equipped with The attendance management unit determines a day on which the employee uses any one of the one or more elevator facilities as the employee's attendance day, determines the first time that the employee arrives at the work floor on the attendance day as the employee's attendance time, and determines the last time that the employee departs from the work floor on the attendance day as the employee's departure time. The interest measurement system according to any one of claims 1 to 8.

10. a first attribute storage unit that stores attributes of each area for each of a plurality of floors of the first building; a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building; a floor determination unit that determines an arrival floor of a user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among a plurality of floors of the first building using one or more elevator facilities provided in the first building; and a behavior information acquisition unit that acquires behavior information representing the behavior of a user identified by the first user identification unit at the arrival floor determined by the floor determination unit based on an image captured by at least one of the plurality of first cameras; an interest information acquisition unit that acquires interest information representing the interest level of the user for each attribute, for the user identified by the first user identification unit, based on the relationship between the area layout and attributes of the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and location information; a second attribute storage unit configured to store attributes of each area for each of a plurality of floors of the second building; a visualization processing unit that generates an interest level map by using attribute information stored in the second attribute storage unit and information stored in the interest information storage unit to visualize a distribution of interest levels of users of the second building on at least any of a plurality of floors of the second building; and Equipped with The behavioral information includes interest direction information that indicates the direction of the user's interest, the interest information acquisition unit acquires interest information of the user based on an area of ​​high interest of the user based on a direction of the user represented by interest direction information and a correspondence between attributes of the area; the visualization processing unit uses interest information stored in the interest information storage unit for one or more users specified in the input generation conditions to generate the interest level map; Interest measurement system.

11. The visualization processing unit uses both the interest information acquired in the first building and the interest information acquired in the second building to generate the interest level map in the second building. The interest measurement system according to claim 10.

12. The visualization processing unit generates the interest level map for each user of the second building. The interest measurement system according to claim 10 or 11.

13. a second user identification unit that identifies a user in the second building based on an image captured by at least one of a plurality of second cameras installed in the second building; a destination presentation unit that, when the second user identification unit identifies a user who starts using one or more elevator facilities provided in the second building, presents areas having attributes with a higher degree of interest to the user as destinations to the user by using, in the second building, either or both of the interest information acquired in the first building and the interest information acquired in the second building based on the interest information stored in the interest information storage unit and the attribute information stored in the second attribute storage unit; Equipped with The visualization processing unit generates the interest level map for the second building by including information on the destination actually presented by the destination presentation unit. The interest measurement system according to any one of claims 10 to 12.

14. a second user identification unit that identifies a user in the second building based on an image captured by at least one of a plurality of second cameras installed in the second building; a consistency processing unit that, when a user identified by the first user identification unit and a user identified by the second user identification unit are identical to each other, causes the first user identification unit and the second user identification unit to extract differences in feature amounts and identify the identified users as different users; The interest measurement system according to claim 10 , further comprising:

15. an attribute storage unit that stores attributes of each area for each of a plurality of floors of the first building; a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building; a floor determination unit that determines an arrival floor of a user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among a plurality of floors of the first building using one or more elevator facilities provided in the first building; and a behavior information acquisition unit that acquires behavior information representing the behavior of a user identified by the first user identification unit at the arrival floor determined by the floor determination unit based on an image captured by at least one of the plurality of first cameras; an interest information acquisition unit that acquires interest information representing the interest level of the user for each attribute, for the user identified by the first user identification unit, based on the relationship between the area layout and attributes of the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and location information; a receiving unit that receives an image of a user of a third building from an external system applied to the third building; a third user identification unit that identifies a user based on the image received by the receiving unit; a visualization processing unit that generates an interest level map by using information stored as interest information in the interest information storage unit for the user identified by the third user identification unit and attribute information for at least any area of ​​the plurality of floors of the third building determined based on the image received by the receiving unit, the visualization processing unit generating an interest level map by visualizing a distribution of interest levels of users of the third building on floors of the third building for which attribute information has been determined among the plurality of floors of the third building; Equipped with The behavioral information includes interest direction information that indicates the direction of the user's interest, the interest information acquisition unit acquires interest information of the user based on an area of ​​high interest of the user based on a direction of the user represented by interest direction information and a correspondence between attributes of the area; Interest measurement system.

16. an attribute storage unit that stores attributes of each area for each of a plurality of floors of the first building; a first user identification unit that identifies a user in the first building based on an image captured by at least one of a plurality of first cameras installed in the first building; a floor determination unit that determines an arrival floor of a user identified by the first user identification unit based on an image captured by at least one of the plurality of first cameras when the user moves from a departure floor to an arrival floor among a plurality of floors of the first building using one or more elevator facilities provided in the first building; and a behavior information acquisition unit that acquires behavior information representing the behavior of a user identified by the first user identification unit at the arrival floor determined by the floor determination unit based on an image captured by at least one of the plurality of first cameras; an interest information acquisition unit that acquires interest information representing the interest level of the user for each attribute, for the user identified by the first user identification unit, based on the relationship between the area layout and attributes of the arrival floor determined by the floor determination unit and the behavior information acquired by the behavior information acquisition unit; an interest information storage unit that stores the interest information acquired by the interest information acquisition unit for each user, including time and location information; a receiving unit that receives, from an external system, an image of a user who starts using any one of the one or more elevator facilities provided in the third building; a third user identification unit that identifies a user based on the image received by the receiving unit; a transmission unit that transmits, for the user identified by the third user identification unit, information on destination candidates that are of high interest to the user and that are stored in the interest information storage unit, to the external system; Equipped with The behavioral information includes interest direction information that indicates the direction of the user's interest, the interest information acquisition unit acquires interest information of the user based on an area of ​​high interest of the user based on a direction of the user represented by interest direction information and a correspondence between the area and an attribute of the area; Interest measurement system.

17. The interest information acquisition unit acquires interest information of the user every time the behavior information acquisition unit completes acquisition of behavior information of the user at the arrival floor. The interest measurement system according to any one of claims 1 to 16.

18. a behavioral information storage unit that stores the behavioral information acquired by the behavioral information acquisition unit for each user; Equipped with The interest information acquisition unit reads the behavioral information for each user from the behavioral information storage unit at a preset timing, and acquires interest information of the user based on the read behavioral information. The interest measurement system according to any one of claims 1 to 17.

19. The behavioral information acquisition unit learns a model for deriving behavioral information from an image of a user by a supervised learning method of machine learning, and acquires behavioral information from the image of the user based on the learned model. The interest measurement system according to any one of claims 1 to 18.

20. An interest measurement system according to any one of claims 1 to 19, a simulation processing unit that sets simulation conditions based on existing conditions stored in the information of interest storage unit, and simulates changes in the information of interest based on new conditions obtained by changing the existing conditions obtained by the information of interest acquisition unit; A simulation system comprising:

21. Based on the results of the simulation of the new conditions, the rent for the new conditions is automatically calculated. The simulation system of claim 20.

22. The simulation processing unit calculates a difference between the behavior information and interest information under the existing conditions stored in the interest information storage unit and the simulated behavior information and interest information of the simulation under the new conditions. The simulation system according to claim 20 or 21.

23. An interest measurement system according to any one of claims 1 to 15; a simulation processing unit that sets simulation conditions based on existing conditions stored in the information of interest storage unit, and simulates changes in the information of interest based on new conditions obtained by changing the existing conditions obtained by the information of interest acquisition unit; Equipped with the simulation processing unit calculates a difference between the behavior information and interest information under the existing conditions stored in the interest information storage unit and the simulated behavior information and interest information of the simulation under the new conditions; The visualization processing unit visualizes the result of the difference of the simulation by superimposing it on at least one of an interest degree map of an existing condition and an interest degree map of a new condition. Simulation system.

Citation Information

Patent Citations

  • User interest analysis system, user interest analysis method, user interest analysis program, and recording medium therefor

    JP2006133915A

  • Institutional activity analysis device, institutional activity analysis system, and institutional activity analysis method

    JP2017188023A

  • Movement route analysis system

    JP2020077358A

  • Heatmap providing apparatus and method

    US20150187102A1

  • Apparatus and method for store analysis

    US20190019207A1

Cited By

  • Input device, input system, input method, and input program

    JP7856201B1