Congestion status display system, congestion status display method, and program

Abstract

To enhance user's convenience.SOLUTION: A congestion state information acquisition part (101) of a congestion state display system (1) acquires congestion state information about a congestion state of a corresponding place on the basis of a photographing device (40) arranged at each of a plurality of places. A user position information acquisition part (102) acquires user position information about a user position. A place selection part (103) selects a display object place to be a display object of a congestion state among the plurality of places on the basis of the user position information. A display control part (104) displays a congestion state screen about the congestion state of the display object place on a user terminal (20) on the basis of the congestion state information of the display object place.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a congestion status display system, a congestion status display method, and a program. [Background technology]

[0002] Conventionally, there is known a technique for acquiring congestion status information regarding the congestion status of a predetermined location based on an image capturing device placed at the location. For example, Patent Document 1 describes a congestion estimation program that acquires a machine learning model trained by machine learning based on training data including image data of an image of a predetermined area and classes indicating the congestion status of the predetermined area, and when the image data of the image of the predetermined area is input to the machine learning model, estimates the congestion status of the predetermined area based on the reliability of each class output by the machine learning model and environmental information at the time of estimation using the machine learning model.

[0003] For example, Patent Document 2 describes an estimation program that groups objects that are mutually related among a plurality of first images based on the position information of each estimated object and the estimated status of each object in each of the plurality of first images captured in a space, and estimates a retention area in the space where each object is retained based on the grouping results.

[0004] For example, Patent Document 3 describes a facility usage support method that acquires congestion estimation information for each usage area estimated from images captured by a camera that captures the usage area, calculates the time required for users to use the usage area for each usage area based on this congestion estimation information, acquires congestion presentation information for each usage area that indicates the degree of congestion in the usage area, and generates a viewing screen that includes the required time and congestion presentation information for each of multiple usage areas that users are expected to use. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-175561 [Patent Document 2] Japanese Patent Application Publication No. 2019-101664 [Patent Document 3] Japanese Patent Application Publication No. 2017-134513 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the technologies of Patent Documents 1 and 2 estimate the congestion level at one location, and are therefore unable to estimate the congestion level at each of multiple locations. The technology of Patent Document 3 can display the waiting time for each of multiple usage areas, but is unable to display the waiting time according to the user's location. For this reason, the conventional technologies have not been able to sufficiently improve user convenience.

[0007] One of the purposes of the present disclosure is to improve user convenience. [Means for solving the problem]

[0008] The congestion status display system of the present disclosure includes a congestion status information acquisition unit that acquires congestion status information regarding the congestion status of a plurality of locations based on an imaging device disposed at each of the locations; a user location information acquisition unit that acquires user location information regarding a user location; a location selection unit that selects a display target location from the plurality of locations based on the user location information, at which the congestion status is to be displayed; and a display control unit that displays a congestion status screen regarding the congestion status of the display target location on a user terminal based on the congestion status information of the display target location. [Effects of the Invention]

[0009] The present disclosure can improve convenience for users. [Brief explanation of the drawings]

[0010] [Figure 1]FIG. 1 is a diagram illustrating an example of a hardware configuration of a congestion status display system. [Figure 2] FIG. 1 is a diagram showing an example of a location where an imaging device is installed. [Figure 3] FIG. 10 is a diagram illustrating an example of a congestion status screen. [Figure 4] FIG. 2 is a diagram illustrating an example of functions realized by the congestion status display system. [Figure 5] FIG. 10 is a diagram illustrating an example of a location database. [Figure 6] FIG. 2 is a diagram illustrating an example of processing executed by the congestion status display system. [Figure 7] FIG. 10 is a diagram illustrating an example of a function realized in a modified example. [Figure 8] FIG. 23 is a diagram showing an example of a congestion status screen according to a thirteenth modification. DETAILED DESCRIPTION OF THE INVENTION

[0011] [1. Hardware configuration of the congestion status display system] An example of an embodiment of a congestion status display system, a congestion status display method, and a program according to the present disclosure will be described.

[0012] Fig. 1 is a diagram showing an example of the hardware configuration of a congestion status display system. For example, the congestion status display system 1 includes a server 10, a user terminal 20, a location terminal 30, and a photographing device 40. Each of the server 10, the user terminal 20, the location terminal 30, and the photographing device 40 is connected to a network N such as the Internet, a LAN, or a public communication line. Although Fig. 1 shows one each of the server 10, the user terminal 20, the location terminal 30, and the photographing device 40, there may be multiple of at least one of the server 10, the user terminal 20, the location terminal 30, and the photographing device 40.

[0013] The server 10 is a server computer. For example, the server 10 includes a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 includes at least one processor. The storage unit 12 includes at least one of a volatile memory such as RAM and a non-volatile memory such as a flash memory. The communication unit 13 includes at least one of a communication interface for wired communication and a communication interface for wireless communication.

[0014] The user terminal 20 is a user's computer. For example, the user terminal 20 is a smartphone, a tablet, a personal computer, or a wearable terminal. The user terminal 20 includes a control unit 21, a memory unit 22, a communication unit 23, an operation unit 24, a display unit 25, and a GPS unit 26. The hardware configurations of the control unit 21, the memory unit 22, and the communication unit 23 may be similar to those of the control unit 11, the memory unit 12, and the communication unit 13, respectively. The operation unit 24 includes an input device such as a touch panel or a mouse. The display unit 25 includes a display such as a liquid crystal or organic EL display. The GPS unit 26 includes a GPS receiver that receives signals from satellites.

[0015] The location terminal 30 is a computer at a location where the imaging device 40 is placed. For example, the location terminal 30 is a personal computer, a POS terminal, a server computer, a tablet, or a smartphone. The location terminal 30 includes a control unit 31, a storage unit 32, a communication unit 33, an operation unit 34, and a display unit 35. The hardware configurations of the control unit 31, the storage unit 32, the communication unit 33, the operation unit 34, and the display unit 35 may be similar to those of the control unit 11, the storage unit 12, the communication unit 13, the operation unit 24, and the display unit 25, respectively.

[0016] The photographing device 40 is a device that photographs a predetermined location. For example, the photographing device 40 is an AI (Artificial Intelligence) camera, a 360-degree camera, a video camera, a surveillance camera, a camera other than those classified as above, a smartphone, a tablet, or a personal computer. The photographing device 40 includes a control unit 41, a memory unit 42, a communication unit 43, and a photographing unit 44. The hardware configurations of the control unit 41, the memory unit 42, and the communication unit 43 may be similar to those of the control unit 11, the memory unit 12, and the communication unit 13, respectively. The photographing unit 44 includes at least one camera. The photographing device 40 may be connected to the location terminal 30 via a wired or wireless connection. The photographing device 40 may be included in the location terminal 30.

[0017] The programs stored in the storage units 12, 22, 32, 42 may be supplied to the server 10, the user terminal 20, the location terminal 30, or the photographing device 40 via the network N. Also, at least one of a reading unit (e.g., a memory card slot) that reads a computer-readable information storage medium and an input / output unit (e.g., a USB port) that inputs and outputs data to and from an external device may be included in the server 10, the user terminal 20, the location terminal 30, or the photographing device 40. For example, a program stored in an information storage medium may be supplied to the server 10, the user terminal 20, the location terminal 30, or the photographing device 40 via at least one of the reading unit and the input / output unit.

[0018] Furthermore, the congestion status display system 1 only needs to include at least one computer. The computers included in the congestion status display system 1 are not limited to the example in FIG. 1. For example, the congestion status display system 1 may include only the server 10 and the photographing device 40. In this case, the user terminal 20 and the location terminal 30 exist outside the congestion status display system 1. The congestion status display system 1 may also include only the server 10. In this case, the user terminal 20, the location terminal 30, and the photographing device 40 exist outside the congestion status display system 1. For example, the congestion status display system 1 may include the server 10 and other computers not shown in FIG. 1.

[0019] [2. Overview of the congestion status display system] In this embodiment, a camera device 40 is placed at each of a plurality of locations to detect the congestion level of the location. The camera device 40 can be placed at any location for which the congestion level is to be estimated. For example, the camera device 40 may be placed in a restaurant, retail store, or other store, a shopping mall, a department store, a shopping street, an event venue, a government office, a public transportation facility such as a station or airport, an amusement park, an office building, or other locations. Multiple camera devices 40 may be placed at one location.

[0020] FIG. 2 is a diagram showing an example of a location where the camera 40 is installed. In the example shown in the upper part of FIG. 2, the camera 40 is installed on the ceiling of a store or other location. The camera 40 may be installed in any location other than the ceiling. In this embodiment, an example is given of a case where the camera 40 is installed in a restaurant. For example, the camera 40 is installed in a location where it can capture the entire interior of the store. As shown in the lower part of FIG. 2, the camera 40 captures images of the interior of the store and generates a captured image. For example, the camera 40 analyzes the captured image and counts the number of customers in the store. Similarly, when the camera 40 is installed in a location other than a restaurant, the camera 40 counts the number of people in the other location.

[0021] For example, camera devices 40 installed at each of a plurality of locations generate congestion status information indicating the number of people present at that location. The camera devices 40 transmit the congestion status information for the locations where the camera devices 40 are installed to the server 10. The server 10 acquires the congestion status information from the camera devices 40 installed at each of the plurality of locations. The server 10 provides a congestion status display service that displays the congestion status of any of the plurality of locations to the user based on the congestion status information for each of the plurality of locations. Hereinafter, the locations for which congestion status is to be displayed are referred to as display target locations.

[0022] For example, if the image capture device 40 is installed in a restaurant, the congestion status display service may be provided to the user as one function of a restaurant search service that allows the user to search for restaurants. In this embodiment, it is assumed that an application for the congestion status display service (e.g., a so-called smartphone app) is installed on the user terminal 20. When the user launches the application installed on the user terminal 20, the user terminal 20 displays a congestion status screen on the display unit 25 that indicates the congestion status of a location. Note that the congestion status screen may be displayed on another program, such as a browser, installed on the user terminal 20.

[0023] FIG. 3 is a diagram showing an example of a congestion status screen. In FIG. 3, an application screen for a restaurant search service is shown as an example of the congestion status screen SC. For example, the user terminal 20 identifies the current location of the user based on the GPS unit 26. The user terminal 20 displays the congestion status screen SC showing a map M of the area around the current location on the display unit 25. On the map M, an icon I1 indicating the current location and an icon I2 indicating the display target location are displayed. The user can also input search conditions for the display target location into the input form F. When the user inputs the search conditions, the congestion status of the display target location that meets the search conditions is displayed on the congestion status screen SC.

[0024] In the example of FIG. 3, an icon I2 is displayed on the map to indicate the position of the display target location. The symbol included in the icon I2 indicates the congestion status of the display target location. For example, a circle symbol indicates that the display target location is empty. A triangle symbol indicates that the display target location is somewhat crowded. A cross symbol indicates that the display target location is very crowded. The congestion status may be expressed in any number of stages and is not limited to three stages as in this embodiment. For example, the congestion status may be expressed in two stages, or four or more stages. The congestion status may be expressed in a form other than a symbol. For example, the congestion status may be expressed by letters, numbers, the color of the icon I2, the size of the icon I2, or the shape of the icon I2.

[0025] For example, when a display target location is included in the map M, the user terminal 20 displays an icon I2 including a symbol corresponding to the congestion status information of the display target location on the congestion status screen SC. The user can also change the display range of the map M. For example, the user can display the map M of a location to which the user is heading on the congestion status screen SC. When the user changes the display range of the map M, the user terminal 20 communicates with the server 10 and updates the display on the congestion status screen SC so that an icon I2 indicating the congestion status of the display target location included in the changed display range is displayed.

[0026] As described above, the congestion status display system 1 of this embodiment acquires congestion status information for a plurality of locations from the image capture devices 40 installed at each of the locations. The congestion status display system 1 displays an icon I2 containing a symbol corresponding to the congestion status information of the display target location included in the map M on the congestion status screen SC. The user can understand the congestion status of any display target location using the congestion status screen SC. For example, the user can easily find a restaurant where they can enter without waiting. The congestion status display system 1 will be described in detail below.

[0027] [3. Functions realized by the congestion status display system] FIG. 4 is a diagram showing an example of functions realized by the congestion status display system 1. As shown in FIG.

[0028] [3-1. Functions realized by the server] For example, the server 10 includes a data storage unit 100, a congestion status information acquisition unit 101, a user position information acquisition unit 102, a location selection unit 103, and a display control unit 104. The data storage unit 100 is realized by the storage unit 12. The congestion status information acquisition unit 101, the user position information acquisition unit 102, the location selection unit 103, and the display control unit 104 are each realized by the control unit 11.

[0029] [Data storage section] The data storage unit 100 stores data necessary for displaying the congestion status screen SC. For example, the data storage unit 100 stores a location database DB.

[0030] Fig. 5 is a diagram showing an example of the location database DB. The location database DB is a database that stores various information related to the location where the image capture device 40 is installed. For example, the location database DB stores a location ID, a location name, location position information, capacity information, and congestion status information. The location database DB may store any information. The information stored in the location database DB is not limited to the example of Fig. 5. For example, the location database DB may store a history of congestion status information from the past.

[0031] A location ID is an example of location identification information that can identify an individual location. The location identification information may be information other than a location ID. For example, the location identification information may be a location name, location position information, a telephone number, an email address, or other information. The location name is the name of a location. For example, if a restaurant corresponds to a location, the location name is the name of the restaurant. The location position information is information about the position of a location. The location position information may be any information that can identify a location on Earth. For example, the location position information may be an address, latitude and longitude, coordinates, or other information.

[0032] The capacity information is information about the capacity of each location. For example, the capacity information may be the number of people that can be accommodated, the number of seats, the number of tables, the area, the volume, the number of floors, or other information. If the image capture device 40 is installed in a restaurant, the capacity information may be the number of people that can be accommodated, the number of seats, or the number of tables. The capacity information may also indicate the capacity for both seated and standing meals. In this embodiment, an example is given in which the capacity information is a numerical value indicating the capacity, but the capacity information may also be in other formats such as letters or symbols.

[0033] The congestion status information is information relating to the congestion status of each location. The congestion status is the degree of congestion. The congestion status information indicates the current or past congestion status. The congestion status information may indicate the congestion status at a certain point in time, or may indicate the congestion status at each of multiple points in time. In this embodiment, an example is given in which the congestion status information indicates the latest number of people at each location. The congestion status information may not be a numerical value indicating the number of people, but may be in other formats such as characters indicating the number of people (for example, characters such as large, medium, and small) or symbols. The congestion status information may not be a number of people, but may be another value such as the number of people divided by the capacity. The congestion status information may be the captured image itself indicating the results of capture by the image capture device 40.

[0034] The data stored in the data storage unit 100 is not limited to the location database DB. The data storage unit 100 may store any data necessary for displaying the congestion status screen SC. For example, the data storage unit 100 may store a user database that stores various information about users who use the congestion status display service. The user database stores information such as user IDs and passwords that users use to log in to the congestion status display service. The data storage unit 100 may also store various information about locations where the image capture device 40 is not located.

[0035] [Congestion status information acquisition section] The congestion information acquisition unit 101 acquires congestion information about the congestion status of a location based on the image capture device 40 installed at each of the multiple locations. In this embodiment, the image capture device 40 installed at each of the multiple locations generates congestion information about the location based on the captured image of the location captured by the image capture device 40. That is, the analysis of the congestion status is performed on the image capture device 40 side. For this reason, the congestion information acquisition unit 101 acquires the congestion information generated by the image capture device 40 installed at each of the multiple locations. For example, the congestion information acquisition unit 101 associates the congestion information acquired from the image capture device 40 at each of the multiple locations with the location ID of the location and stores it in the location database DB. The congestion information acquisition unit 101 can acquire congestion information about any location from the location database DB at any time.

[0036] The congestion status information acquisition unit 101 may acquire congestion status information of a location from each of the image capture devices 40 at a plurality of locations indirectly via another device, rather than directly. The congestion status information acquisition unit 101 may acquire, from each of the image capture devices 40 at a plurality of locations, a captured image showing the state of the location, rather than congestion status information. The congestion status information acquisition unit 101 may acquire congestion status information by analyzing the captured image. In this case, the congestion status information acquisition unit 101 has the same function as the congestion status information generation unit 401 described below. For example, the congestion status information acquisition unit 101 may analyze the captured image using any method and generate congestion status information. The congestion status information acquisition unit 101 may store the congestion status information it has generated in the location database DB in association with a location ID.

[0037] [User location information acquisition section] The user position information acquisition unit 102 acquires user position information related to the user position. The user position is a position related to the user. For example, the user position may be a current position, which is the position where the user is currently located. In this case, the user terminal 20 acquires user position information indicating the current position based on the GPS unit 26. The user terminal 20 transmits the user position information to the server 10. The user position information acquisition unit 102 acquires the user position information from the user terminal 20. The user position information indicating the current position may be acquired by a known method. For example, the user terminal 20 may acquire the user position information indicating the current position based on a GNSS other than GPS, a wireless LAN access point, a mobile base station, or another method.

[0038] The user position is not limited to the current position. The user position may be any position that is somehow related to the user. For example, the user position may be a position specified by the user on map M. The user position information acquisition unit 102 acquires user position information related to the user position specified on map M displayed on the user terminal 20. The user position may be the center of the display range of map M. In this case, when the user performs an operation to change the display range of map M, the user terminal 20 transmits user position information indicating the center of the display range of map M to the server 10. The user position information acquisition unit 102 acquires the user position information from the user terminal 20. The user position may be the display range of map M itself. The user can specify the user position on any screen other than map M. For example, the user may specify the user position by selecting a station from a list showing multiple stations. In this case, the user position is the position of the station selected by the user.

[0039] [Location selection section] The location selection unit 103 selects, from among a plurality of locations, a display target location for displaying the congestion status based on the user location information. For example, the location selection unit 103 selects, from among the plurality of locations, a location in the vicinity of the user location indicated by the user location information as a display target location. The vicinity of the user location means being within a predetermined distance from the user location or being within an area including the user location. The location selection unit 103 may select all locations in the vicinity of the user location as display target locations, or may select only some of those locations as display target locations. The location selection unit 103 may select at least one display target location. If there are no locations in the vicinity of the user location, the location selection unit 103 may not select a display target location.

[0040] In the example of FIG. 3, the location selection unit 103 displays a map M according to the user's location on the congestion status screen SC, so being within the map M corresponds to being in the vicinity of the user's location. For example, the location selection unit 103 identifies a location in the vicinity of the user's location based on the location information stored in the location database DB. The location selection unit 103 selects the identified location as a location to be displayed. When the map M is not displayed, the location selection unit 103 may select, as a location to be displayed, a location within a predetermined distance from the user's location or a location within an area including the user's location (for example, an area within a radius of 1 km) based on the location information stored in the location database DB.

[0041] [Display control section] The display control unit 104 causes the user terminal 20 to display a congestion status screen SC relating to the congestion status of the display target location based on the congestion status information of the display target location. The congestion status screen SC may show the congestion status of one display target location, or may show the congestion status of each of multiple display target locations. In this embodiment, the display control unit 104 causes the user terminal 20 to display a map M and a congestion status screen SC showing the congestion status of the display target locations in the vicinity of the user position. It is assumed that data for the map M is stored in the data storage unit 100.

[0042] In this embodiment, the process for displaying the congestion status screen SC is mainly executed by the display control unit 104 of the server 10. Therefore, the display control unit 104 generates display data for the congestion status screen SC and transmits it to the user terminal 20, thereby displaying the congestion status screen SC on the user terminal 20. The display data may be any data necessary for displaying the congestion status screen SC. The display data may be in any data format. For example, the display data may be HTML data or image data.

[0043] For example, the display control unit 104 refers to the location database DB and acquires capacity information and congestion status information of the display target location. The display control unit 104 calculates the ratio of the number of people indicated by the congestion status information to the capacity indicated by the capacity information of the display target location. The display control unit 104 causes the user terminal 20 to display a congestion status screen SC showing this ratio as the congestion status. In the example of FIG. 3, the display control unit 104 causes the user terminal 20 to display a congestion status screen SC showing an icon I2 including a symbol corresponding to this ratio.

[0044] For example, when the ratio of the number of people to the capacity is less than a first threshold (e.g., 50%), the display control unit 104 displays an icon I2 indicating a circle on the congestion status screen SC. When the ratio is equal to or greater than the first threshold and less than a second threshold (e.g., 70%), the display control unit 104 displays an icon I2 indicating a triangle on the congestion status screen SC. The second threshold is a threshold greater than the first threshold. When the ratio is equal to or greater than the second threshold, the display control unit 104 displays an icon I2 indicating a cross on the congestion status screen SC.

[0045] The display control unit 104 may cause the user terminal 20 to display a congestion status screen SC that does not include a map M. For example, the display control unit 104 may cause the congestion status of places in the vicinity of the position indicated by the user position information to be displayed in a list rather than on a map M on the congestion status screen SC. The display control unit 104 may cause the congestion status of places in the vicinity of the position indicated by the user position information to be displayed in a format other than the map M and a list (for example, a tile format) on the congestion status screen SC. The display control unit 104 may cause the user terminal 20 to display the congestion status screen SC based on the congestion status information, without taking into consideration the capacity information in particular.

[0046] [3-2. Functions implemented on user devices] For example, the user terminal 20 includes a data storage unit 200, an operation reception unit 201, and a display control unit 202. The data storage unit 200 is realized by the storage unit 22. The operation reception unit 201 and the display control unit 202 are realized by the control unit 21.

[0047] [Data storage section] The data storage unit 200 stores data necessary for a user to use the congestion status display service. For example, the data storage unit 200 stores an application dedicated to the congestion status display service. When a user uses the congestion status display service from a browser instead of the application, the data storage unit 200 stores the browser.

[0048] [Operation reception section] The operation reception unit 201 receives various operations from the user. For example, the operation reception unit 201 receives operations for an application or a browser dedicated to the congestion status display service. The operation reception unit 201 transmits data indicating the content of the user's operation to the server 10.

[0049] [Display control section] The display control unit 202 displays various screens on the display unit 25. For example, the display control unit 202 displays a congestion status screen SC on the display unit 25. The display control unit 202 communicates with the server 10, receives data necessary for displaying the congestion status screen SC, and displays the congestion status screen SC on the display unit 25.

[0050] [3-3. Functions realized by location terminal] For example, the location terminal 30 includes a data storage unit 300, an operation reception unit 301, and a display control unit 302. The data storage unit 300 is realized by the storage unit 32. The operation reception unit 301 and the display control unit 302 are realized by the control unit 31.

[0051] [Data storage section] The data storage unit 300 stores data necessary for a person involved in a location where the image capture device 40 is installed to use the congestion status display service. For example, the data storage unit 300 stores an application dedicated to the congestion status display service. When a person involved uses the congestion status display service from a browser instead of the application, the data storage unit 300 stores the browser.

[0052] [Operation reception section] The operation reception unit 301 receives various operations from the person concerned. For example, the operation reception unit 301 receives operations for an application or browser dedicated to the congestion status display service. The operation reception unit 301 transmits data indicating the operation content of the person concerned to the server 10.

[0053] [Display control section] The display control unit 302 displays various screens on the display unit 35. For example, the display control unit 302 displays a screen for related parties of the congestion status display service on the display unit 35. The display control unit 302 communicates with the server 10, receives data necessary for displaying the screen, and displays the screen on the display unit 35.

[0054] [3-4. Functions realized by the imaging device] For example, the photographing device 40 includes a data storage unit 400, a congestion status information generation unit 401, and a transmission unit 402. The data storage unit 400 is realized by the storage unit 42. The congestion status information generation unit 401 and the transmission unit 402 are each realized by the control unit 41.

[0055] [Data storage section] The data storage unit 400 stores data necessary for the congestion status information. For example, the data storage unit 400 stores image data of a captured image showing the state of a location captured by the photographing device 40 using the photographing unit 44. The captured image may be a still image or a video. The captured image may be an individual frame included in a video. In this embodiment, the captured image is a still image, for example. The data storage unit 400 may store image data of captured images at each of a plurality of points in time. The data storage unit 400 may store congestion status information generated by the congestion status information generation unit 401. The data storage unit 400 may store a location ID of the location where the photographing device 40 is located.

[0056] [Congestion status information generation unit] The congestion information generation unit 401 generates congestion information based on a captured image showing the state of a location captured by the image capture device 40. A method for estimating the congestion state based on the captured image may be a known method. For example, the congestion information generation unit 401 analyzes the captured image using template matching, optical flow, machine learning techniques, or other methods to generate congestion information. In the example of FIG. 2, the congestion information generation unit 401 counts the number of human figures shown in a captured image showing the state of a certain location to generate congestion information indicating the number of people in the location. The congestion information generation unit 401 may generate congestion information using a sensor (e.g., a human presence sensor) within the image capture device 40.

[0057] In this embodiment, the congestion status information generation unit 401 periodically generates the latest congestion status information. The time interval at which the congestion status information is generated may be any interval. For example, the time interval may be 1 minute, 5 minutes, 30 minutes, 1 hour, or another interval. Data indicating the time interval is stored in the data storage unit 400. The congestion status information generation unit 401 generates a new captured image for each time interval indicated in the data, and generates new congestion status information based on the new captured image. In other words, the congestion status information generation unit 401 generates a new captured image every time it is time to generate congestion status information, and generates new congestion status information based on the new captured image. The congestion status information generation unit 401 may generate the latest congestion status information irregularly rather than periodically.

[0058] [Transmitter] The transmitting unit 402 transmits the congestion status information to the server 10. For example, if the latest congestion status information is generated periodically, the transmitting unit 402 transmits the latest congestion status information to the server 10 periodically. If the latest congestion status information is generated irregularly, the transmitting unit 402 transmits the latest congestion status information to the server 10 irregularly. The transmitting unit 402 also transmits to the server 10 the location ID of the location where the image capturing device 40 is installed. The transmitting unit 402 may transmit the congestion status information to the server 10 via the location terminal 30.

[0059] [4. Processing performed by the congestion status display system] Fig. 6 is a diagram showing an example of processing executed in the congestion status display system 1. The processing in Fig. 6 is executed by the control units 11, 21, and 41 executing programs stored in the storage units 12, 22, and 42, respectively. In the example of Fig. 6, the processing of the location terminal 30 is not shown, but the image capturing device 40 may communicate indirectly with the server 10 via the location terminal 30, rather than directly with the server 10.

[0060] As shown in FIG. 6, the camera device 40 captures an image of the location where it is located (S1). The camera device 40 generates congestion status information based on the captured image generated by capturing the image in S1 (S2). The camera device 40 transmits a location ID and congestion status information to the server 10 (S3). The server 10 acquires the location ID and congestion status information from the camera device 40 (S4). In S4, the server 10 stores the congestion status information in the location database DB in association with the location ID. The server 10 executes the process of S4 between the camera devices 40 located in various locations.

[0061] When the application for the congestion status display service is launched, the user terminal 20 executes a login process with the server 10 to log the user in to the congestion status display service (S5). The user terminal 20 acquires user position information indicating the user's location based on the GPS unit 26 (S6). The user terminal 20 transmits the user position information to the server 10 (S7). The server 10 acquires the user position information from the user terminal 20 (S8). The server 10 selects a location to be displayed based on the user position information and the location database DB (S9).

[0062] The server 10 acquires congestion status information of the display target location based on the location database DB (S10). The server 10 generates display data for the congestion status screen SC based on the congestion status information of the display target location and transmits it to the user terminal 20 (S11). The user terminal 20 acquires the display data for the congestion status screen SC from the server 10 (S12). The user terminal 20 displays the congestion status screen SC on the display unit 25 based on the display data acquired in S11 (S13), and this processing ends. Thereafter, when the user changes the display range on the map M, the user terminal 20 transmits user position information corresponding to the display range of the map M to the server 10. Thereafter, processing similar to S8 to S13 is executed, and the congestion status of the location corresponding to the latest display range of the map M is displayed on the congestion status screen SC.

[0063] [5. Summary of embodiments] The congestion status display system 1 of this embodiment acquires congestion status information regarding the congestion status analyzed based on the image capturing devices 40 installed at each of a plurality of locations. The congestion status display system 1 acquires user location information. The congestion status display system 1 selects a display target location based on the user location information. The congestion status display system 1 displays a congestion status screen SC on the user terminal 20 based on the congestion status information of locations in the vicinity of the location indicated by the user location information. This allows the user to understand the congestion status of any location among the plurality of locations, thereby improving user convenience. For example, if the congestion status display system 1 is used for a restaurant search service, the user can easily find a restaurant that they can enter without waiting.

[0064] Furthermore, the congestion status display system 1 acquires user position information indicating the user's position specified on the map M displayed on the user terminal 20. The congestion status display system 1 causes the user terminal 20 to display a congestion status screen SC indicating the map M and the congestion status of places around the user's position. This allows the user to understand the congestion status of places on the map M, and the congestion status display system 1 allows the user to understand the congestion status of each place more clearly, thereby further improving user convenience.

[0065] Furthermore, the camera devices 40 installed at each of the multiple locations generate congestion status information for that location based on the images they have taken of the location. The congestion status display system 1 acquires the congestion status information generated by the camera devices 40 installed at each of the multiple locations. As a result, the processing for generating the congestion status information is performed on the camera device 40 side, and the congestion status display system 1 can reduce the processing load on the server 10.

[0066] [6. Modifications] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit of the present disclosure.

[0067] 7 is a diagram showing an example of functions realized in the modified example. For example, the server 10 includes a product status information acquisition unit 105, a reservation processing execution unit 106, an ambiguous setting unit 107, an ambiguous determination unit 108, an estimation unit 109, an operation status information acquisition unit 110, a proposal unit 111, a schedule information acquisition unit 112, and a future congestion status information acquisition unit 113. Each of the product status information acquisition unit 105, the reservation processing execution unit 106, the ambiguous setting unit 107, the ambiguous determination unit 108, the estimation unit 109, the operation status information acquisition unit 110, the proposal unit 111, the schedule information acquisition unit 112, and the future congestion status information acquisition unit 113 is realized by the control unit 11.

[0068] [6-1. Variation 1] For example, in the embodiment, an example was given of a case where congestion status information is acquired based on a human-shaped figure shown in a captured image, but the method of acquiring congestion status information is not limited to the example of the embodiment. Modification 1 takes an example where congestion status information is acquired based on fixtures in the location where the image capture device 40 is installed. The fixtures are objects located in the location where the image capture device 40 is installed. The fixtures may be any objects. For example, if the image capture device 40 is installed in a restaurant, the fixtures may be chairs, tables, counters, tableware, shelves, potted plants, or other objects in the restaurant. If the image capture device 40 is installed in a location other than a restaurant, the fixtures may be objects located in the other location.

[0069] For example, the camera 40 generates congestion status information by detecting fixtures shown in the captured image. The camera 40 may detect fixtures based on a known object detection method. For example, the object detection method may be a pattern matching method, an edge detection method, a machine learning technique, or another method. When the camera 40 is installed in a restaurant, the camera 40 detects chairs in the restaurant based on the captured image. The camera 40 counts the number of chairs shown in the captured image. If a person is sitting in a chair, the chair will be hidden by the person and the shape of the chair will not be detected. Therefore, the camera 40 calculates the number of customers in the restaurant by subtracting the number of chairs detected in the captured image from the total number of chairs in the restaurant. The camera 40 generates congestion status information indicating the number of customers.

[0070] The method by which the camera device 40 generates congestion information based on the fixtures shown in the captured image is not limited to the above example. For example, the camera device 40 may generate congestion information by counting the number of tables shown in the captured image. If a person is using a table, the table will not be detected by the items or luggage on the table. Therefore, the camera device 40 estimates the number of customers in the restaurant by subtracting the number of tables detected in the captured image from the total number of tables in the restaurant. In this case, the camera device 40 may estimate the number of customers in the restaurant based on data indicating the number of people that can sit at one table. The camera device 40 generates congestion information indicating this number of people.

[0071] The congestion status information acquisition unit 101 of Modification 1 acquires congestion status information for a plurality of locations based on the camera device 40 that captures images of furniture arranged in the locations. For example, the congestion status information acquisition unit 101 acquires congestion status information from the camera device 40, the congestion status information being generated by the camera device 40 detecting furniture in the captured images. While the method for generating the congestion status information differs from that of the embodiment, the process by which the congestion status information acquisition unit 101 acquires the congestion status information from the camera device 40 may be the same as that of the embodiment. Instead of the camera device 40 generating the congestion status information, the congestion status information acquisition unit 101 may acquire the captured images from the camera device 40, detect furniture shown in the captured images, and acquire the congestion status information. In this case, the process for generating the congestion status information, which has been described as being performed by the camera device 40, may be performed by the congestion status information acquisition unit 101.

[0072] The congestion status display system 1 of the first modification acquires congestion status information for a plurality of locations based on an image capturing device 40 that captures images of fixtures arranged in each of the locations. As a result, even in an environment where it is difficult to detect people from the captured image, the congestion status display system 1 can acquire congestion status information from the fixtures, allowing the user to understand the congestion status of a location in such an environment.

[0073] [6-2. Variation 2] For example, the equipment of Variation 1 may be placed in a space used by visitors to the location where the image capture device 40 is placed. The visitor may be a person associated with the location, or a person other than a person associated with the location. For example, if the image capture device 40 is placed in a restaurant, the visitor is a customer. If the image capture device 40 is placed in a location other than a restaurant, the visitor may be any person who visits the location. For example, the visitor may be a business partner.

[0074] The congestion information acquisition unit 101 of the second modification acquires congestion information for a plurality of locations based on the camera 40 that captures images of furniture placed in the spaces used by visitors to each of the locations. The spaces are part of the location where the camera 40 is placed. For example, if the camera 40 is placed in a restaurant, the space is the seating floor. If the camera 40 is placed in a location other than a restaurant, the space may be any space in the other location.

[0075] For example, the camera device 40 is placed in a position where it can capture an image of the space in which the furniture is placed. The camera device 40 captures an image of the furniture in the space and generates a captured image. In the first modification, the furniture may be placed in a space not used by visitors, but in the second modification, the furniture is placed in a space used by visitors. The process by which the camera device 40 detects furniture from the captured image and generates congestion status information may be the same as in the first modification. The congestion status information acquisition unit 101 acquires congestion status information for each of a plurality of locations from the camera device 40, which captures an image of furniture placed in a space used by visitors who visit each of the locations. Also, as in the first modification, the congestion status information acquisition unit 101 may acquire congestion status information based on the captured image generated by the camera device 40.

[0076] The congestion status display system 1 of the second modification acquires congestion status information for a plurality of locations based on a camera device 40 that captures images of fixtures placed in the spaces used by visitors to each of the locations. This allows the congestion status display system 1 to acquire congestion status information related to the congestion status of visitors among the people present at the locations where the camera device 40 is placed, thereby enabling the user to understand the congestion status that the user wants to know. For example, the congestion status display system 1 can display a congestion status screen SC showing the congestion status of the seating area on the user terminal 20 using fixtures in the seating area of ​​a restaurant.

[0077] [6-3. Variation 3] For example, the color of the fixture in Modifications 1 and 2 may be used to detect whether the space containing the fixture is vacant. Modification 3 describes, as an example of fixture, a sign with one side of a first color and the other side of a second color. The first color indicates that the space is vacant. The second color is a color different from the first color and indicates that the space is not vacant. The first color and the second color may each be any color. For example, the first color may be blue. The second color may be red. For example, when the image capture device 40 is installed in a restaurant, a sign is placed on each table in the restaurant. A waiter places the first-colored side of the sign on an empty table facing up. After guiding a customer to the table, the waiter places the second-colored side of the sign on facing up. The fixture used to estimate the crowdedness is not limited to signs and may be other fixtures. It is sufficient to use fixtures that have multiple colors, each of which can be used to estimate the crowdedness. For example, the fixtures may be paper, cloth, tableware, a computer, a light, or other fixtures. In a third modification, the color of fixtures is detected from the captured image and used to estimate the occupancy level. In a restaurant, the occupancy level may be estimated from the color of the tablecloth. For example, if there is food on the tablecloth, the area of ​​the color of the tablecloth in the captured image will be small, so whether the seats are occupied may be estimated from the area of ​​the color.

[0078] The congestion status information acquisition unit 101 of Modification 3 acquires congestion status information according to the colors of fixtures arranged in each of multiple locations. For example, the camera 40 captures images of the tags on tables from the ceiling of a restaurant. The camera 40 detects the colors of the tags shown in the captured image. The colors of the tags shown in the captured image may be detected using a known object detection method. The camera 40 determines that a table is vacant if the tags on the table are a first color. The camera 40 determines that the table is occupied if the tags on the table are a second color. The camera 40 generates congestion status information based on the number of vacant tables and / or occupied tables. Although the method for generating congestion status information differs from the embodiment, the process by which the congestion status information acquisition unit 101 acquires congestion status information from the camera 40 is the same as described in the embodiment. Similarly to the embodiment, the congestion status information acquisition unit 101 may acquire congestion status information based on captured images acquired from the camera 40, rather than having the camera 40 generate congestion status information.

[0079] The congestion status display system 1 of the third modification acquires congestion status information according to the color of the equipment placed in each of a plurality of locations. As a result, the congestion status display system 1 can acquire more accurate congestion status information by acquiring congestion status information according to the color of the equipment that is easily detected from the captured image. The congestion status display system 1 can allow the user to more accurately grasp the congestion status of the location where the image capture device 40 is placed.

[0080] [6-4. Variation 4] For example, in Modifications 1 to 3, the case where fixtures are used to acquire congestion information has been described. However, the congestion information acquisition unit 101 may acquire congestion information for a location based on a camera 40 that captures images of products sold at each of multiple locations. For example, if the camera 40 is installed in a restaurant, if a product is placed on a table, it is highly likely that the table is in use. Therefore, the camera 40 may determine whether or not a product is placed on a table shown in a captured image. The camera 40 estimates the number of customers in the restaurant from the number of tables with products placed on them. The camera 40 generates congestion information indicating the number of customers.

[0081] For example, if the camera 40 is installed in an apparel store, if the products in the store are not folded, the store may be crowded. Therefore, the camera 40 may analyze the state of the products shown in the captured image and estimate the congestion level based on the degree of messiness of the product display. For example, the camera 40 may generate congestion status information such that the more messy the display, the more crowded the store. Although the method for generating the congestion status information differs from that of the embodiment, the process by which the congestion status information acquisition unit 101 acquires the congestion status information from the camera 40 may be the same as that of the embodiment. Instead of the camera 40 generating the congestion status information, the congestion status information acquisition unit 101 may acquire the captured image from the camera 40, detect the products shown in the captured image, and acquire the congestion status information. In this case, the process for generating the congestion status information, which has been described as being executed by the camera 40, may be executed by the congestion status information acquisition unit 101.

[0082] The congestion status display system 1 of the fourth modification acquires congestion status information for a plurality of locations based on the image capturing device 40 that captures images of products sold at the locations. As a result, even in an environment where it is difficult to detect people from the captured image, the congestion status display system 1 can acquire congestion status information from the products, allowing the user to understand the congestion status of a location in such an environment.

[0083] [6-5. Variation 5] For example, in the fourth modification, an example was given in which congestion status information was acquired based on the status of the products, but the display of the congestion status screen SC may also be controlled based on the status of the products. The congestion status display system 1 of the fifth modification includes a product status information acquisition unit 105. The product status information acquisition unit 105 acquires product status information relating to the status of the products sold at each of a plurality of locations based on the image capture device 40 installed at the location. For example, the image capture device 40 may detect the status of the products from the captured image based on a method similar to that of the fourth modification, and generate product status information.

[0084] The product status information is information indicating the status of the product. For example, the product status information may indicate the presence or absence of products, the number of products, the degree of disorganization of the product display, or other conditions. The camera device 40 may identify the condition of the product by analyzing the captured image. For example, the camera device 40 may generate the product status information by detecting the presence or number of products based on a known object detection method. The camera device 40 may generate the product status information by detecting the disorganization of the product display using a template image of disorganized products. For example, the product status information acquisition unit 105 acquires the product status information from the camera device 40. The product status information acquisition unit 105 may acquire the product status information by analyzing the captured image acquired from the camera device 40. In this case, the process for generating the product status information, which has been described as being executed by the camera device 40, may be executed by the product status information acquisition unit 105.

[0085] The display control unit 104 of the fifth modification causes the user terminal 20 to display a congestion status screen SC further based on the product status information of the display target location. For example, the display control unit 104 may cause the congestion status screen SC to display a message indicating the status of the products indicated by the product status information. The display control unit 104 may cause the congestion status screen SC to display a message indicating the presence or absence of products, the number of products, the disorganization of product display, or other conditions. The display control unit 104 may correct the congestion status information based on the product status information and then display the congestion status screen SC on the user terminal 20. For example, when the product status information indicates that there are no products, that there are only a few products, that the products are disorganized, or other conditions, the display control unit 104 may correct the congestion status indicated by the congestion status information to appear more crowded and then display the congestion status screen SC on the user terminal 20.

[0086] The congestion status display system 1 of Variation 5 acquires product status information related to the status of products sold at a plurality of locations based on the camera device 40 installed at each of the locations. The congestion status display system 1 causes the user terminal 20 to display a congestion status screen SC based on the product status information of the display target location. This allows the congestion status display system 1 to display on the user terminal 20 a congestion status screen SC corresponding to the status of the products at the display target location. For example, the user can know the status of the products in advance from the congestion status screen SC. For example, even if there are few customers in a restaurant, if the tables are not cleared or there is little product in stock, it will take a long time for the products to be served, and the user can also know such information from the congestion status screen SC.

[0087] [6-6. Variation 6] For example, the display control unit 104 may cause the user terminal 20 to display a congestion status screen SC indicating that a reservation for the display target location is available for acceptance. In the example of FIG. 3, when the user selects icon I2, the display control unit 104 causes the congestion status screen SC to display a user interface for reserving the location indicated by icon I2. The user interface may be an input form for the reservation date and time, an input form for the reservation name, an input form for other reservation details, a link to the screen of these input forms, or another user interface. The user interface for making reservations available for acceptance may be a known user interface. Data necessary for displaying the congestion status screen SC indicating that a reservation is available for acceptance is assumed to be stored in the data storage unit 100. The display control unit 104 may cause the user terminal 20 to display a congestion status screen SC indicating that a reservation for the display target location is available for acceptance for acceptance of reservations based on the data.

[0088] The congestion status display system 1 of the sixth modification includes a reservation processing execution unit 106. The reservation processing execution unit 106 executes reservation processing for reservations accepted from the congestion status screen. The reservation processing is processing for recording reservation data related to the reservation details. In the sixth modification, an example is given in which the reservation data is stored in a location database DB, but the reservation data may be stored in a database other than the location database DB. The reservation data may include any information related to the reservation. For example, the reservation data may include the reservation date and time, the person who made the reservation, the reservation conditions, or other information. The reservation processing execution unit 106 acquires reservation data related to the reservation details entered by the user on the congestion status screen SC from the user terminal 20. The reservation processing execution unit 106 executes the reservation processing by storing the reservation data in a database such as a location database DB. If the reservation data is stored in an external system, the reservation processing execution unit 106 may execute the reservation processing by transmitting the reservation data to the external system.

[0089] The congestion status display system 1 of the sixth modification causes the user terminal 20 to display a congestion status screen SC that allows reservations for the display target location to be accepted. The congestion status display system 1 executes reservation processing for the reservation accepted from the congestion status screen SC. This allows the user to check the congestion status on the congestion status screen SC and immediately make a reservation, thereby improving user convenience.

[0090] [6-7. Variation 7] For example, depending on the person concerned at the location where the image capture device 40 is placed, they may want to be notified of the congestion status of the location in detail, or they may want to be notified of the congestion status of the location in a vague manner. For this reason, it may be possible to allow the person concerned to set how clearly they want to notify the user of the congestion status.

[0091] The congestion status display system 1 of the seventh variant includes an ambiguity setting unit 107. The ambiguity setting unit 107 sets the ambiguity of the display of the congestion status of each of the multiple locations based on the operation of the parties involved in each of the multiple locations. The ambiguity of the display is the number of levels in the display of the congestion status. The more levels there are, the less ambiguous the display. The fewer levels there are, the more ambiguous the display. In the example of Figure 3, the congestion status is displayed in three levels. When the congestion status has two levels, "empty" and "crowded," and the "slightly crowded" level is eliminated, the display of the congestion status becomes ambiguous. When the congestion status has two levels, "slightly crowded" and "crowded," and the "empty" level is eliminated, the display of the congestion status becomes ambiguous. When the congestion status has two levels, "empty" and "slightly crowded," and the "crowded" level is eliminated, the display of the congestion status becomes ambiguous.

[0092] For example, a person involved in the location where the image capturing device 40 is placed operates the location terminal 30 to specify the setting content related to ambiguity. The person involved may specify the level of congestion display itself, or may simply specify the ambiguity by selecting one of a plurality of predetermined ambiguities, such as "ambiguous" or "clear." The location terminal 30 transmits ambiguity setting data indicating the ambiguity setting specified by the person involved in a certain location to the server 10. The ambiguity setting unit 107 receives the ambiguity setting data from the location terminal 30. The ambiguity setting unit 107 performs the setting related to ambiguity by associating the ambiguity setting data with the location ID of the location.

[0093] For example, the display control unit 104 displays a congestion status screen SC on the user terminal based on the setting of the display target location. The display control unit 104 references the location database DB and acquires ambiguity setting data for the display target location. The display control unit 104 determines the number of levels for the display target location based on the ambiguity setting data for the display target location. The display control unit 104 displays a congestion status screen SC showing the congestion status of the location based on the determined number of levels. In Variation 7, the ambiguity setting may differ for each display target location. Therefore, the display control unit 104 determines how ambiguously to display the congestion status of a certain display target location based on the ambiguity setting for the display target location, and displays the congestion status of the display target location on the congestion status screen SC with ambiguity according to the determined result.

[0094] The congestion status display system 1 of Variation 7 sets the ambiguity of the display of the congestion status of each of a plurality of locations based on the operation of the parties involved in each of the locations. The congestion status display system 1 displays the congestion status screen SC on the user terminal based on the setting of the display target location. This allows the congestion status display system 1 to prevent the congestion status screen SC from being displayed in an undesired manner at a location where the image capture device 40 is located. For example, a party who does not want the vacant status of their restaurant to be clearly known can set the congestion status to be ambiguous. Conversely, a party who wants to clearly communicate the congestion status of their restaurant to the user can set the congestion status to be clear.

[0095] [6-8. Variation 8] For example, in the seventh modification, a case has been described in which a person related to the location where the image capturing device 40 is installed sets the ambiguity. The ambiguity setting may be determined depending on whether the user is a paid member or not. The congestion status display system 1 of the seventh modification includes an ambiguity determination unit 108. The ambiguity determination unit 108 determines the ambiguity in the display of the congestion status screen SC based on whether the user of the user terminal is a paid member or not. Whether the user is a paid member or not may be determined based on the user database stored in the data storage unit 100, or may be queried from an external system unit. The user can use the congestion status display service as a paid member by logging in to the congestion status display service and completing the procedure to become a paid member. When the user becomes a paid member, the server 10 updates the user database to indicate that the user is a paid member.

[0096] The display control unit 104 of the eighth modification causes the user terminal 20 to display the congestion status screen SC further based on the ambiguity determined by the ambiguity determination unit 108. For example, the display control unit 104 may generate display data for the congestion status screen SC so that the congestion status indicated by the congestion status information of the display target area is displayed with the ambiguity determined by the ambiguity determination unit 108. For example, if the user is a paid member, the display control unit 104 may cause the display unit 25 to display the congestion status screen SC so that the congestion status can be seen more clearly than when the user is not a paid member. In the example of FIG. 3, if the user is a paid member, the display control unit 104 controls the display of the congestion status screen SC so that the congestion status is displayed in three stages on the congestion status screen SC. If the user is not a paid member, the display control unit 104 controls the display of the congestion status screen SC so that the congestion status is displayed in two stages, “empty” and “crowded” (i.e., the congestion status screen SC has fewer stages of congestion status than when the user is a paid member).

[0097] The congestion status display system 1 of Modification 8 determines the ambiguity in displaying the congestion status screen SC based on whether the user of the user terminal 20 is a paid member. The congestion status display system 1 displays the congestion status screen SC on the user terminal further based on the ambiguity determined by the ambiguity determination unit 108. This allows the congestion status display system 1 to prevent the congestion status screen SC from being displayed in an undesired manner at a location where the image capture device 40 is placed. For example, if a person concerned thinks that it is desirable for a queue to form, the congestion status display system 1 sets the congestion status display system 1 to make it easy to detect the formation of a queue.

[0098] [6-9. Variation 9] For example, a user may want to know the congestion situation in a location where the camera device 40 is not installed. If there is a location similar to the location where the camera device 40 is not installed among multiple locations where the camera device 40 is installed, the congestion situation in the similar location may be useful as a reference. Therefore, the congestion situation display system 1 may estimate the congestion situation in a location where the camera device 40 is not installed based on the congestion situations in locations similar to the location where the camera device 40 is not installed. In the 9th modification, the location where the camera device 40 is not installed is referred to as the "other location."

[0099] The congestion status display system 1 of the ninth modification includes an estimation unit 109. The estimation unit 109 estimates the congestion status of another location different from the multiple locations based on congestion status information of a location related to the other location. A location related to another location is a location similar to the other location. A location related to another location can also be said to be a location whose congestion status is useful as a reference. For example, the estimation unit 109 identifies a location related to the other location from among multiple locations where the image capture device 40 is installed, and estimates the congestion status of the other location based on congestion status information of the identified location. The other location whose congestion status is to be estimated may be one of the display target locations, or may be a location that has not been selected as a display target location but is a candidate for the display target location.

[0100] In the ninth modification, the location IDs of the other locations and the location IDs of the locations related to the other locations are pre-associated in the location database DB. That is, the relationships between the other locations and the locations related to the other locations are pre-defined in the location database DB. These relationships may be defined by an administrator of the congestion status display system 1, by a person involved in the other locations, or by information processing by a computer such as the server 10. For example, the estimation unit 109 identifies locations related to the other locations from among multiple locations where the image capture devices 40 are installed, based on the association of these location IDs.

[0101] In addition, when a place related to another place is defined by information processing by a computer such as the server 10, the computer such as the server 10 may identify the place related to the other place based on the characteristics of the place where the image capture device 40 is located and the characteristics of the other place. It is assumed that place characteristic information regarding the characteristics of these places is stored in a place database DB. The place characteristic information may be any characteristic that is correlated with the congestion state. For example, the place characteristic information may be location conditions, industry, genre (category), product, service, price range, atmosphere, capacity, or other characteristics. The computer such as the server 10 may identify, among multiple places, a place whose place characteristic information indicates characteristics similar to those indicated by the place characteristic information of the other place as a place related to the other place. The computer such as the server 10 may identify a place related to the other place based on clustering based on the place characteristic information, a model prepared by a machine learning technique, or other methods.

[0102] For example, when the estimation unit 109 identifies a location related to another location, it acquires congestion status information of the identified location from the location database DB. The estimation unit 109 may acquire the congestion status information of the identified location as the congestion status information of the other location. The estimation unit 109 may acquire the congestion status information of the other location by increasing or decreasing a value indicated by the congestion status information of the identified location based on a predetermined amount or calculation formula. The estimation unit 109 may input the congestion status information of the identified location into a model prepared using a machine learning technique, and acquire it as the congestion status information of the other location. The estimation unit 109 stores the congestion status information of the other location in the location database DB in association with the location ID of the other location.

[0103] The location selection unit 103 in the ninth modification example selects not only locations where the camera device 40 is installed, but also other locations where the camera device 40 is not installed as candidates for display locations. If there are other locations in the vicinity of the user position indicated by the user location information, the location selection unit 103 selects the other locations as display locations. Although the difference is whether the camera device 40 is installed or not, the method of selecting display locations may be the same as in the embodiment.

[0104] The display control unit 104 of the ninth modification causes the user terminal 20 to display a congestion status screen SC relating to the congestion status of another location, further based on the estimation result of the estimation unit 109. For example, when another location is selected as the display target location by the location selection unit 103, the display control unit 104 causes the user terminal 20 to display a congestion status screen SC relating to the congestion status of the other location, based on the congestion status information of the other location. Although the difference is whether or not the imaging device 40 is installed, the method of displaying the congestion status of the display target location may be the same as in the embodiment.

[0105] The congestion status display system 1 of the ninth modification estimates the congestion status of a location different from the plurality of locations based on congestion status information of a location related to the other location. The congestion status display system 1 displays a congestion status screen SC relating to the congestion status of the other location on the user terminal 20 based on the estimated congestion status of the other location. This allows the user to understand the estimated congestion status of the other location where the image capture device 40 is not installed, thereby further improving user convenience.

[0106] [6-10. Variation 10] For example, even if a certain location is empty, for some reason, the people involved in the location may not want users to visit that location. When image capture device 40 is installed in a restaurant, even if the restaurant is empty, if the restaurant is short-staffed during that time period, the people involved in the restaurant may not want users to visit that time period. Conversely, even if the restaurant is crowded, if the restaurant has sufficient staff during that time period, the people involved in the restaurant may want users to visit that time period. For this reason, the congestion status display system 1 may display, on the user terminal 20, a congestion status screen SC that corresponds to the operating status of the location where image capture device 40 is installed.

[0107] The congestion status display system 1 of the tenth modification includes an operation status information acquisition unit 110. The operation status information acquisition unit 110 acquires operation status information related to the operation status of each of the multiple locations. The operation status is the current status of the business being operated at the location where the image capture device 40 is installed. For example, the operation status may be the number of people involved (shifts in the case of a restaurant), product inventory, product status, service speed, equipment usage status, or other status. In the tenth modification, the number of people involved is taken as an example of the operation status. For example, the location terminal 30 stores operation status information indicating the number of people involved for each time period. If the image capture device 40 is installed at a restaurant, the location terminal 30 stores operation status information indicating the restaurant's shifts. The operation status information acquisition unit 110 acquires operation status information of each of the multiple locations from the location terminal 30. The operation status information acquisition unit 110 associates the operation status information acquired from the location with the location ID of each of the multiple locations and stores the information in the location database DB.

[0108] The display control unit 104 of the tenth modification causes the user terminal 20 to display the congestion status screen SC further based on the operation status information. For example, the display control unit 104 determines the congestion status of a certain display target place to be displayed on the congestion status screen SC based on the operation status information of the certain display target place and the congestion status information of the certain display target place. The display control unit 104 adjusts the congestion status indicated by the congestion status information of the certain display target place based on the operation status information of the certain display target place. It is assumed that data indicating the relationship between the operation status information and the congestion status adjustment method is stored in advance in the data storage unit 100. The display control unit 104 adjusts the congestion status indicated by the congestion status information of the certain display target place based on the data using the adjustment method associated with the operation status information of the certain display target place.

[0109] For example, if the image capture device 40 is installed in a restaurant and the operation status information indicates the shift of the restaurant, the display control unit 104 determines whether there is a current manpower shortage based on the shift indicated by the operation status information of the display target location. The display control unit 104 determines whether there is a current manpower shortage by comparing the current manpower indicated by the shift with a threshold associated with the display target location. The threshold is assumed to be stored in the location database DB. The threshold may vary depending on the location and time period. The display control unit 104 determines that there is a manpower shortage when it is determined that the current manpower indicated by the shift of a certain display target location is equal to or greater than the threshold associated with the display target location. The display control unit 104 determines that there is a manpower shortage when it is determined that the current manpower indicated by the shift of a certain display target location is less than the threshold associated with the display target location.

[0110] For example, if the display control unit 104 determines that the display target location currently has sufficient staff, it may display the congestion status screen SC on the user terminal 20 without adjusting the congestion status indicated by the congestion status information for the display target location. If the display control unit 104 determines that the display target location currently has insufficient staff, it may adjust the congestion level indicated by the congestion status information for the display target location to increase, and display the congestion status screen SC on the user terminal 20. The congestion level is the number of people present at the display target location. Data indicating the increase in the congestion level is assumed to be pre-stored in the data storage unit 100. The increase may be a fixed value or may be an amount corresponding to the number of people who are short-staffed. In the example of FIG. 3, due to an increase in the congestion level, a display target location that would normally be "slightly crowded" is displayed as "crowded" if it is short-staffed. This prevents excessive visitors from arriving during hours when there is a shortage of staff.

[0111] For example, if it is determined that the display target location currently has sufficient staff, the display control unit 104 may adjust the congestion level indicated by the congestion status information for the display target location. If it is determined that the display target location currently has sufficient staff, the display control unit 104 adjusts the congestion level indicated by the congestion status information for the display target location to decrease, and displays the congestion status screen SC on the user terminal 20. Data indicating the amount of decrease in the congestion level is assumed to be pre-stored in the data storage unit 100. The amount of decrease may be a fixed value or may be an amount corresponding to the number of people who have sufficient staff. In the example of FIG. 3, due to the congestion level phenomenon, a display target location that would normally be "congested" is displayed as "slightly congested" when it has sufficient staff. This prevents further visitors from being expected during times when there is sufficient staff.

[0112] The method by which the display control unit 104 displays the congestion status screen SC based on the operation status information is not limited to the above example. The display control unit 104 may display the congestion status screen SC by using the operation status information in some way. For example, the display control unit 104 may display a message or image indicating the operation status indicated by the operation status information on the congestion status screen SC. The display control unit 104 may display a message or image such as "There may be a shortage of staff at present" or "There may be a low inventory of products at present" on the congestion status screen SC as the operation status of the display target location.

[0113] The congestion status display system 1 of the tenth modification acquires operation status information relating to the operation status of each of a plurality of locations. The congestion status display system 1 displays a congestion status screen SC on the user terminal 20 based on the operation status information. This allows the congestion status display system 1 to display a congestion status screen SC corresponding to the operation status of the display target location on the user terminal 20. For example, the congestion status display system 1 can reduce visitors during hours when there is a shortage of staff and increase visitors during hours when there is an abundance of staff, thereby improving convenience for those involved in the location where the image capture device 40 is installed. When the operation status of the display target location is displayed on the congestion status screen SC, the user can know the operation status of the display target location, so the congestion status display system 1 can further improve user convenience.

[0114] [6-11. Variation 11] For example, if a display target location whose congestion status is displayed on the congestion status screen SC is congested, the user may head to another location instead of going to the display target location. For this reason, the congestion status display system 1 may suggest other locations related to the display target location. The congestion status display system 1 of Modification 11 includes a suggestion unit 111. The suggestion unit 111 suggests other locations related to the display target location when the display target location is congested.

[0115] A display target location being congested means that the congestion status of the display target location is equal to or greater than a threshold. In the embodiment, when the ratio of the number of people to the capacity is used as the congestion status, the ratio is equal to or greater than a threshold. In the embodiment, an example is given in which two thresholds, i.e., a first threshold and a second threshold, are used, but the number of thresholds may be only one or may be three or more. In Modification 11, the suggestion unit 111 determines whether the ratio, which is an example of the congestion status of the display target location, is equal to or greater than a second threshold, and determines that the display target location is congested if it is determined that the ratio is equal to or greater than the second threshold. If it is determined that the ratio is less than the second threshold, the suggestion unit 111 determines that the display target location is congested.

[0116] The other locations related to the display target location are similar to the display target location. The other locations related to the display target location can also be locations that should be suggested instead of the display target location. The other locations related to the display target location may be locations where the image capture device 40 is installed, or may be locations where the image capture device 40 is not installed. In the eleventh modification, the location IDs of each location that can be the display target location and the location IDs of other locations related to the location are associated in advance in the location database DB. That is, the relationship between the location IDs of each location that can be the display target location and the other locations related to the location is defined in advance in the location database DB. These relationships may be defined by an administrator of the congestion status display system 1, by a person involved in each location that can be the display target location, or by information processing by a computer such as the server 10. For example, the suggestion unit 111 identifies locations related to the display target location based on the association of these location IDs. When other locations related to each location that can be the display target location are defined by information processing by a computer such as the server 10, the other locations may be identified by processing similar to that of the ninth modification.

[0117] For example, the suggestion unit 111 suggests another place related to the display target location by displaying information that allows the other place to be identified on the congestion status screen SC. The information may be an image such as an icon I2, a message, a link, a banner, a pop-up, a window, or other information. The suggestion unit 111 may suggest the other place related to the display target location in a manner that allows the user to visually or audibly recognize the other place. The suggestion unit 111 may suggest the other place when the other place related to the display target location is not crowded. When there are multiple other places related to the display target location, the suggestion unit 111 may suggest a relatively less crowded other place among the multiple other places. The method of determining whether the other place is crowded may be the same as the method of determining whether the display target location is crowded.

[0118] The congestion status display system 1 of Variation 11 suggests other places related to the display target location when the display target location is crowded. This allows the congestion status display system 1 to suggest other places that can be used as alternative destinations to the user when the display target location is crowded, thereby further improving user convenience. For example, when the restaurant that the user is searching for on the congestion status screen SC is crowded, the user can learn of the existence of other alternative restaurants, thereby improving user convenience.

[0119] [6-12. Variation 12] For example, the congestion situation at a location where the image capture device 40 is installed may change depending on scheduled events at the location or in the surrounding area. If the image capture device 40 is installed in a restaurant and an event attracting a large number of people is held in the building in which the restaurant is located or in the surrounding area, the restaurant may become suddenly crowded around the time of the event. For this reason, the congestion situation display system 1 may display the congestion situation screen SC on the user terminal 20, taking into account scheduled events such as such events. Schedules are not limited to events, and may be anything that affects the congestion situation. For example, schedules may include the arrival and departure times of transportation such as trains or airplanes.

[0120] The congestion status display system 1 of the twelfth modification includes a schedule information acquisition unit 112. The schedule information acquisition unit 112 acquires schedule information related to schedules at or around each of a plurality of locations. The schedule information indicates the date and time of the schedule, the expected number of people at the schedule, the specific content of the schedule, or other information. The schedule information may be any information related to the congestion status. For example, the schedule information may be stored in the location database DB in association with a location ID. In this case, the schedule information acquisition unit 112 acquires schedule information associated with the location ID of the display target location. The schedule information may be stored in a database other than the location database DB, in a computer other than the server 10, or in an external information storage medium. In this case, the schedule information acquisition unit 112 may acquire the schedule information from the other database, the other computer, or the external information storage medium.

[0121] The display control unit 104 of the 12th modification causes the user terminal 20 to display the congestion status screen SC further based on the schedule information. For example, the display control unit 104 determines the congestion status of a certain display target location to be displayed on the congestion status screen SC based on the schedule information of the certain display target location and the congestion status information of the certain display target location. The display control unit 104 adjusts the congestion status indicated by the congestion status information of the certain display target location based on the schedule information of the certain display target location. It is assumed that data indicating the relationship between the schedule information and the congestion status adjustment method is stored in advance in the data storage unit 100. The display control unit 104 adjusts the congestion status indicated by the congestion status information of the certain display target location based on the data using the adjustment method associated with the schedule information of the certain display target location.

[0122] For example, when the date and time of an event indicated in the schedule information for a certain display target location arrives or approaches, the display control unit 104 adjusts the congestion level indicated in the congestion status information for the display target location so that the congestion level increases. The meaning of the congestion level is as explained in Modification Example 10. Data indicating the increase in the congestion level is assumed to be stored in advance in the data storage unit 100. The increase may be a fixed value or an amount corresponding to the schedule information. For example, the increase may be greater as the number of people indicated in the schedule information increases. In the example of Figure 3, due to the increase in the congestion level, a display target location that would normally be "slightly crowded" is displayed as "crowded" due to the event indicated in the schedule information. This allows the congestion status to be adjusted taking the event into consideration.

[0123] The method by which the display control unit 104 displays the congestion status screen SC based on the schedule information is not limited to the above example. The display control unit 104 may display the congestion status screen SC by using the schedule information in some way. For example, the display control unit 104 may display a message or image indicating the schedule indicated by the schedule information on the congestion status screen SC. The display control unit 104 may display a message or image such as "There is an event being held now, so it may be busier than the congestion status currently displayed" or "A train is arriving in an hour, so it may be crowded at that time" on the congestion status screen SC as a schedule for the display target location.

[0124] The congestion status display system 1 of Variation 12 acquires schedule information related to schedules at or around each of a plurality of locations. The congestion status display system 1 displays a congestion status screen SC on the user terminal 20 based on the schedule information. This allows the congestion status display system 1 to display a congestion status screen SC corresponding to the schedule at or around the display target location on the user terminal 20. For example, the congestion status display system 1 can further enhance user convenience by allowing the user to understand the congestion status taking into account the schedule, which is an element that cannot be estimated solely from the congestion status information obtained from the image capture device 40.

[0125] [6-13. Variation 13] For example, in a facility such as an airport or a train station, the camera device 40 may be installed at each of multiple locations within the facility. In this case, a user at the facility may be able to switch the display area within the facility on the congestion status screen SC. The facility includes multiple locations where the camera device 40 is installed. The facility may be any facility for which congestion status information is provided. In Variation 13, a public transportation facility such as an airport or a train station is used as an example, but the facility may also be an office building, a shopping mall, an event venue, or other facility. Information indicating whether multiple locations are within the same facility is stored in the location database DB. For example, a facility ID that can identify the facility and the location IDs of each of the multiple locations within the facility are associated and stored in the location database DB. The server 10 may identify multiple locations within a facility based on these associations.

[0126] FIG. 8 is a diagram showing an example of a congestion status screen SC according to Modification 13. The display control unit 104 of Modification 13 causes the user terminal 20 to display a congestion status screen SC that shows facilities including multiple display target locations and allows the display of the congestion status to be switched for each display target location. For example, when the user selects a facility, the display control unit 104 causes a map M of the facility to be displayed on the congestion status screen SC. A user interface for the user to select a facility may be displayed on the congestion status screen SC or on another screen. When the user moves the map M, the display control unit 104 causes the congestion status of the display target locations included in the map M after the move to be displayed on the congestion status screen SC. In the example of FIG. 8, the display control unit 104 causes the user terminal 20 to display a congestion status screen SC that shows the congestion status of each of multiple locations (e.g., restaurants, smoking areas, shops, and waiting areas) in the airport selected by the user. It is assumed that an image capturing device 40 is installed at each of the locations.

[0127] For example, when a user selects an icon I3 of a display target location within a facility, the display control unit 104 switches the display of the congestion status by moving the map M to the location of the icon I2 indicating the congestion status of the display target location based on the congestion status information of the display target location indicated by the icon I3. The display control unit 104 may switch the display of the congestion status by displaying a message or image (e.g., button B in FIG. 8) indicating the congestion status of the display target location selected by the user, rather than by moving the map M. In the example of FIG. 8, information indicating whether each location belongs to a restaurant or a waiting area is stored in the location database DB. The display control unit 104 switches the congestion status of the location selected by the user based on the information. For example, when the user selects a restaurant, the display control unit 104 identifies which location among the locations within the airport is a restaurant based on the information, and displays the congestion status on the congestion status screen SC based on the congestion status information of the identified location.

[0128] The congestion status display system 1 of the thirteenth modification displays a congestion status screen SC that shows a facility including a plurality of display target locations and allows the display of the congestion status to be switched for each display target location on the user terminal 20. This makes it easier for the user to grasp the congestion status of each display target location within the facility, thereby improving user convenience.

[0129] [6-14. Variation 14] For example, the display control unit 104 may cause the user terminal 20 to display a congestion status screen SC relating to the congestion status of a specific space in a display target location. In Modification 14, the camera device 40 does not capture an image of the entire location, but rather captures an image of a specific space in the location. The specific space captured by the camera device 40 is a part of the location where the camera device 40 is placed. The specific space may be any space. The specific space may be any space in which the user wants to know the congestion status.

[0130] For example, if the image capture device 40 is installed in a restaurant, a popular space such as a window seat in the restaurant may correspond to the specific space. Although the specific space is captured by the image capture device 40, the method of generating congestion status information and the method of displaying the congestion status screen SC may be the same as those in the embodiment. The display control unit 104 may display information that can identify the specific space (for example, a character string or an image indicating the specific space) on the congestion status screen SC. Data required to display the information is stored in the data storage unit 100. The display control unit 104 may display the information based on the data.

[0131] The congestion status display system 1 of the fourteenth modification displays a congestion status screen SC relating to the congestion status of a specific space in a display target location on the user terminal 20. This allows the congestion status display system 1 to allow the user to grasp the congestion status of a specific space in a display target location, thereby further improving user convenience. For example, the user can grasp the congestion status of a popular space in a restaurant.

[0132] [6-15. Variation 15] For example, in the embodiment, the case where the current or most recent congestion status is displayed on the congestion status screen SC has been exemplified. The congestion status of each location has a tendency specific to that location, so the congestion status display system 1 may be able to estimate the future congestion status of that location based on that tendency. Therefore, the congestion status display system 1 may estimate the future congestion status of the display target location and display the estimated congestion status on the congestion status screen SC.

[0133] The congestion status display system 1 of the fifteenth modification includes a future congestion status information acquisition unit 113. The future congestion status information acquisition unit 113 acquires future congestion status information regarding the congestion status of a location in the future based on the congestion status information of each of a plurality of locations. In the fifteenth modification, it is assumed that the history of the congestion status information for each location is stored in the location database DB. For example, the future congestion status information acquisition unit 113 estimates the congestion status of each location in the future based on the history of the congestion status information for that location, and acquires future congestion status information indicating the estimated congestion status. The future congestion status information differs from the congestion status information in that it indicates the congestion status in the future, but may be similar to the congestion status information in other respects.

[0134] For example, the future congestion information acquisition unit 113 acquires congestion information at a past time similar to the future time to be estimated as the future congestion information for the future time. A past time similar to a future time is a past time with a similar congestion situation to the future time. For example, a past time with the same time period or day of the week as the future time is a past time with a similar congestion situation to the future time. A past time with a similar congestion situation to the future time may be identified based on factors other than time period or day of the week. Other factors may include a division such as weekday or weekend, a division within a month (e.g., early, middle, and late), a month, or a season. The future congestion information acquisition unit 113 may acquire congestion information at a past time similar to the future time to be estimated as the future congestion information for the future time, or may acquire it as the future congestion information for the future time after multiplying it by some coefficient or calculating the average value of past congestion situations. Note that the method of acquiring future congestion information is not limited to the above example. For example, the future congestion status information acquisition unit 113 may estimate the future congestion status of a certain location from the history of congestion status information of the location, based on a model prepared by a machine learning technique.

[0135] The display control unit 104 of Modification 15 causes the user terminal 20 to display a congestion status screen SC indicating the future congestion status of the display target location based on the future congestion status information of the display target location. For example, the display control unit 104 causes the congestion status screen SC to display not only the congestion status indicated by the current or most recent congestion status information, but also the future congestion status of the display target location. Although the congestion status screen SC differs from that described in the embodiment in that it displays the future congestion status of the display target location, the processing for displaying the congestion status may be the same as in the embodiment. For example, the display control unit 104 may calculate the ratio of the number of people indicated by the future congestion status information to the capacity indicated by the capacity information of the display target location, and cause the user terminal 20 to display a congestion status screen SC showing an icon I2 including a symbol corresponding to the ratio.

[0136] The congestion status display system 1 of Variation 15 acquires future congestion status information regarding the future congestion status of a location based on the congestion status information for each of a plurality of locations. The congestion status display system 1 displays a congestion status screen SC regarding the future congestion status of the display target location based on the future congestion status information for the display target location on the user terminal 20. This allows the congestion status display system 1 to display not only the current or most recent congestion status but also the future congestion status on the congestion status screen SC, thereby further improving user convenience.

[0137] [6-16. Other variations] For example, the above modifications 1 to 15 may be combined.

[0138] For example, the functions described as being realized by the server 10 may be realized by the user terminal 20, the location terminal 30, the photographing device 40, or another computer. The functions described as being realized by the photographing device 40 may be realized by the server 10, the user terminal 20, the location terminal 30, or another computer. The functions of the congestion status display system 1 may be shared among multiple computers.

[0139] [7. Notes] For example, the congestion status display system can be configured as follows. (1) a congestion status information acquisition unit that acquires congestion status information regarding the congestion status of each of a plurality of locations based on an image capturing device disposed at each of the locations; a user location information acquisition unit that acquires user location information relating to a user location; a location selection unit that selects, from the plurality of locations, a display target location that is to be a display target of the congestion status based on the user location information; a display control unit that displays, on a user terminal, a congestion status screen regarding the congestion status of the display target place based on the congestion status information of the display target place; A congestion status display system including (2) the congestion status information acquisition unit acquires the congestion status information of each of the plurality of locations based on the photographing device that photographs the equipment arranged in the location, (1) A congestion status display system. (3) the congestion status information acquisition unit acquires the congestion status information of each of the plurality of locations based on the photographing device that photographs the equipment arranged in a space used by visitors who visit each of the plurality of locations; (2) A congestion status display system. (4) the congestion status information acquisition unit acquires the congestion status information according to the color of the equipment arranged in each of the plurality of locations. A congestion status display system according to (2) or (3). (5) the user position information acquisition unit acquires the user position information relating to the user position specified on a map displayed on the user terminal; A congestion status display system according to any one of (1) to (4). (6) the congestion status information acquisition unit acquires the congestion status information of each of the plurality of locations based on the photographing device that photographs the products sold at the location; A congestion status display system according to any one of (1) to (5). (7) the congestion status display system further includes a product status information acquisition unit that acquires product status information regarding the status of products sold at each of the plurality of locations based on an image capturing device disposed at each of the locations; the display control unit causes the user terminal to display the congestion status screen further based on the commodity status information of the display target location. A congestion status display system according to any one of (1) to (6). (8) the image capturing device disposed at each of the plurality of locations generates the congestion status information of the location based on a captured image showing the state of the location captured by the image capturing device; the congestion status information acquisition unit acquires the congestion status information generated by the imaging devices disposed at each of the plurality of locations. A congestion status display system according to any one of (1) to (7). (9) the display control unit causes the user terminal to display the congestion status screen, which indicates that the display target location is available for reservation; the congestion status display system further includes a reservation processing execution unit that executes reservation processing related to the reservation accepted from the congestion status screen, A congestion status display system according to any one of (1) to (8). (10) The congestion status display system further includes an ambiguity setting unit that sets ambiguity in the display of the congestion status of each of the plurality of locations based on an operation of a person involved in the location, The display control unit causes the congestion status screen to be displayed on the user terminal further based on the setting of the display target location. A congestion status display system according to any one of (1) to (9). (11) the congestion status display system further includes an ambiguity determination unit that determines ambiguity in displaying the congestion status screen based on whether or not the user of the user terminal is a paid member, The display control unit causes the congestion status screen to be displayed on the user terminal further based on the ambiguity determined by the ambiguity determination unit. A congestion status display system according to any one of (1) to (10). (12) the congestion status display system further includes an estimation unit that estimates a congestion status of another location different from the plurality of locations based on the congestion status information of the location related to the other location, the display control unit causes the user terminal to display the congestion status screen regarding the congestion status of the other place based on the estimation result of the estimation unit. A congestion status display system according to any one of (1) to (11). (13) The congestion status display system further includes an operation status information acquisition unit that acquires operation status information regarding an operation status of each of the plurality of locations, the display control unit causes the congestion status screen to be displayed on the user terminal further based on the operation status information. A congestion status display system according to any one of (1) to (12). (14) The congestion status display system further includes a suggestion unit that suggests other places related to the display target place when the display target place is crowded. A congestion status display system according to any one of (1) to (13). (15) The congestion status display system further includes a schedule information acquisition unit that acquires schedule information regarding a schedule for each of the plurality of locations or a schedule for a surrounding area thereof, The display control unit causes the congestion status screen to be displayed on the user terminal further based on the schedule information. A congestion status display system according to any one of (1) to (14). (16) the display control unit causes the user terminal to display the congestion status screen, which shows facilities including a plurality of the display target locations and allows switching of display of the congestion status for each of the display target locations; A congestion status display system according to any one of (1) to (15). (17) The display control unit causes the user terminal to display a congestion status screen regarding the congestion status of a specific space in the display target location. A congestion status display system according to any one of (1) to (16). (18) The congestion status display system further includes a future congestion status information acquisition unit that acquires future congestion status information regarding the congestion status of each of the plurality of locations based on the congestion status information of each of the plurality of locations, the display control unit causes the user terminal to display the congestion status screen regarding the congestion status of the display target place in the future based on the future congestion status information of the display target place. A congestion status display system according to any one of (1) to (17). [Explanation of symbols]

[0140] 1 Congestion status display system, 10 Server, 11, 21, 31, 41 Control unit, 12, 22, 32, 42 Memory unit, 13, 23, 33, 43 Communication unit, 20 User terminal, 24, 34 Operation unit, 25, 35, 45 Display unit, 26 GPS unit, 30 Location terminal, 40 Photographing device, 44 Photographing unit, 100, 200, 300, 400 Data storage unit, 101 Congestion status information acquisition unit, 102 User position information acquisition unit, 103 Location selection unit, 104, 202, 302 Display control unit, 105 Product status information acquisition unit, 106 Reservation processing execution unit, 107 Ambiguous setting unit, 108 Ambiguous determination unit, 109 Estimation unit, 110 Operation status information acquisition unit, 111 Proposal unit, 112 Schedule information acquisition unit, 113 Future congestion status information acquisition unit, 201, 301 operation reception unit, 401 congestion status information generation unit, 402 transmission unit, F input form, I captured image, M map, N network, DB location database, I1, I2, I3 icons, SC congestion status screen.

Claims

1. a congestion status information acquisition unit that analyzes the state of merchandise shown in images captured by a photographing device that photographs merchandise sold at each of a plurality of locations, and acquires congestion status information relating to the congestion status of the location based on the degree of disorder in the display of the merchandise; a user location information acquisition unit that acquires user location information relating to a user location; a location selection unit that selects, from the plurality of locations, a display target location that is to be a display target of the congestion status based on the user location information; a display control unit that displays, on a user terminal, a congestion status screen regarding the congestion status of the display target place based on the congestion status information of the display target place; A congestion status display system including

2. a congestion status information acquisition unit that acquires congestion status information regarding the congestion status of a plurality of locations based on captured images generated by the image capture devices disposed at the locations; a product condition information acquisition unit that acquires product condition information relating to the disorderliness of product displays as the condition of the products sold at each of the plurality of locations by analyzing the captured images generated by the photographing devices disposed at each of the plurality of locations; a user location information acquisition unit that acquires user location information relating to a user location; a location selection unit that selects, from the plurality of locations, a display target location that is to be a display target of the congestion status based on the user location information; a display control unit that displays, on a user terminal, a congestion status screen regarding the congestion status of the display target place based on the congestion status information of the display target place and the commodity status information of the display target place; A congestion status display system including

3. the image capturing device disposed at each of the plurality of locations generates the congestion status information of the location based on a captured image showing the state of the location captured by the image capturing device; the congestion status information acquisition unit acquires the congestion status information generated by the imaging devices disposed at each of the plurality of locations. The congestion status display system according to claim 1 or 2.

4. the display control unit causes the user terminal to display the congestion status screen, which indicates that the display target location is available for reservation; the congestion status display system further includes a reservation processing execution unit that executes reservation processing related to the reservation accepted from the congestion status screen, The congestion status display system according to claim 1 or 2.

5. The congestion status display system further includes an ambiguity setting unit that sets ambiguity in the display of the congestion status of each of the plurality of locations based on an operation of a person involved in the location, The display control unit causes the congestion status screen to be displayed on the user terminal further based on the setting of the display target location. The congestion status display system according to claim 1 or 2.

6. The congestion status display system further includes an ambiguity determination unit that determines ambiguity in displaying the congestion status screen based on whether or not the user of the user terminal is a paid member, and the display control unit causes the user terminal to display the congestion status screen based on the ambiguity determined by the ambiguity determination unit. The congestion status display system according to claim 1 or 2.

7. the congestion status display system further includes an estimation unit that estimates a congestion status of another location different from the plurality of locations based on the congestion status information of the location related to the other location, the display control unit causes the user terminal to display the congestion status screen regarding the congestion status of the other place based on the estimation result of the estimation unit. The congestion status display system according to claim 1 or 2.

8. The congestion status display system further includes an operation status information acquisition unit that acquires operation status information regarding an operation status of each of the plurality of locations, the display control unit causes the congestion status screen to be displayed on the user terminal further based on the operation status information. The congestion status display system according to claim 1 or 2.

9. The congestion status display system further includes a suggestion unit that suggests other places related to the display target place when the display target place is crowded. The congestion status display system according to claim 1 or 2.

10. The congestion status display system further includes a schedule information acquisition unit that acquires schedule information regarding a schedule for each of the plurality of locations or a schedule for a surrounding area thereof, The display control unit causes the congestion status screen to be displayed on the user terminal further based on the schedule information. The congestion status display system according to claim 1 or 2.

11. the display control unit causes the user terminal to display the congestion status screen, which shows facilities including a plurality of the display target locations and allows switching of display of the congestion status for each of the display target locations; The congestion status display system according to claim 1 or 2.

12. The display control unit causes the user terminal to display a congestion status screen regarding the congestion status of a specific space in the display target location. The congestion status display system according to claim 1 or 2.

13. The congestion status display system further includes a future congestion status information acquisition unit that acquires future congestion status information regarding the congestion status of each of the plurality of locations based on the congestion status information of each of the plurality of locations, the display control unit causes the user terminal to display the congestion status screen regarding the congestion status of the display target place in the future based on the future congestion status information of the display target place. The congestion status display system according to claim 1 or 2.

14. The computer a congestion status information acquisition step of analyzing the state of merchandise shown in a photographed image generated by a photographing device that photographs merchandise sold at each of a plurality of locations, and acquiring congestion status information regarding the congestion status of the location based on the degree of disorder of the merchandise display; a user location information acquisition step of acquiring user location information relating to a user location; a location selection step of selecting, from the plurality of locations, a display target location to be targeted for display of the congestion status, based on the user location information; a display control step of displaying, on a user terminal, a congestion status screen relating to the congestion status of the display target place based on the congestion status information of the display target place; A congestion status display method that performs the following.

15. a congestion status information acquisition unit that analyzes the state of merchandise shown in photographed images generated by a photographing device that photographs merchandise sold at each of a plurality of locations, and acquires congestion status information relating to the congestion status of the location based on the degree of disorder of the merchandise display; a user position information acquisition unit that acquires user position information relating to a user position; a location selection unit that selects, from the plurality of locations, a display target location that is a display target for displaying the congestion status based on the user location information; a display control unit that displays, on a user terminal, a congestion status screen regarding the congestion status of the display target place based on the congestion status information of the display target place; A program that allows a computer to function as a

Images