Information processing method, program, and information processing device

Abstract

To provide an information processing method capable of achieving a sales promotion activity for prompting buying inclination at a museum shop and the like.SOLUTION: A computer measures the number of appreciators who stop at an exhibit appreciation area for each of a plurality of exhibits and a stop time of each appreciator. The computer identifies a video reproduction method on each exhibit on the basis of the measured number of appreciators and stop time, and outputs each video in the identified reproduction method.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method, a program, and an information processing device. [Background technology]

[0002] Patent Document 1 discloses a system that analyzes the preferences of visitors based on the time they spend viewing each work inside an art gallery or museum, and notifies them of recommended works by email after they leave. The system disclosed in Patent Document 1 allows visitors to view recommended works by accessing the address specified in the email received after they leave the museum, making it possible to prevent them from missing works that match their preferences. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-10870 Summary of the Invention [Problem to be solved by the invention]

[0004] Many art galleries and museums have so-called museum shops, located inside or nearby, that sell merchandise related to the exhibits. However, some visitors who have finished viewing the exhibits leave the museum without stopping by the museum shop. Furthermore, because there are many artworks on display in the museum, even if a visitor finds a piece they like while viewing it, by the time they arrive at the museum shop, their impression of the piece has faded, and they often do not end up purchasing a product. Therefore, it is difficult to increase sales at museum shops. The system disclosed in Patent Document 1 only introduces recommended artworks and does not engage in sales promotion activities to increase sales at museum shops.

[0005] The present disclosure has been made in consideration of these circumstances, and its purpose is to provide an information processing method, etc., that can realize sales promotion activities that stimulate purchasing desire at museum shops. [Means for solving the problem]

[0006] An information processing method according to one aspect of the present disclosure involves a computer measuring, for each of a plurality of exhibits, the number of viewers who stop in an area where the exhibit is viewed and the amount of time each viewer stays there, identifying a playback method for the video for each of the plurality of exhibits based on the measured number of viewers and the amount of time each viewer stays there, and outputting each video using the identified playback method. [Effects of the Invention]

[0007] In one aspect of the present disclosure, it is possible to realize sales promotion activities that encourage purchasing at museum shops. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of the configuration of an information processing system. [Figure 2] FIG. 1 is an explanatory diagram of a facility that uses an information processing system. [Figure 3] FIG. 2 is a block diagram showing a configuration example of an edge PC. [Figure 4] FIG. 2 is a block diagram illustrating an example of the configuration of a server. [Figure 5] FIG. 2 is an explanatory diagram illustrating an example of a record layout of a DB stored in a server. [Figure 6] FIG. 2 is an explanatory diagram illustrating an example of a record layout of a DB stored in a server. [Figure 7] 10 is a flowchart illustrating an example of a procedure for detecting a state of a viewer. [Figure 8] FIG. 1 is an explanatory diagram illustrating an example of the configuration of a learning model. [Figure 9] 10 is a flowchart illustrating an example of a procedure for specifying a reproduction schedule. [Figure 10] 10 is a flowchart illustrating an example of a procedure for specifying a reproduction schedule. [Figure 11] 10 is a flowchart illustrating an example of a procedure for specifying a reproduction schedule. [Figure 12] 10 is a flowchart illustrating an example of a procedure for specifying a reproduction schedule. [Figure 13] 10 is a flowchart showing another example of the procedure for setting the playback time of one cycle. [Figure 14] 10 is a flowchart showing another example of the travel time setting processing procedure. [Figure 15] 10 is a flowchart showing an example of a procedure for specifying a playback schedule according to the second embodiment. [Figure 16] FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 17] 11 is a flowchart showing an example of a procedure for specifying a playback schedule according to the third embodiment. [Figure 18] FIG. 10 is an explanatory diagram showing an example of a screen. [Figure 19] FIG. 10 is an explanatory diagram showing another example of the schedule editing screen. [Figure 20] 10 is a flowchart illustrating an example of a procedure for a playback schedule recommendation process. [Figure 21] FIG. 13 is an explanatory diagram showing an example of the configuration of a camera DB according to a fifth embodiment. [Figure 22] 10 is a flowchart showing another example of the procedure of the playback schedule recommendation process. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an information processing method, a program, and an information processing device according to the present disclosure will be described in detail with reference to the drawings showing embodiments thereof.

[0010] (Embodiment 1) FIG. 1 is an explanatory diagram showing an example of the configuration of an information processing system, and FIG. 2 is an explanatory diagram of a facility that uses the information processing system. In this embodiment, an information processing system is described that detects the viewing behavior of visitors who move around the facility and view the exhibits in a facility where multiple exhibits are displayed, such as an art museum, a museum, a science museum, an aquarium, a botanical garden, a zoo, or a theme park, and performs sales promotion activities to encourage purchasing at stores located within or near the facility based on the detection results. Note that the facilities in which the information processing system of this embodiment is used are not limited to those described above, and may be any facility that displays multiple exhibits and has a store located within or near the facility. Hereinafter, a facility in which the information processing system is installed is referred to as a museum, and a store located within or near the museum is referred to as a museum shop.

[0011] As shown in FIG. 2, the museum is equipped with an exhibition area where multiple exhibits are displayed and a shop area (sales area) with a museum shop. The museum is also configured so that visitors move through the exhibition area, viewing the exhibits according to a predetermined route, and arrive at the shop area after viewing. In the information processing system of this embodiment, an area for viewing the exhibit (hereinafter referred to as a "spot") is set for each exhibit, and when a visitor is at each spot, it is assumed that the visitor is viewing the corresponding exhibit. For example, in the example shown in FIG. 2, appropriate areas in front of each exhibit are set as spots. Therefore, visitors move between spots, stopping at each spot, to view each exhibit. Note that the spots may be set to a position and size that allows the visitors to view the exhibits, depending on the type, size, and display method of the exhibit, and may be different sizes for each exhibit.

[0012] The information processing system of this embodiment includes an edge PC (Personal Computer) 10, a server 20, and a digital signage 30 (display device), and each device is communicatively connected via a network N. The network N may be the Internet or a local area network (LAN) provided within the museum. The digital signage 30 is provided in a location away from the exhibition area, such as near the entrance to a museum shop, where it can be viewed by visitors who have finished viewing the exhibits and arrived at the shop area. Note that the location of the digital signage 30 is not limited to near the entrance to the museum shop, but may also be provided on the route from the exhibition area to the museum shop (within the travel area). In this embodiment, for simplicity of explanation, a configuration in which one digital signage 30 is provided near the entrance to the museum shop will be described as an example. However, multiple digital signages 30 may also be provided near the museum shop or on the travel route.

[0013] The edge PC 10 is an information processing device capable of various information processing and information transmission / reception. A plurality of cameras 10a that capture images of visitors in the museum are connected to the edge PC 10 via wired or wireless connections. The edge PC 10 and the cameras 10a may be connected via a network N. The edge PC 10 detects visitors in each spot based on image data (hereinafter referred to as captured images) captured by each camera 10a, and performs processing to determine the viewing status of the detected visitors. The edge PC 10 also transmits the determination results to the server 20 via the network N. In this embodiment, the cameras 10a are installed at positions where they can capture images of visitors not only in the exhibition area but also in the moving area and shop area. Therefore, the edge PC 10 may detect visitors in the moving area based on the captured images of the moving area and determine the status of each visitor, or may detect visitors in the shop area based on the captured images of the shop area and determine the status of each visitor. For example, in the case of a shop area, a camera 10a may be installed at a position where it can capture an image of the entrance to the shop area, and viewers entering and exiting the shop area may be detected based on the images captured by this camera 10a, and the status of each viewer may be determined. In this embodiment, one edge PC 10 performs processing based on the images captured by each camera 10a, but multiple edge PCs 10 may be installed and processing may be distributed. In this embodiment, viewers are detected based on images captured by the camera 10a. However, viewers may be detected using a distance measuring sensor that measures the distance to an object (viewer) using light such as laser light, near-infrared light, or infrared light, instead of or in addition to the camera 10a. If a distance measuring sensor is used, the distance measuring sensor is also connected to the edge PC 10.

[0014] The server 20 is an information processing device capable of various information processing and information transmission / reception, such as a server computer or a personal computer. The server 20 performs processing to set a playback schedule for videos related to each exhibit based on the viewing status of the viewer in each spot detected by the edge PC 10. The server 20 also outputs instructions to the digital signage 30 via the network N to play videos related to each exhibit according to the set playback schedule. Through the above-described processing, the information processing system of this embodiment can sequentially change the playback schedule for videos related to each exhibit depending on the viewer's viewing status of each exhibit. Therefore, by changing the playback schedule for videos viewed by the viewer after viewing an exhibit based on the viewer's viewing status corresponding to their level of interest in each exhibit, sales promotion activities that encourage purchasing at the museum shop can be realized.

[0015] 3 is a block diagram showing an example of the configuration of the edge PC 10. The edge PC 10 includes a control unit 11, a storage unit 12, a communication unit 13, a camera connection unit 14, etc., and these units are connected to each other via a bus. The control unit 11 includes one or more processors such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), or a GPU (Graphics Processing Unit). The control unit 11 executes a program 12P stored in the storage unit 12 as needed to perform information processing, control processing, etc. that the edge PC 10 should perform.

[0016] The storage unit 12 includes a RAM (Random Access Memory), a flash memory, a hard disk, an SSD (Solid State Drive), etc. The storage unit 12 stores a program 12P (program product) executed by the control unit 11 and various data. The storage unit 12 also temporarily stores data and the like generated when the control unit 11 executes the program 12P. The program 12P and various data may be written to the storage unit 12 during the manufacturing stage of the edge PC 10, or may be downloaded by the control unit 11 from another device via the communication unit 13 and stored in the storage unit 12. A part of the storage unit 12 may be another storage device connected to the edge PC 10.

[0017] The communication unit 13 is a communication module for performing processes related to wired or wireless communication, and transmits and receives information to and from other devices via the network N. The camera connection unit 14 is an interface for connecting the camera 10a, accepts input of images captured by the camera 10a, and sequentially stores the input images in, for example, the storage unit 12. The camera 10a takes images after startup or in accordance with instructions from the edge PC 10, and sequentially sends the acquired images to the edge PC 10. The camera 10a acquires images (video) at, for example, 30 or 15 frames per second.

[0018] In addition to the above-described configuration, the edge PC 10 may also include an input unit that accepts operation input by the user and sends a control signal corresponding to the operation content to the control unit 11, and a display unit such as a liquid crystal display or an organic EL display.

[0019] FIG. 4 is a block diagram showing an example configuration of the server 20. The server 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, a display unit 25, etc., which are interconnected via a bus. The control unit 21, the storage unit 22, and the communication unit 23 of the server 20 have configurations similar to those of the control unit 11, the storage unit 12, and the communication unit 13 of the edge PC 10. The storage unit 22 of the server 20 stores an exhibit DB 22a, a video DB 22b, a product DB 22c, and a camera DB 22d in addition to various programs 22P (program products) executed by the control unit 21. The exhibit DB 22a is a database that stores information about exhibits exhibited in a museum where this system is used. The video DB 22b is a database that stores information about video data associated with each exhibit. The product DB 22c is a database that stores information about products associated with each exhibit. The camera DB 22d is a database that stores information about a camera 10a installed in the museum. The exhibit DB 22a, the video DB 22b, the product DB 22c, and the camera DB 22d may be stored in another storage device connected to the server 20, or in another storage device with which the server 20 can communicate.

[0020] The input unit 24 accepts operation input by the user and sends a control signal corresponding to the operation content to the control unit 21. The display unit 25 is a liquid crystal display, an organic EL display, or the like, and displays various information in accordance with instructions from the control unit 21. The input unit 24 and the display unit 25 may be an integrated touch panel. Note that the input unit 24 and the display unit 25 are not essential, and the server 20 may be configured to accept operations via a connected computer and output information to be displayed to an external display device.

[0021] In this embodiment, the server 20 may be a multi-computer consisting of multiple computers, a virtual machine virtually constructed by software, or a cloud server. The server 20 may also include a reading unit that reads a non-transitory computer-readable portable storage medium 20a, and may use the reading unit to read the program 22P from the portable storage medium 20a and store it in the storage unit 22. The program 22P may be executed on a single computer or on multiple computers interconnected via a network N.

[0022] 5 and 6 are explanatory diagrams showing examples of record layouts of DBs 22a to 22d stored in server 20. FIG. 5A shows exhibit DB 22a, FIG. 5B shows video DB 22b, FIG. 5C shows product DB 22c, and FIG. 6 shows camera DB 22d. Exhibit DB 22a includes an exhibit ID column, an exhibit information column, an exhibition location column, a viewing location column, a video ID column, and a product ID column. The exhibit ID column stores IDs uniquely assigned to exhibits displayed in the museum. The exhibit information column, exhibition location column, and viewing location column store information about the exhibit, information about the exhibition location, and information about the viewing location, in association with the exhibit ID. The information about the exhibit includes information such as the artist and title (name) of the exhibit. The information about the exhibition location includes information indicating the location within the exhibition area. The information about the viewing location includes information indicating the spot where each exhibit can be viewed. The video ID column and the product ID column store the video ID of the video data related to the exhibit and the product ID of the product corresponding to the exhibit, in association with the exhibit ID. The video data related to the exhibit may be such that one piece of video data is associated with one exhibit, or multiple pieces of video data are associated with one exhibit, or one piece of video data is associated with multiple exhibits. Similarly, the products corresponding to the exhibits may be such that one piece of product is associated with one exhibit, or multiple products are associated with one exhibit, or one product is associated with multiple exhibits. Products corresponding to the exhibits include, for example, replicas of the exhibits, goods manufactured in connection with the exhibits, etc.

[0023] The video DB 22b includes a video ID column, a file name column, a video name column, a playback time column, and a corresponding exhibit column. The video ID column stores an ID uniquely assigned to each video (video data). The file name column, video name column, playback time column, and corresponding exhibit column store the file name of the video data, a name arbitrarily assigned to the video data (video data), playback time, and the exhibit ID of the corresponding exhibit, in association with the video ID. Note that the video data is stored, for example, in a predetermined area (video folder) in the storage unit 22, and the file name includes a folder name and file name for reading the video data from the predetermined area. Each video preferably includes video related to the corresponding exhibit, video related to a product corresponding to the exhibit, video promoting the product, etc., and is video that encourages purchasing of the product. Furthermore, the video may be a still image or a video.

[0024] The product DB 22c includes a product ID column, a product name column, a product information column, a corresponding exhibit column, and a sales history column. The product ID column stores IDs uniquely assigned to products sold at the museum shop. The product name column, product information column, and corresponding exhibit column store product names, product information, and the exhibit IDs of corresponding exhibits, in association with the product IDs. Product information includes, for example, information about the product's manufacturer and price. The sales history column stores sales history information, including the date and time the product was sold and the number of units sold, in association with the product IDs. The sales history information is obtained, for example, by the control unit 21 of the server 20 from a POS terminal (payment processing terminal) installed in the museum shop and stored in the product DB 22c.

[0025] The camera DB 22d is provided for each day the museum is open and stores each piece of information in association with the date. The camera DB 22d includes a camera ID column, a detection spot column, and a detection result column. The camera ID column stores IDs uniquely assigned to the cameras 10a installed in the museum. The detection spot column stores information indicating spots within the camera 10a's shooting area in association with the camera ID. In this embodiment, the detection spot column stores the exhibit IDs of exhibits associated with each spot. The detection result column stores information indicating the situation within each spot detected based on the images captured by the camera 10a in association with the camera ID. In this embodiment, the detection result column includes a stopping time column, a stopping state column, an attribute column, a spot state column, etc., and stores the start and end times of a visitor's stopping time within a spot, information indicating the state at the time of stopping, the visitor's attributes, information indicating the situation within the spot, etc., in association with each other. The stopped state includes, for example, a state where the distance to the exhibit is less than a predetermined distance (e.g., 2 m), a state where the distance is equal to or greater than a predetermined distance, a state where the person is staring at the exhibit, a state where the person is not looking at the exhibit, a state where the person is looking at the exhibit while looking away, a state where the person is using a wheelchair, etc. The situation within the spot includes a congestion state indicated in multiple stages, for example, crowded, slightly crowded, empty, etc. For example, a number of people according to the degree of congestion may be set for each spot, and the degree of congestion determined according to the number of viewers in the spot may be stored in the spot status column. Note that the spot status column may store information indicating the status of nearby spots in addition to information indicating the status within the spot. Each piece of information in the detection result column is stored, for example, when the control unit 21 of the server 20 detects the situation within each spot based on images captured by the camera 10 a.

[0026] The following describes the processing performed by each device in the information processing system of this embodiment. First, the processing performed by the edge PC 10 to detect the state of the viewer in each spot based on the captured images taken by each camera 10a will be described. Note that in this embodiment, the edge PC 10 executes the processing to detect the viewing state of the viewer based on the captured images, but this processing may also be executed by the server 20. In this case, the edge PC 10 executes the processing to transfer the captured images sequentially transmitted from the camera 10a to the server 20, and the following processing is executed by the server 20.

[0027] Fig. 7 is a flowchart showing an example of a viewer state detection process. In Fig. 7, the left side shows the process performed by the edge PC 10, and the right side shows the process performed by the server 20. The following process is executed by the control unit 11 in accordance with a program 12P stored in the storage unit 12 of the edge PC 10, and by the control unit 21 in accordance with a program 22P stored in the storage unit 22 of the server 20. Part of the following process may be realized by a dedicated hardware circuit.

[0028] In the information processing system of this embodiment, for example, when the museum opens, the camera 10a is activated and begins capturing images. The camera 10a captures, for example, 30 or 15 frames of images per second and sequentially outputs the captured images to the edge PC 10. The control unit 11 of the edge PC 10 sequentially captures the images captured by each camera 10a and detects whether or not a viewer is present in the captured image based on the captured images (S11). The control unit 11 determines whether or not a person (viewer) is present in the captured image by, for example, template matching. Specifically, a template representing a typical person's face or whole body image is stored in the storage unit 12 in advance, and when the control unit 11 detects an area in the captured image that matches the template, it identifies the detected area as the viewer's area. Note that by providing templates for each combination of age group and gender, when a person (viewer) is detected in the captured image, the age group and gender of the detected viewer can be identified.

[0029] The control unit 11 may also determine whether a viewer is included in a captured image using a learning model trained by machine learning. The learning model is expected to be used as a program module that functions as part of artificial intelligence software. For example, a learning model trained using an algorithm such as a convolution neural network (CNN) can be used to determine whether a viewer is present in a captured image when the captured image is input, and, if a viewer is present, output the viewer's attributes (age group and gender). In this case, the control unit 11 inputs the captured image acquired from the camera 10a into the learning model, and, based on the output information from the learning model, can identify whether a viewer is present in the captured image and, if so, the viewer's attributes. Note that the learning model here may be configured using any object detection algorithm other than CNN, such as R-CNN (Regions with CNN), Fast R-CNN, Faster R-CNN, Mask R-CNN, SSD (Single Shot Multibook Detector), or YOLO (You Only Look Once), or may be configured by combining several of these models.

[0030] FIG. 8 is an explanatory diagram showing an example of the configuration of a learning model. The learning model shown in FIG. 8 is trained to take a photographed image as input, perform calculations based on the input photographed image to determine whether or not a viewer is present in the photographed image, and if a viewer is present, to determine the viewer's attributes (age group and gender), and output the calculation results. The learning model shown in FIG. 8 has multiple output nodes, where output node 0 outputs the probability of determining that there is no viewer, output node 1 outputs the probability of determining that there is a viewer under the age of 10, output node 2 outputs the probability of determining that there is a teenage male viewer, and output node 3 outputs the probability of determining that there is a teenage female viewer. The output value of each output node is, for example, a value between 0 and 1.0, and the sum of the determination probabilities output from each output node is 1.0.

[0031] The learning model shown in FIG. 8 is generated by machine learning an untrained learning model using training data including training images and information (correct labels) indicating the attributes (age group and gender) of people in the images. When a training image is input, the learning model learns so that the output value from the output node corresponding to the attribute indicated by the correct label approaches 1.0 and the output values from other output nodes approach 0.0. In the learning process, the learning model performs calculations based on the input image and calculates output values from each output node. The learning model then compares the calculated output value of each output node with the value corresponding to the correct label (0 or 1) and optimizes parameters used in the calculation process so that each output value approximates the value corresponding to the correct label. These parameters include weights between neurons in the learning model. The parameter optimization method is not particularly limited, but examples include backpropagation, steepest descent, and the like. As a result, a learning model is obtained that, when a photographed image is input, is trained to determine whether or not a viewer is present in the photographed image and, if so, the viewer's attributes.

[0032] The learning model is learned by another learning device. The learned learning model generated by learning on the other learning device is downloaded from the learning device to the edge PC 10 via the network N or a portable storage medium, for example, and stored in the storage unit 12. Note that the learning model is not limited to the configuration shown in FIG. 8, and the number of output nodes may be the number of attributes to be determined.

[0033] If the control unit 11 of the edge PC 10 determines that a viewer cannot be detected in the captured image (S11: NO), it continues the processing of step S11 until a viewer is detected. If the control unit 11 detects a viewer in the captured image (S11: YES), it identifies the spot where the detected viewer is located (S12). That is, the control unit 11 identifies the exhibit that the viewer is viewing. For example, if the cameras 10a are fixed cameras fixed at predetermined positions, by setting the area of each spot in the image captured by each camera 10a, the control unit 11 can identify which spot the viewer is in based on the position of the viewer detected in the captured image. Also, for example, marks indicating the area or boundary of each spot may be provided on the floor of the exhibition area, and the control unit 11 may be configured to identify the area of each spot in the captured image based on the marks in the captured image.

[0034] When the control unit 11 identifies the spot where the viewer is located in the captured image, the control unit 11 stores the current time in the memory unit 12 as the detection start time of the viewer (S13). The control unit 11 performs a tracking process of the viewer based on the captured images sequentially acquired from the camera 10a capturing the viewer (S14). In the tracking process, the control unit 11 uses the captured image area of the viewer detected in the captured image as a template and repeatedly identifies the captured image area of the viewer in the next captured image. While performing the tracking process, the control unit 11 determines the state of the viewer (S15). For example, the control unit 11 determines the distance between the viewer and the exhibit that the viewer is viewing, the state in which the viewer is viewing the exhibit (viewing state), whether the viewer is using a wheelchair, etc. The distance to the exhibit can be identified based on the viewer's position in the captured image, for example, by presetting the distance to the exhibit for each position in the captured image. If a ranging sensor is installed at the location where the exhibit is displayed, the distance from the exhibit to the viewer can also be measured by the ranging sensor. The viewing state of a viewer can be determined, for example, by detecting the viewer's gaze direction based on a captured image, and based on the gaze direction, determining whether the viewer is staring at the exhibit, not looking at the exhibit, or looking away from the exhibit. Such determination of the viewer's state can also be performed using a learning model trained by machine learning. For example, a learning model trained to output information indicating whether the viewer in the captured image is in one of the above states when a captured image is input can be used. Whether the viewer is using a wheelchair can be determined, for example, using template matching or a learning model.

[0035] The control unit 11 also determines the attributes of the viewer (S16). If the control unit 11 has identified the attributes of the viewer (age group and gender) when detecting the viewer in the captured image in step S11, the identified attributes can be used. If the attributes of the viewer have not been identified in step S11, the control unit 11 identifies the attributes of the viewer in the captured image using, for example, template matching or a learning model. The control unit 11 also determines the status of the spot where the viewer is located based on the captured image (S17). For example, the control unit 11 determines the congestion status of the spot depending on the number of viewers in the spot. The control unit 11 may determine the congestion status of nearby spots in addition to the spot where the viewer is located.

[0036] The control unit 11 performs a viewer tracking process to detect whether the viewer has left the spot identified in step S12 (S18). If it is determined that the viewer has not left (S18: NO), the control unit 11 returns to the process of step S14 and repeats the processes of steps S14 to S17 until the viewer has left. If it is determined that the viewer has left the spot identified in step S12 (S18: YES), the control unit 11 determines whether the elapsed time from the detection start time stored in step S13 is equal to or longer than a predetermined time (e.g., one second) (S19). In other words, the control unit 11 determines whether the viewer has been standing in the spot identified in step S12 for equal to or longer than the predetermined time. Note that the predetermined time here can be changed for each museum, for example.

[0037] If it is determined that the viewer has been standing still for a predetermined time or longer (S19: YES), the control unit 11 transmits the detection results obtained by the above-described process to the server 20 (S20). For example, the control unit 11 transmits the detection results to the server 20 in association with information (e.g., the camera ID) of the camera 10a that captured the image from which the viewer was identified in step S11 and information about the spot identified in step S12 (e.g., the exhibit ID of the exhibit corresponding to the spot). As the detection results, the control unit 11 transmits to the server 20 the detection start time stored in the memory unit 12 in step S13, the detection end time indicating the time when the viewer left the spot, the viewer's status determined in step S15, the viewer's attributes determined in step S16, and the congestion status of the spot determined in step S17. If it is determined that the viewer has not been standing still for a predetermined time or longer (S19: NO), the control unit 11 skips the process of step S20. That is, viewers who do not stay in a spot for a predetermined time or longer are considered not to have viewed the corresponding exhibit, and are excluded from the count of viewers' stay status.

[0038] The control unit 21 of the server 20 receives the detection results transmitted from the edge PC 10 and stores the received detection results in the camera DB 22d (S21). Here, the control unit 21 associates the information about the camera 10a (camera ID) with the information about the spot (exhibit ID of the corresponding exhibit), and stores the detection start time and detection end time in the stopping time column, the viewing state of the viewer in the stopping state column, the viewer's attributes in the attribute column, and the congestion state of the spot in the spot status column. The control unit 11 of the edge PC 10 executes the processing of steps S12 to S20 described above each time a viewer is detected in an image captured by each camera 10a. Through the above processing, the presence or absence of a viewer at each spot can be detected, and for each detected viewer, information about the exhibit being viewed, information about the viewer, and information about the spot are stored in the camera DB 22d of the server 20. Note that if the detected viewer stops at the spot for less than a predetermined time, information about the viewer is not stored in the camera DB 22d. In other words, viewers who pass through the spot in less than a predetermined time are not included in the viewers viewing the exhibits.

[0039] In the above-described process, the presence or absence of a viewer, the viewer's status, attributes, etc. are determined based on the images captured by the camera 10a, but this configuration is not limited to this. For example, the determination of the presence or absence of a viewer may be based on distance data measured by a distance sensor, and the distance between the exhibit and the viewer may also be measured by a distance sensor. In addition, in the process shown in FIG. 7, the edge PC 10 detects the status of the viewer in each spot within the exhibition area, but similar processing is possible for the moving area and the shop area. That is, the edge PC 10 may detect the status of the viewer in the moving area and the shop area and the status within the area based on the images captured by the camera 10a installed in the moving area and the shop area. In this case, the detected status within the moving area and the shop area is also stored in the camera DB 22d.

[0040] Next, a process will be described in which the server 20 specifies a playback schedule for the video to be played on the digital signage 30 based on the state of the viewer in each spot detected by the edge PC 10 through the above-described process. FIGS. 9 to 12 are flowcharts showing an example of the playback schedule specification process. In FIGS. 9 and 10, the left side shows the process performed by the server 20, and the right side shows the process performed by the digital signage 30. The process of setting the scheduling target period shown in FIG. 11 corresponds to step S32 in FIG. 9, and the process of calculating the total stopping time shown in FIG. 12 corresponds to step S34 in FIG. 9. In the following process, the edge PC 10 executes the process shown in FIG. 7, and the control unit 21 of the server 20 executes the following process while storing the detection results sequentially transmitted from the edge PC 10 in the camera DB 22d. In addition, in the following processing, the standard stay time of a viewer in the exhibition area (standard viewing time), the standard travel time from the exhibition area to the shop area, and the standard stay time of a viewer in the shop area are preset and stored in memory unit 22, for example, as times expected when the museum and museum shop are not crowded.

[0041] For example, when the first viewer (first person) leaves the exhibition area after the museum opens, the control unit 21 of the server 20 starts a process to specify a playback schedule for the video to be played on the digital signage 30. Therefore, until the first viewer leaves the exhibition area, the control unit 21 may be configured not to instruct the digital signage 30 to play a video, or may be configured to instruct the digital signage 30 to play a predetermined video.

[0042] Therefore, the control unit 21 determines whether the first viewer has exited the exhibition area (S31). For example, if a route for viewing exhibits in a museum is set, the control unit 21 determines whether the first viewer has exited the spot of the last exhibit on the route. Furthermore, if an exit is provided in the exhibition area, the control unit 21 may determine whether the first viewer has passed through the exit. For example, a motion sensor may be provided to detect people passing through the exit, and when the motion sensor detects the passage of the first viewer, it may be determined that the first viewer has exited the exhibition area. Furthermore, it may be determined whether the first viewer has passed through the exit based on an image captured by a camera of the exit. In this case, the camera capturing the exit may be the camera 10a that captures any of the spots, or a camera that captures only the exit may be provided.

[0043] If it is determined that the first viewer has not left the exhibition area (S31: NO), the control unit 21 continues the processing of step S31 until it detects that the first viewer has left the exhibition area. If it is determined that the first viewer has left the exhibition area (S31: YES), the control unit 21 sets a scheduling target period (S32). In this embodiment, the video playback schedule is determined based on the viewer's viewing state, etc., and the scheduling target period refers to a period (time period) in which the viewer's stopping time, viewing state, etc. should be taken into consideration (measured).

[0044] In the scheduling target period setting process shown in FIG. 11, the control unit 21 first acquires a reference stay time in the exhibition area (S51). The control unit 21 reads out a reference stay time in the exhibition area that has been stored in advance in the storage unit 22. Note that the reference stay time in the exhibition area may be a predetermined time, or may be the time from when the first viewer enters the exhibition area to when the first viewer exits the exhibition area. In this case, the control unit 21 may read out, for example, from the camera DB 22d, the time when the first viewer enters the first exhibit spot on the route and the time when the first viewer exits the last exhibit spot on the route, and calculate the difference between the two times to determine the reference stay time. Note that the viewer who first enters the first exhibit spot may be different from the viewer who first exits the last exhibit spot.

[0045] Based on the acquired reference stay time, the control unit 21 identifies the start time and end time of the reference stay time (S52). Here, the control unit 21 identifies the current time as the end time of the reference stay time and the time preceding the current time as the start time of the reference stay time. The control unit 21 then calculates the proportion of viewers by age group who were in the exhibition area during the time period from the identified start time to the end time (S53). For example, the control unit 21 identifies viewers detected at the first spot on the route whose stopping time stored in the camera DB 22d falls within this time period. The control unit 21 considers the identified viewers to be viewers who were in the exhibition area during this time period, reads the age group of each viewer from the camera DB 22d, counts the number of viewers for each age group, and calculates the proportion of each age group. Note that the attributes of viewers who entered the exhibition area may be stored in association with the entry time. In this case, the control unit 21 may identify viewers who entered during this time period and calculate the proportion of the identified viewers by age group.

[0046] The control unit 21 also calculates the proportion of viewers who use wheelchairs among those who were in the exhibition area during this time period (S54). Here, too, the control unit 21 identifies viewers whose stopping times stored in the camera DB 22d fall within this time period, for example, among viewers detected at the first spot on the route, and identifies viewers among the identified viewers whose information indicates that they were using wheelchairs while stopping, and counts the number of identified viewers to calculate the proportion. Here, too, information indicating whether a viewer who entered the exhibition area is a wheelchair user may be stored in association with the entry time, and in this case, the control unit 21 may identify viewers who use wheelchairs among those who entered during this time period and calculate the proportion of the identified viewers.

[0047] The control unit 21 also identifies the degree of congestion in the exhibition area during this time period (S55). For example, the control unit 21 reads out the spot conditions in the detection results in which the stopping times stored in the camera DB 22d fall within this time period, and calculates the degree of congestion in the exhibition area based on the read-out spot conditions. For example, the control unit 21 may assign 2 points to a spot condition that is crowded, 1 point to a spot condition that is slightly crowded, and 0 point to a spot condition that is empty, and calculate the average score for each spot condition to determine the degree of congestion. Alternatively, for example, the control unit 21 may calculate the degree of congestion in the exhibition area based on the difference between the number of viewers who entered the exhibition area during this time period and the number of viewers who left the exhibition area.

[0048] The control unit 21 also calculates the proportion of group tourists among the visitors in the exhibition area during this time period (S56). For example, if a reading device that reads admission tickets is installed at the entrance to the museum and this reading device is connected to the server 20, the control unit 21 can acquire ticket information read by the reading device. The ticket information includes information indicating whether the admission ticket is a group ticket or an individual ticket (general visitor), and the control unit 21 can determine whether the visitors who have entered the museum are group tourists based on the ticket information read by the reading device. Therefore, the control unit 21 can calculate the proportion of group tourists in the exhibition area by calculating the ratio of the number of group tickets to the number of admission tickets read by the reading device.

[0049] The control unit 21 determines the situation within the exhibition area through the processes of steps S53 to S56, and predicts the stay time (viewing time) within the exhibition area for that time period by increasing or decreasing the standard stay time acquired in step S51 based on the calculated situation within the exhibition area (S57). For example, the control unit 21 performs a calculation to shorten the standard stay time when the age group with the highest proportion of people under 10 years old is the age group calculated in step S53. For example, the control unit 21 multiplies the standard stay time by 0.95. This is because children under 10 years old are expected to spend less time viewing each exhibit than adults. Furthermore, the control unit 21 performs a calculation to lengthen the standard stay time when the proportion of wheelchair users calculated in step S54 is equal to or greater than a predetermined value (e.g., 30% or greater). For example, the control unit 21 multiplies the standard stay time by 1.05. This is because wheelchair users are expected to spend longer time moving around the exhibition area than non-wheelchair users. The control unit 21 also performs a calculation to increase or decrease the standard stay time depending on the degree of congestion in the exhibition area calculated in step S55. For example, if the degree of congestion indicates that the exhibition area is crowded, the control unit 21 multiplies the standard stay time by 1.1 to calculate a stay time longer than the standard stay time. If the degree of congestion indicates that the exhibition area is empty, the control unit 21 multiplies the standard stay time by 0.9 to calculate a stay time shorter than the standard stay time. This is because it is believed that if the exhibition area is crowded, it will take longer to move around within the exhibition area, and if the exhibition area is empty, it will take less time to move around within the exhibition area. Furthermore, the control unit 21 performs a calculation to shorten the standard stay time if, for example, the proportion of group visitors calculated in step S56 is equal to or greater than a predetermined value (e.g., 30% or greater). For example, the control unit 21 multiplies the standard stay time by 0.95. This is because it is believed that group visitors will spend less time viewing each exhibit than individual visitors due to the set gathering time after viewing the exhibits. Furthermore, the control unit 21 performs calculations to increase or decrease the reference staying time depending on the time period.For example, for a time period immediately after opening (e.g., one hour after opening), the control unit 21 multiplies the reference stay time by 1.1 to calculate a stay time longer than the reference stay time, and for a time period immediately before closing (e.g., one hour before closing), the control unit 21 multiplies the reference stay time by 0.9 to calculate a stay time shorter than the reference stay time. This is because immediately after opening, the exhibition area is empty and visitors have plenty of time to appreciate the exhibits, so viewing time is likely to be longer, while just before closing, visitors are likely to be in a hurry and viewing time is likely to be shorter. As described above, by performing calculations to increase or decrease the stay time in the exhibition area based on the age group of visitors, the proportion of wheelchair users, the degree of congestion in the exhibition area, the proportion of group visitors, and the time of day, it is possible to weight the reference stay time according to the situation in the exhibition area and predict the stay time for that time period. Note that the calculation process described above is merely an example and is not limited to the above-described calculation process.

[0050] The control unit 21 sets the start time and end time of the scheduling period based on the predicted stay time (S58). Here, the control unit 21 sets the current time (the time identified as the end time of the reference stay time in step S52) as the end time of the scheduling period, and sets the time obtained by going back the predicted stay time from the current time as the start time of the scheduling period. As a result, in this embodiment, the scheduling period to be taken into consideration when determining the playback schedule for the video of each exhibit is determined based on the stay time of the viewer in the exhibition area. The control unit 21 then returns to the processing of FIG. 9.

[0051] Next, the control unit 21 determines the visitor's standing still state at each spot for the set scheduling period. In this embodiment, one video is associated with one or more spots, and for each video, the visitor's standing still state at the corresponding spot is tallied and a playback schedule for each video is determined based on the tallied results. Therefore, the control unit 21 first associates each video with the spot corresponding to each video. For example, the control unit 21 associates each video with the spot of the corresponding exhibit based on each video ID stored in the video DB 22b and the corresponding exhibit corresponding to each video ID. Then, the control unit 21 reads out the detection results for the spot corresponding to one video from the detection results for each spot stored in the camera DB 22d for the scheduling period (S33). Based on the read detection results, the control unit 21 calculates the total standing still time of the visitor who stood still at each spot corresponding to the video (total standing still time) (S34). 12, the control unit 21 extracts a detection result for one spot from the detection results for the spot corresponding to one video image read out in step S33 (S61). Furthermore, the control unit 21 extracts a detection result for one viewer from the detection results for one extracted spot (S62). The control unit 21 performs the following process based on the extracted detection result for one viewer.

[0052] The control unit 21 calculates the stopping time of the viewer (S63). Specifically, the control unit 21 calculates the time from the start time to the end time based on the start time and end time of the stopping time in the detection result. For example, if the start time is 10:00 and the end time is 10:05, the control unit 21 calculates the stopping time as 5 minutes. Next, the control unit 21 performs a calculation on the stopping time calculated in step S63 according to the distance from the exhibit as the stopping state of the viewer (S64). For example, the control unit 21 determines whether the distance from the exhibit is less than a predetermined distance (e.g., 2 m), and if it determines that it is less than the predetermined distance, it performs a calculation to lengthen the stopping time. If it determines that the distance from the exhibit is equal to or greater than the predetermined distance, the control unit 21 does not perform a calculation on the stopping time, or performs a calculation to shorten the stopping time. If the camera DB 22d stores the detection result that the distance to the exhibit is close or far, the control unit 21 determines whether the distance to the exhibit is close or far and performs a calculation according to the determination result. This makes it possible to weight the stopping time according to the distance between the viewer and the exhibit. For example, if a viewer is interested in an exhibit, they tend to be closer to the exhibit, so even if the stopping time is the same, a viewer who is closer to the exhibit is considered to be more interested in the exhibit. Therefore, in this embodiment, a calculation is performed to lengthen the stopping time when the distance to the exhibit is close.

[0053] Next, the control unit 21 performs a calculation on the stopping time according to the viewing state (viewing state) of the viewer (S65). For example, the control unit 21 determines whether the viewer is looking at an exhibit, and if it determines that the viewer is not looking at an exhibit, it performs a calculation to shorten the stopping time. If it determines that the viewer is looking at an exhibit, the control unit 21 does not perform a calculation on the stopping time, or performs a calculation to lengthen the stopping time. Note that the control unit 21 may perform different calculations when the viewer is not looking at an exhibit and when the viewer is looking at an exhibit while looking away. This allows the stopping time to be weighted according to the viewing state in which the viewer is viewing an exhibit. For example, if a viewer is interested in an exhibit, they tend to stare at the exhibit. Therefore, even if the viewing time is the same, a viewer who stares at an exhibit is considered to be more interested in the exhibit. Therefore, in this embodiment, if a viewer is staring at (looking at) an exhibit, it performs a calculation to lengthen the stopping time.

[0054] Next, the control unit 21 performs a calculation on the stopping time according to the viewer's age group (S66). For example, the control unit 21 determines whether the viewer is under 10 years old, and if it determines that the viewer is under 10 years old, performs a calculation to shorten the stopping time. If it determines that the viewer is not under 10 years old, the control unit 21 does not perform a calculation on the stopping time, or performs a calculation to lengthen the stopping time. The control unit 21 may be configured to assign different weights to each viewer's age group. This allows the stopping time to be weighted according to the viewer's age group. For example, if a viewer is under 10 years old, it is considered that they are less likely to purchase products at the museum shop. Therefore, in this embodiment, if the viewer is under 10 years old, a calculation to shorten the stopping time is performed. If it is possible to predict an age group that is more likely to purchase products at the museum shop, a calculation to lengthen the stopping time for that age group may be performed. If it is possible to predict an age group that is less likely to purchase products, a calculation to shorten the stopping time for that age group may be performed.

[0055] Next, the control unit 21 performs a calculation on the stopping time according to the viewer's wheelchair usage status (S67). For example, the control unit 21 determines whether the viewer is a wheelchair user, and if it is determined that the viewer is a wheelchair user, performs a calculation to lengthen the stopping time. If it is determined that the viewer is not a wheelchair user, the control unit 21 does not perform a calculation on the stopping time, or performs a calculation to shorten the stopping time. This makes it possible to weight the stopping time according to whether the viewer is a wheelchair user.

[0056] Next, the control unit 21 performs a calculation on the stopping time according to the congestion state in the spot where the viewer is present (S68). For example, the control unit 21 determines whether the spot state of the detection result indicates a crowded state, and if it determines that the spot state indicates a crowded state, performs a calculation to lengthen the stopping time. If it determines that the spot state of the detection result indicates a uncrowded state, the control unit 21 does not perform a calculation on the stopping time, or performs a calculation to shorten the stopping time. Note that if the spot state of the detection result is a numerical value indicating the degree of congestion, the control unit 21 may be configured to assign different weights to each degree of congestion. This allows the stopping time to be weighted according to the congestion state in the spot.

[0057] Next, the control unit 21 performs a calculation on the stopping time according to the time zone of the scheduling period (S69). For example, the control unit 21 determines whether the scheduling period is immediately before closing, and if it is determined that it is immediately before closing, performs a calculation to shorten the stopping time. The control unit 21 also determines whether the scheduling period is immediately after opening, and if it is determined that it is immediately after opening, does not perform a calculation on the stopping time, or performs a calculation to lengthen the stopping time. Note that the control unit 21 may be configured to assign different weights to each time zone of the scheduling period. This makes it possible to weight the stopping time according to the time zone of the scheduling period.

[0058] Next, the control unit 21 performs a calculation on the stopping time according to the characteristics of the exhibit being viewed by the viewer (S70). For example, the control unit 21 reads the characteristics of the exhibit from the exhibit information in the exhibit DB 22a and determines whether the read characteristics have a predetermined characteristic that causes the appearance to change depending on the viewing position or the elapsed time, such as a characteristic in optical illusions and trick art where what is visible changes depending on the viewing position, or a characteristic in a mechanical doll where what is visible changes over time. If the control unit 21 determines that the predetermined characteristic exists, it performs a calculation to lengthen the stopping time. If the control unit 21 determines that the predetermined characteristic does not exist, it does not perform a calculation on the stopping time, or it performs a calculation to shorten the stopping time. This allows the stopping time to be weighted according to the characteristics of the exhibit.

[0059] Furthermore, if the control unit 21 can manage whether the viewer is a group tourist or not, the control unit 21 may perform a calculation on the stopping time depending on whether the viewer is a group tourist or not. For example, if the viewer is a group tourist, the control unit 21 may perform a calculation to shorten the stopping time, and if the viewer is not a group tourist, the control unit 21 may not perform a calculation on the stopping time or may perform a calculation to lengthen the stopping time.

[0060] Through the above-described processing, the control unit 21 increases or decreases the viewing time by weighting the actual viewing time of the viewer according to the viewing state and age group, the congestion status of the viewing spot, the time of day, the characteristics of the exhibits, and the like. The viewing state (viewing state) of the viewer reflects the viewer's level of interest in the exhibits. For example, a viewer is expected to view an exhibit of high interest from close up and take time to view an exhibit of low interest, and to view an exhibit of low interest from a distance or not spend time there. Therefore, by increasing or decreasing the actual viewing time according to the viewing state that reflects the viewer's level of interest, a viewing time that reflects the viewer's level of interest can be calculated. Note that by weighting according to the viewer's age group, it is possible to calculate a viewing time that reflects, for example, whether the viewer is in an age group that contributes to increased sales at the museum shop. Furthermore, by weighting according to the congestion status of the viewing spot, the time of day, and the characteristics of the exhibits, it is possible to calculate a viewing time that reflects the viewer's viewing state according to the viewing environment and the characteristics of the exhibits. The control unit 21 is not limited to a configuration in which all calculations in steps S64 to S70 are performed for the stopping time calculated in step S63, but may be configured to perform one or more of the calculations in steps S64 to S70, and may be able to arbitrarily set which calculations to perform.

[0061] The control unit 21 calculates the cumulative total of the stopping times after the calculation (S71). Note that the control unit 21 tallies the total stopping time at the spot corresponding to each video, and therefore resets the cumulative value of the stopping time to 0 when performing the calculation process for the total stopping time for one video. The control unit 21 then calculates the cumulative value of the stopping time of each viewer at one spot by adding the stopping time of each viewer calculated in steps S64 to S70 to the cumulative value in step S71. Thus, the control unit 21 operates as a measurement unit that measures the number of viewers who stopped at one spot (one exhibit) and the stopping time of each viewer. Note that the cumulative value of the stopping time of each viewer indicates the score for that spot, and the score becomes higher the more viewers there are in the spot and the longer each viewer's stopping time. The control unit 21 determines whether there are any viewers (unprocessed viewers) for whom the calculation processing for the above-mentioned stopping time has not been performed in the detection results extracted in step S61 (S72), and if it determines that there are (S72: YES), it returns to the processing of step S62, extracts the detection result for one of the unprocessed viewers (S62), and performs the processing of steps S63 to S71 based on the detection result for the one extracted person.

[0062] If it is determined that there are no unprocessed viewers (S72: NO), the control unit 21 determines whether there are any spots (unprocessed spots) for which the above-mentioned processing has not been performed (S73) among the detection results for the spots corresponding to one video image read out in step S33. If it is determined that there are any spots (unprocessed spots) for which the above-mentioned processing has not been performed (S73: YES), the process returns to step S61. The control unit 21 then extracts the detection results for one of the unprocessed spots (S61) and performs the processes of steps S62 to S72 based on the extracted detection results. This allows the cumulative value of the total stopping time for all spots read out in step S33 to be calculated. If it is determined that there are no unprocessed spots (S73: NO), the control unit 21 returns to the process shown in FIG. 9. The cumulative value of the stopping time calculated at this point becomes the sum of the total stopping time of viewers who stopped at each spot corresponding to the video image to be processed. Note that different sizes of spots may be set depending on the type, size, display method, etc. of the exhibit. In this case, the size of the spot may be taken into consideration when calculating the total stopping time per unit area relative to the calculated total stopping time at each spot. Control unit 21 associates the total stopping time calculated in step S34 with the video ID of the video and stores them in storage unit 22 (S35). Control unit 21 determines whether there is any video (unprocessed video) for which the calculation process for the total stopping time described above has not been performed (S36), and if it determines that there is (S36: YES), returns to the process of step S33. Control unit 21 reads out the detection result for the spot corresponding to one of the unprocessed videos (S33), and performs the processes of steps S34 to S35 based on the read detection result.

[0063] The control unit 21 repeats the processing of steps S33 to S35 until it determines that there are no unprocessed images. As a result, for each spot corresponding to each image, the sum of the stopping times (total stopping time) is calculated, weighted according to the state of each viewer and the viewing environment. The total stopping time at each spot reflects each viewer's level of interest in the exhibit. Furthermore, for each image, the sum of the total stopping times at the spots corresponding to each image is calculated. Therefore, the total stopping time for each image also reflects each viewer's level of interest in the corresponding exhibit. Therefore, in this embodiment, by determining the playback time and playback order of each image based on the total stopping time of each image, each image can be played with a playback time and playback order that reflects each viewer's level of interest. Therefore, if a viewer finds an exhibit that interests them while viewing the exhibit area, the image corresponding to this exhibit is played preferentially, making it possible to present to the viewer images of exhibits that they liked or were impressed by during their viewing. By viewing videos of exhibits that visitors like or that impressed them, they are reminded of the exhibits and are more likely to purchase merchandise related to the exhibits in the museum shop. This makes it possible to carry out sales promotion activities that can increase sales in the museum shop.

[0064] If the control unit 21 determines that there are no unprocessed videos (S36: NO), it calculates the percentage of the total stopping time for each video based on the total stopping time corresponding to each video stored in the storage unit 22 in step S35 (S37). Specifically, the control unit 21 calculates the sum of the total stopping times corresponding to each video and calculates the percentage of the total stopping time for each video relative to the total stopping time. Next, the control unit 21 sorts the videos in descending order of the calculated percentage of the total stopping time, and selects a predetermined number of videos in descending order of the percentage of the total stopping time (S38). For example, the control unit 21 selects videos in descending order of the percentage of the total stopping time until the sum of the percentages of the total stopping time corresponding to each video reaches a predetermined value (e.g., 70% or 80%). In this case, videos with a small percentage of the total stopping time, i.e., videos corresponding to exhibits with a short total stopping time and low interest from the viewer, can be excluded from playback. Furthermore, if the number of videos to be played back is predetermined, the control unit 21 selects the predetermined number of videos in descending order of the proportion of the total stopping time.

[0065] Next, the control unit 21 sets the playback time for one cycle (S39). In this embodiment, for example, half the average stay time of a viewer in the shop area is set as the playback time for one cycle. Therefore, the control unit 21 reads out the standard stay time in the shop area stored in advance in the storage unit 22, calculates half the standard stay time, and sets this as the playback time for one cycle. For example, if the standard stay time in the shop area is 20 minutes, the control unit 21 sets the playback time for one cycle to 10 minutes.

[0066] In this embodiment, the shop area can be configured to detect the status of visitors, similar to the exhibition area. In this case, the stay time in the shop area can be set taking into account the status of the visitors in the shop area. The status of the visitors in the shop area can be detected, for example, by installing a camera at the entrance to the shop area and capturing images of visitors passing through the entrance and entering the shop area. For example, it is possible to detect the status of the visitors, such as their attributes (e.g., age group), whether they are wheelchair users, and environmental conditions such as the congestion level in the shop area. Therefore, when the system is configured to detect the status in the shop area, the control unit 21 may be configured to perform the processing shown in Figure 13 below instead of the processing in step S39. Note that there are no visitors in the shop area when the first visitor leaves the exhibition area. Therefore, for example, the playback time of one cycle is set based on the reference stay time in the shop area stored in the memory unit 22 for a predetermined time after the museum opens or a predetermined time after the first visitor leaves the exhibition area.

[0067] FIG. 13 is a flowchart showing another example of the procedure for setting one cycle of playback time. In steps S83 to S87 in FIG. 13, the control unit 21 performs the same processes as steps S53 to S57 in the process for setting the scheduling period shown in FIG. 11, and therefore detailed description thereof will be omitted. In the process for setting one cycle of playback time shown in FIG. 13, the control unit 21 acquires a reference stay time in the shop area pre-stored in the storage unit 22 (S81). Based on the acquired reference stay time, the control unit 21 identifies the start time and end time of the reference stay time (S82). Here, the control unit 21 identifies the current time as the end time of the reference stay time, and identifies the time preceding the current time by the reference stay time as the start time. The control unit 21 then calculates the proportion of viewers by age group who were in the shop area during the time period from the identified start time to the end time (S83).

[0068] The control unit 21 also calculates the proportion of visitors using wheelchairs among those who were in the shop area during this time period (S84). The control unit 21 also identifies the degree of congestion in the shop area during this time period (S85). If the control unit 21 can determine whether the visitors in the shop area during this time period are group tourists, it calculates the proportion of visitors who were group tourists among those who were in the shop area during this time period (S86). Whether the visitors in the shop area are group tourists can be determined, for example, based on ticket information read from their admission tickets when they enter the museum. For example, the time at which the visitors arrive at the shop area is assumed to be the time at which the reference stay time in the exhibition area and the reference travel time to the shop area have elapsed from the time of entry. Therefore, by determining whether the visitors who entered the shop area during a time period that predates the reference stay time in the exhibition area and the reference travel time to the shop area are group tourists, it is possible to determine whether the visitors in the shop area during this time period are group tourists.

[0069] The control unit 21 predicts the stay time in the shop area for a certain time period by increasing or decreasing the reference stay time acquired in step S81 based on the situation in the shop area calculated in steps S83 to S86 (S87). Step S87 can be performed in the same manner as step S57 in FIG. 11. However, in step S87, the control unit 21 may perform a calculation to lengthen the reference stay time if the proportion of group tourists calculated in step S86 is equal to or greater than a predetermined value (e.g., 30% or greater). This is because group tourists often have a set stay time in the shop area and are expected to spend longer in the shop area than individual tourists. Also in step S87, the control unit 21 performs a calculation to increase or decrease the reference stay time depending on the time period. As a result, the stay time in the shop area can be predicted according to the situation in the shop area for a certain time period by performing calculations depending on the age group of visitors in the shop area, the proportion of wheelchair users, the degree of congestion in the shop area, the proportion of group tourists, and the time period. The above-described calculation process for the duration of stay in the shop area is an example, and the calculation process is not limited to the above-described process.

[0070] The control unit 21 sets the playback time for one cycle based on the predicted stay time in the shop area (S88). Here, the control unit 21 sets the playback time for one cycle to half the predicted stay time. When performing this process, the playback time for one cycle of playing back the video of each exhibit is determined based on the viewer's stay time in the museum shop. When the process shown in FIG. 13 is executed, the control unit 21 returns to the process of FIG. 9 after processing step S88.

[0071] When the playback time for one cycle has been set, control unit 21 calculates the playback time (playable time) for each of the predetermined number of videos selected in step S38 during the playback time for one cycle (S40). For example, if the playback time for one cycle is 10 minutes and the proportions of the total stopping time calculated in step S37 for videos 1 to 5 (video names 1 to 5) selected in step S38 are 30%, 20%, 15%, 10%, and 5%, respectively, control unit 21 calculates the playable times for videos 1 to 5 as 225 seconds (600 seconds x 30 / 80), 150 seconds (600 seconds x 20 / 80), 112 seconds (600 seconds x 15 / 80), 75 seconds (600 seconds x 10 / 80), and 37 seconds (600 seconds x 5 / 80). That is, the control unit 21 calculates the ratio (playback time ratio) of the total stopping time ratio for each of the selected videos 1 to 5 based on the sum of the total stopping time ratios for each of the selected videos 1 to 5 (here, 80% = 30% + 20% + 15% + 10% + 5%), and calculates the playable time for each of the videos 1 to 5 by multiplying the calculated ratio by the playback time for one cycle.

[0072] The control unit 21 generates a playback schedule for the videos based on the playable time corresponding to each video (S41). For example, the control unit 21 takes into consideration the proportion of the total stoppage time calculated for each video in step S37, and generates a playback schedule in which video 1, which has the highest proportion of the total stoppage time, is played (playable time for video 1 / playable time for video 1) times, video 2, which has the second highest proportion of the total stoppage time, is played (playable time for video 2 / playable time for video 2) times, video 3, which has the third highest proportion of the total stoppage time, is played (playable time for video 3 / playable time for video 3) times, video 4, which has the fourth highest proportion of the total stoppage time, is played (playable time for video 4 / playable time for video 4) times, and video 5, which has the fifth highest proportion of the total stoppage time, is played (playable time for video 5 / playable time for video 5) times. The control unit 21 may also generate a playback schedule in which the playback order 1, 2, ... is assigned to the videos in descending order of the proportion of the total stoppage time, and the playback order 1, 2, ... is repeated until the playable time of each video reaches 0.

[0073] Furthermore, when multiple videos with different playback times are prepared for one video, the control unit 21 may generate a playback schedule by switching the video to be played according to the available playback time (or remaining available playback time) for each video. Specifically, if a first video with a playback time of 30 seconds and a second video with a playback time of 1 minute are prepared as video 1, and the available playback time for video 1 is 90 seconds, a playback schedule may be generated in which the second video is played first and the first video is played second. Note that the playback order of each video determined when generating the playback schedule may be set, for example, according to the proportion of total viewing time for each video, or may be configured to be arbitrarily changeable. Through the above-described processing, the control unit 21 (identification unit) can identify (switch) the playback method for playing the video of each exhibit according to the viewer's level of interest in each exhibit (total viewing time at the spot), and generate a playback schedule in accordance with the identified playback method. The playback method includes a selection method for determining which video should be selected for playback from among multiple videos corresponding to multiple exhibits, or which video should be selected for playback from multiple videos (videos with different playback times) corresponding to a single exhibit.

[0074] Next, the control unit 21 sets the travel time from the exhibition area to the shop area (S42). The travel time is used when setting the time to start video playback in the playback schedule generated in step S41. Specifically, the time when the travel time has elapsed since the time the first viewer left the exhibition area in step S31 is set as the start time of video playback. Note that here, a standard travel time pre-stored in the memory unit 22 is used. Therefore, the control unit 21 reads out the standard travel time pre-stored in the memory unit 22 and sets it as the travel time to the shop area.

[0075] The path from the exhibition area to the shop area can also be configured to detect the status of the viewer, similar to the path in the exhibition area. In this case, the travel time to the shop area can be set taking into account the status of the viewer while traveling along the path. The status of the viewer while traveling can be detected, for example, by installing a camera at the exit of the exhibition area or along the path and capturing images of the viewer leaving the exhibition area or traveling along the path. Alternatively, a camera capturing images of the viewer exiting the last spot along the route in the exhibition area can be used to detect the status of the viewer while traveling based on images of the viewer leaving the last spot. Here, too, it is possible to detect the viewer's status, such as the viewer's attributes (e.g., age group) and whether the viewer is a wheelchair user, as well as environmental conditions such as the congestion level along the path. Therefore, when the system is configured to detect the status along the path, the control unit 21 may be configured to perform the processing shown in FIG. 14 below instead of the processing in step S42. Here again, there are no viewer on the path when the first viewer exits the exhibition area. Therefore, for example, during the period from the opening of the museum until a predetermined time has elapsed, or during the period from the first viewer leaving the exhibition area until a predetermined time has elapsed, the reference travel time stored in the memory unit 22 is set as the travel time.

[0076] FIG. 14 is a flowchart showing another example of the travel time setting process. In steps S93 to S97 in FIG. 14, the control unit 21 performs the same processes as steps S53 to S57 in the scheduling period setting process shown in FIG. 11, and therefore detailed description thereof will be omitted. In the travel time setting process shown in FIG. 14, the control unit 21 acquires a reference travel time pre-stored in the storage unit 22 (S91). Based on the acquired reference travel time, the control unit 21 identifies the start time and end time of the reference travel time (S92). Here, too, the control unit 21 identifies the current time as the end time of the reference travel time, and identifies the time calculated by tracing back the reference travel time from the current time as the start time. The control unit 21 then calculates the proportion of viewers by age group who were on the travel route during the time period from the identified start time to the end time (S93).

[0077] The control unit 21 also calculates the proportion of viewers using wheelchairs who were on the route during this time period (S94). The control unit 21 also identifies the degree of congestion on the route during this time period (S95). If the control unit 21 can determine whether the viewers on the route during this time period are group tourists, it calculates the proportion of group tourists who were on the route during this time period (S96). Whether the viewers on the route during this time period are group tourists can be determined based on ticket information read from the admission ticket when the viewers enter the museum. For example, the time when the viewer arrived on the route during this time period is assumed to be the time when the standard stay time in the exhibition area has elapsed from the time of entry. Therefore, by determining whether the viewers who entered the museum during a time period preceding the standard stay time in the exhibition area are group tourists from this time period, it is possible to determine whether the viewers on the route during this time period are group tourists.

[0078] The control unit 21 predicts the travel time to the shop area for the current time period by increasing or decreasing the reference travel time acquired in step S91 based on the conditions along the travel route calculated in steps S93 to S96 (S97). Note that step S97 can be the same process as step S57 in FIG. 11. As a result, the travel time from the exhibition area to the shop area can also be predicted according to the conditions along the travel route for the current time period by performing calculations according to the age group of visitors along the travel route, the proportion of wheelchair users, the degree of congestion, the proportion of group tourists, and the time period. Note that the above-described calculation process for the travel time to the shop area is one example and is not limited to the above-described calculation process. When the process of FIG. 14 is executed, the control unit 21 sets the predicted travel time as the travel time for the current time period and returns to the process of FIG. 9.

[0079] If a travel time to the shop area is set, the control unit 21 specifies the time to start video playback according to the playback schedule generated in step S41 (S43). Here, the control unit 21 specifies the playback start time as the time when the set travel time has elapsed since the time when the first viewer left the exhibition area in step S31. The control unit 21 associates the specified playback start time with the generated playback schedule and stores them in the storage unit 22 (S44). This allows the playback schedule of the video on the digital signage 30 to be stored in association with the playback start time.

[0080] The control unit 21 (output unit) transmits to the digital signage 30 a video (video data) obtained by joining together the videos in accordance with the generated playback schedule as the video to be played from the playback start time identified in step S43 (S45). If a controller is provided to control the video playback on the digital signage 30, the control unit 21 outputs the playback start time and playback schedule (video playback instructions) to the controller. In this case, the controller stores each video and outputs each video to the digital signage 30 in the order according to the playback schedule from the playback start time, thereby allowing the video to be displayed on the digital signage 30 according to the playback schedule. The digital signage 30 may also have the function of a controller.

[0081] The digital signage 30 sequentially displays the images received from the server 20 (S46). When the operation of the digital signage 30 is controlled by a controller, the digital signage 30 sequentially displays the images received from the controller.

[0082] After processing step S45, the control unit 21 of the server 20 determines whether to end the video playback on the digital signage 30 (S47). For example, the control unit 21 determines to end the video playback on the digital signage 30 when the closing time of the museum shop has passed. The control unit 21 may also determine to end the video playback when there are no visitors in the museum or museum shop. The control unit 21 may also determine to end the video playback when a user operation via the input unit 24 instructs the server 20 to end its operation.

[0083] If it is determined that the video playback should not be ended (S47: NO), the control unit 21 determines the playback start time for the next cycle of playback time (S48). Here, the control unit 21 calculates the time when the playback time for one cycle set in step S39 has elapsed from the playback start time determined in step S43, i.e., the playback end time, and sets the calculated playback end time as the playback start time for the next cycle. The control unit 21 then returns to the process of step S32 and executes the processes of steps S32 to S45 for the playback time of the next cycle. Note that in the process for the second or subsequent cycle of playback time, in step S52 of FIG. 11, the control unit 21 determines the time obtained by going back from the playback start time determined in the most recent step S43 by the travel time set in the most recent step S42 as the end time of the reference stay time in the exhibition area, and determines the time obtained by going back from the determined end time by the reference stay time in the exhibition area as the start time. Furthermore, in step S58, control unit 21 sets the time specified as the end time of the reference stay time in the most recent step S52 as the end time of the scheduling period, and sets the time obtained by going back from the set time to the stay time predicted in the most recent step S57 as the start time of the scheduling period. Furthermore, in the process related to the playback time of one cycle from the second time onwards, in step S43, control unit 21 specifies the playback start time of the next playback time of one cycle specified in the most recent step S48 as the video playback start time in this playback schedule.

[0084] 13, the control unit 21 determines the current time as the end time of the standard stay time in the shop area, and determines the time preceding the current time in the standard stay time in the shop area as the start time. By performing the processes of steps S83 to S87 based on this standard stay time, it is possible to set the playback time of one cycle based on the stay time in the shop area predicted according to the most recent state in the shop area.

[0085] 14, the control unit 21 determines the current time as the end time of the reference travel time and determines the time preceding the current time by the reference travel time as the start time in step S92 of Fig. 14. By performing the processes of steps S93 to S97 based on such a reference travel time, it is possible to set a travel time predicted according to the state of the most recent travel route.

[0086] The control unit 21 repeats the above-described steps S32 to S48 until it determines that video playback should be terminated. When it determines that video playback should be terminated (S47: YES), it terminates the series of processes. This allows the control unit 21 to predict the length of stay within the exhibition area based on the conditions within the exhibition area (e.g., the proportion of viewers by age group, the proportion of wheelchair users, the degree of congestion, the proportion of group visitors, and the time of day), and set the scheduling period based on the predicted length of stay. Furthermore, the control unit 21 can calculate the total time spent at each spot based on the conditions within each spot (e.g., the number of people stopping, the viewing state of each viewer, the mix of people within the spot, the time of day, and the characteristics of the exhibits) for the set scheduling period. The total time spent at each spot calculated in this way is considered to reflect the viewer's level of interest in each exhibit. Therefore, by generating a playback schedule that prioritizes playback of videos related to exhibits with long total viewing times, it is possible to set a playback schedule that takes into account the viewer's behavior (viewing state) within the exhibition area. By playing videos on digital signage 30 according to this playback schedule, it is possible to increase the likelihood that viewers will recall memories of interest or excitement in the exhibits that they found interesting in the exhibition area. By reviving interest and excitement in the exhibition area through the videos played on digital signage 30, it is possible to encourage visitors to visit the museum shop, which is expected to increase the visit rate and increase the desire to make purchases at the museum shop.

[0087] Furthermore, when predicting the length of stay in the shop area based on the conditions within the shop area (e.g., the proportion of viewers by age group, the proportion of wheelchair users, the degree of congestion, the proportion of group tourists, and the time of day), the playback time for one cycle can be appropriately set based on the predicted length of stay. In this case, the playback time for one cycle can be appropriately changed based on the conditions within the shop area, making it possible to switch the playback schedule at a timing appropriate to the turnover of viewers within the shop area (entry and exit status). Furthermore, when predicting the travel time from the exhibition area to the shop area based on the conditions within the travel route (e.g., the proportion of viewers by age group, the proportion of wheelchair users, the degree of congestion, the proportion of group tourists, and the time of day), the playback start time for one cycle of playback schedule can be appropriately set based on the predicted travel time. In this case, the playback start time is determined taking into account the travel time according to the conditions within the travel route, so it is possible to start video playback according to the playback schedule set based on the viewer's conditions in the exhibition area when the viewer leaves the exhibition area and arrives at the location where the digital signage 30 is installed. Therefore, it is possible to provide the viewer with images of exhibits that interest them in the exhibition area using the digital signage 30, increasing the likelihood that they will recall memories of interest or emotions.

[0088] In this embodiment, a scheduling period is set, and a playback schedule is set according to the situation in the exhibition area during each scheduling period. Therefore, the playback schedule on the digital signage 30 is changed sequentially according to the status in the exhibition area (such as the status of the viewer), making it possible to play videos according to the viewer's level of interest during each scheduling period. This revives the viewer's memories of exhibits that interested or impressed them in the exhibition area, potentially increasing their desire to purchase related products at the museum shop. This enables video playback that stimulates purchases at the museum shop and leads to increased sales, enabling sales promotion activities. Furthermore, this embodiment can aggregate the viewer's level of interest in each exhibit during each scheduling period. Therefore, the product lineup for sale at the museum shop can be revised based on the viewer's level of interest, thereby realizing a product lineup that is in line with the viewer's level of interest. By providing a product lineup that is in line with the viewer's level of interest, lost purchasing opportunities due to stockouts of products that the viewer is highly interested in can be reduced, and the display of products that the viewer is less interested in can be avoided, enabling appropriate product display. This increases the purchasing motivation of visitors who enter the shop, increasing the product purchase rate and improving the product turnover rate (stock turnover rate) in the museum shop.

[0089] In this embodiment, in addition to determining whether a visitor is a group or an individual based on the ticket information read from the admission ticket, the system may also detect the number of visitors entering the exhibition area and determine that the visitor is a group if a sudden increase in the number of visitors is detected. If the entrance of a group is determined in this manner, the system may also detect the number of visitors exiting the exhibition area and determine that the group has left the exhibition area if a sudden increase in the number of visitors is detected. In such a case, the time from the group's entry time to its exit time may be set as a scheduling target period, and a playback schedule may be generated based on the set scheduling target period. Furthermore, by predicting the arrival time of the group in the shopping area and playing videos according to the generated playback schedule at the time the group arrives in the shopping area, sales promotion activities that contribute to sales at the museum shop can be realized. After the group leaves the exhibition area, the system returns to the process of setting the scheduling target period by performing the processes shown in FIGS. 9 to 12, and then generates a playback schedule based on the set scheduling target period.

[0090] In this embodiment, the process of setting a playback schedule according to the conditions in the exhibition area during the scheduling period is configured to be executed during the travel time from the exhibition area to the shop area. This allows video playback according to the playback schedule according to the conditions in the exhibition area during the scheduling period to start after the travel time has elapsed. Therefore, video playback can start at a time when viewers counted during the scheduling period are likely to arrive at the shop area, making it possible to provide each viewer with the video they want to watch.

[0091] In the present embodiment, each process performed by the server 20 may be locally performed by the edge PC 10 or an information processing device installed in the museum. For example, the edge PC 10 may be configured to use the results of detection of the state of the viewer in the exhibition area, etc., to perform the process performed by the server 20 in FIGS. 9 and 10 , and instruct the digital signage 30 to play video according to the generated playback schedule. Alternatively, an information processing device such as a personal computer may be communicatively connected to the edge PC 10 and the digital signage 30, and the information processing device may acquire the state of the viewer in the exhibition area, etc., detected by the edge PC 10, and use the acquired detection results to perform the process performed by the server 20 in FIGS. 9 and 10 , and instruct the digital signage 30 to play video according to the generated playback schedule.

[0092] The information processing system of this embodiment can be applied to facilities other than art galleries, museums, science museums, aquariums, botanical gardens, zoos, theme parks, and other such facilities. Interest and excitement that draw people to their attention can be obtained not only through visual stimuli, such as viewing exhibits, but also through auditory stimuli received through the ears, olfactory stimuli received through the nose, and tactile stimuli (skin sensations) received through the fingers and fingers. Therefore, the information processing system can be applied to facilities where exhibits or products that can provide these stimuli are exhibited or displayed. For example, the information processing system can be applied to facilities where different music can be listened to at different locations (spots) within the facility. In this case, instead of displaying images on the digital signage 30, music that reminds the viewer of the music can be output at the location where the digital signage 30 is installed, according to a playback schedule that corresponds to the viewer's viewing state, thereby reviving interest and excitement in the music that was enjoyed. Facilities where music can be listened to include, for example, facilities where the sounds of birdsong, rivers, waterfalls, the ocean, rain, and other water sounds can be heard.

[0093] Furthermore, the information processing system of this embodiment can be applied to a facility where different aromas can be sensed (smelled) at different locations (spots) within the facility. In this case, instead of displaying images on the digital signage 30, the aromas sensed at each spot can be reproduced at the location where the digital signage 30 is installed, according to a reproduction schedule that corresponds to the viewer's viewing state, thereby reviving interest and excitement in each aroma. Note that facilities where aromas can be sensed include, for example, food stores that sell food such as bread or coffee, where the aroma increases the desire to purchase, demonstration stores that sell dishes while demonstrating how to cook them, perfume stores, and gardens or flower shops where plants are exhibited or displayed.

[0094] Furthermore, the information processing system of this embodiment can be applied to a facility where visitors can feel different textures or textures at each location (spot) within the facility. In this case, instead of displaying images on the digital signage 30, the textures felt at each spot can be reproduced at the location where the digital signage 30 is installed according to a reproduction schedule that corresponds to the viewer's viewing state, thereby reviving interest and excitement in each texture. Examples of facilities where visitors can feel textures or textures include stores that sell clothing or bedding made from various materials, electronics retail stores where visitors can feel the breeze blowing from air conditioning equipment, and facilities where visitors can feel the natural breeze.

[0095] Even when applied to various facilities such as those described above, it is possible to encourage entry into the shopping area, stimulate purchasing desire in the shopping area, and realize sales promotion activities that lead to increased sales.

[0096] Furthermore, the information processing system of this embodiment is not limited to indoor facilities, but can also be applied to outdoor facilities such as botanical gardens, zoos, gardens, and theme parks. As long as a configuration can be established that can detect the status of visitors viewing each exhibit or display and the status of the facility, the system can be applied to any facility. Furthermore, the information processing system of this embodiment can also be applied to facilities where there is no travel distance between the exhibition area and the shopping area. For example, if the information processing system of this embodiment is applied to a retail store displaying various products, it is conceivable that videos of each product would be played on digital signage installed in the store according to a playback schedule determined based on the status of each customer in the product display area and the status of the area. Even with this configuration, customers can refresh their memories of products that they are interested in by viewing the videos on the digital signage in the store, which can prevent them from forgetting to purchase products and increase sales. Furthermore, if the videos are displayed on digital signage installed in a location where they can be viewed while waiting to pay (while waiting at the register), it can prevent customers from forgetting to purchase products and alleviate customer frustration while waiting at the register.

[0097] Furthermore, by displaying video on the digital signage 30, the information processing system of this embodiment can refresh the memories of each exhibit in viewers who have finished viewing it. This is expected to not only increase sales at the museum shop but also to influence visitors' behavior after leaving the museum. For example, by including information about affiliated museums exhibiting works related to the exhibit in a video about the exhibit, it is possible to encourage visitors to the affiliated museums, which is expected to increase the visit rate to the affiliated museums. For example, in a facility where posters of tourist destinations are displayed as exhibits, playing video about each tourist destination based on the viewer's level of interest in each poster (total time spent looking at each poster) can encourage visitors to each tourist destination, which is expected to increase the visit rate to each tourist destination. Furthermore, in a facility (such as a retail store) where furniture or electrical appliances are displayed as exhibits or displays, playing video about each exhibit or display based on the viewer's or customer's level of interest in each exhibit or display (total time spent looking at each exhibit or display) can encourage visitors to the furniture or electrical appliance store, which is expected to increase the visit rate to the store.

[0098] (Embodiment 2) This section describes an information processing system that can arbitrarily change the playback time of each video relative to the playback time of one cycle, calculated based on the total stopping time calculated for each spot. The information processing system of this embodiment can be realized by a device similar to the information processing system of the first embodiment, so a description of the configuration will be omitted.

[0099] In the information processing system of this embodiment, each device executes the same processing as in Fig. 7. Therefore, in this embodiment as well, it is possible to detect and store the status and attributes of viewers viewing each exhibit, and the status of each spot.

[0100] Fig. 15 is a flowchart showing an example of the procedure for specifying a playback schedule in the second embodiment, and Fig. 16 is an explanatory diagram showing an example screen. The process shown in Fig. 15 is the process shown in Figs. 9 and 10 with steps S101 to S105 added between steps S40 and S41. Explanations of the same steps as in Figs. 9 and 10 will be omitted. Furthermore, steps S31 to S38 in Fig. 9 and steps S42 to S48 in Fig. 10 are not shown in Fig. 15.

[0101] The control unit 21 of the server 20 of this embodiment performs the same processing as steps S31 to S40 in Fig. 9. As a result, the total stopping time at each spot is calculated for the scheduling period set in consideration of the situation in the exhibition area, and the playback time of each video is calculated based on the total stopping time at each spot. In the server 20 of this embodiment, after processing step S40, the control unit 21 displays an editing screen on the display unit 25 for editing the playback time of each video (S101). Note that if a terminal device having a display unit and an input unit is communicatively connected to the server 20, the control unit 21 may be configured to output the editing screen to the terminal device and display it on the display unit of the terminal device.

[0102] 16A shows an example of an editing screen, and the screen shown in Fig. 16A displays the current time, the playback start time and playback end time (next cycle time) for one cycle of playback schedule to be played back next on the digital signage 30, and the start time and end time of the scheduling target period (aggregation period). Note that the playback start time and playback end time for one cycle of playback schedule may be displayed as the playback start time specified in step S43 and the playback end time when one cycle of playback time has elapsed from this playback start time, or may not be displayed if not specified at this point. The start time and end time of the scheduling target period are displayed as the times set in step S32.

[0103] The editing screen also displays, in association with the names of the videos (movie titles) selected in step S38, the playback time of each video, the percentage of the total pause time for each video (calculated percentage) calculated in step S37, the ratio of the calculated percentage for each video based on the sum of the percentages of the total pause time for each video (calculated percentage), the playable time (allocated time) allocated to each video calculated in step S40 based on this ratio, and the number of plays obtained by dividing the allocated time by the playback time of the video. In this embodiment, the editing screen is configured so that the editing percentages on the editing screen, i.e., the ratio of the calculated percentage for each video based on the sum of the calculated percentages for each video, can be changed (edited). That is, the editing screen has an input field for the editing percentage corresponding to each video, and each input field displays the edit percentage calculated based on the calculated percentage for each video, or the edit percentage after editing. The editing screen also has a "Return to default value" button for instructing the user to return the currently displayed editing ratio to the editing ratio calculated based on the calculated ratio, and a decision button for instructing the user to generate a playback schedule at the currently displayed editing ratio (editing ratio after editing).

[0104] The control unit 21 determines whether or not a change (change instruction) to the editing ratio displayed on the editing screen has been accepted (S102). If it is determined that the change has been accepted (S102: YES), the control unit 21 displays the accepted change in the corresponding input field (S103). FIG. 16B shows an example of the screen after editing. In the example shown in FIG. 16B, the editing ratio for the video with video name 1 has been changed to 60%, and the editing ratio for the video with video name 2 has been changed to 40%. Next, the control unit 21 calculates the allocated time and number of plays for each video based on the edit ratio changed in accordance with the accepted change, and displays the calculated allocated time and number of plays in the respective display fields (S104). This updates the allocated time and number of plays for each video displayed on the editing screen. If it is determined that the change to the editing ratio has not been accepted (S102: NO), the control unit 21 skips the processing of steps S103 to S104. Here, when the "return to default value" button on the editing screen is operated, the control unit 21 returns the editing ratio displayed on the editing screen to the editing ratio calculated based on the calculated ratio and updates the editing screen.

[0105] The control unit 21 determines whether the Enter button on the editing screen has been operated (S105). If it determines that the Enter button on the editing screen has not been operated (S105: NO), the control unit 21 returns to the process of step S102 and continues accepting changes to the editing ratio displayed on the editing screen. If it determines that the Enter button on the editing screen has been operated (S105: YES), the control unit 21 proceeds to the process of step S41 and generates a video playback schedule based on the allocated time and playback count for each video changed via the editing screen (S41). Here, since the playback count for each video has been determined, for example, the control unit 21 assigns a playback order of 1, 2, ... to the video with the most playback counts, and generates a playback schedule in which the playback order of 1, 2, ... is repeated until the playback count for each video reaches 0. For example, in the example shown in FIG. 16B, the control unit 21 generates a playback schedule in which the videos are arranged in the order of video names 1, 2, 1, 2, 1, 1, 1, 1. The playback order of each video may also be set taking into consideration the playback time of each video, and for example, for the example shown in Fig. 16B, control unit 21 may generate a playback schedule in which each video is arranged in the order of video names 1, 1, 2, 1, 1, 2, 1, 1. Thereafter, control unit 21 executes the processes from step S42 onwards.

[0106] The above-described process allows a playback schedule for each exhibit to be generated based on the viewer's status with respect to each exhibit, the exhibit area, the route of movement, and the status within the shop area, and also allows the allocated time and number of playbacks of each video to be customized as desired. Note that in this embodiment, the calculated ratio and edited ratio on the editing screen can be used to indicate the viewer's level of interest in the exhibit corresponding to each video, so that the viewer's level of interest can be taken into consideration when customizing the allocated time and number of playbacks of each video.

[0107] In the above-described process, the allocated time and number of plays for each video can be manually customized. In addition to this configuration, the server 20 may be configured to automatically change the allocated time and number of plays for each video. For example, if a video is old, if the product included in the video is out of stock, or if a malfunction occurs in the video and the video cannot be played, a change value of 0 can be registered in advance as the editing ratio for the video. In this case, the control unit 21 of the server 20 can accept changes to the editing ratio allocated to the video by reading the change value registered in advance for the video in step S102 of FIG. 15. Note that an old video may be, for example, if the sales period for the product or service advertised in the video has passed, or if the campaign period announced in the video has passed. Such videos and videos in which the advertised product is out of stock will not be effective in promoting sales through video playback. Therefore, by automatically changing the playback time (allocated time) allocated to such videos to 0, the videos can be excluded from playback and inappropriate videos can be avoided from being displayed.

[0108] On the other hand, for products for which sales promotion activities should be concentrated by increasing the number of times the video is played, a large number or a percentage to be added to the calculated editing percentage is registered in advance as a modification value as the editing percentage for the video. In this case, the control unit 21 of the server 20 reads the modification value registered in advance for the video in step S102 of Fig. 15, thereby accepting modifications to the editing percentage assigned to the video, and can increase the playback time and number of playbacks assigned to the video in accordance with the accepted modifications. In this way, by increasing the playback time and number of playbacks assigned to the video promoting the product, it is possible to implement effective sales promotion activities for the product to be promoted.

[0109] In this embodiment, the same effects as those of the first embodiment described above can be obtained. Furthermore, in this embodiment, the playback time and number of times of playback of each video can be changed as desired, so that the playback time and number of times of playback of the video can be customized depending on the products (exhibits) that require sales promotion activities and the products (exhibits) that do not. This makes it possible to carry out more effective sales promotion activities. In this embodiment, the modifications described in the first embodiment as appropriate can also be applied.

[0110] (Embodiment 3) This section describes an information processing system that can arbitrarily change the playback order or number of playbacks of each video for the generated playback schedule. The information processing system of this embodiment can be realized using the same devices as the information processing system of embodiment 1, so a description of the configuration will be omitted. In the information processing system of this embodiment, each device also executes the same processing as in FIG. 7. Therefore, in this embodiment as well, it is possible to detect and store the status and attributes of viewers viewing each exhibit, and the status of each spot.

[0111] Fig. 17 is a flowchart showing an example of the processing procedure for specifying a playback schedule according to the third embodiment, and Fig. 18 is an explanatory diagram showing an example screen. The processing shown in Fig. 17 is obtained by adding steps S111 to S114 between steps S43 and S44 in the processing shown in Figs. 9 and 10. Explanations of the same steps as in Figs. 9 and 10 will be omitted. Also, in Fig. 17, the steps in Fig. 9 and steps S47 to S48 in Fig. 10 are omitted from illustration.

[0112] 9 and 10. As a result, a playback schedule is generated that takes into consideration the state of the viewer, the exhibition area, the route of movement, and the situation within the shop area. In the server 20 of this embodiment, after processing step S43, the control unit 21 displays a schedule editing screen for editing the playback schedule on the display unit 25 (S111). Here too, when a terminal device having a display unit and an input unit is communicably connected to the server 20, the control unit 21 may output the schedule editing screen to the terminal device and display it on the display unit of the terminal device.

[0113] FIG. 18A shows an example of a schedule editing screen. The screen shown in FIG. 18A displays the current time, the next cycle time, and the aggregation period, similar to the editing screen shown in FIG. 16A. The schedule editing screen also displays the playback duration of each video and the playback time (playback start time and playback end time) of each video, in association with the video name of the video to be played, according to the playback schedule generated in step S41. The schedule editing screen is configured to allow the playback order of each video to be played to be changed. For example, as shown by the outline arrow in FIG. 18A, when an instruction is given to move the video with video name 2, which is scheduled to be played third, to second place (e.g., a drag operation indicated by the arrow in FIG. 18A), the control unit 21 performs processing to swap the video that is second and third in the playback order. The schedule editing screen also has a "return to default" button for giving an instruction to return to the display of the playback schedule generated in step S41, and a confirmation button for confirming the currently displayed playback schedule.

[0114] The control unit 21 determines whether a change (change instruction) to the playback order has been received via the schedule editing screen (S112). If it is determined that the change has been received (S112: YES), the control unit 21 changes the playback order in accordance with the received change and displays the changed playback order (S113). FIG. 18B shows an example of the screen after editing. When a change to move the video with video name 2, which is third in the playback order, to second place as shown in FIG. 18A is received, the control unit 21 swaps the second and third videos in the playback order as shown in FIG. 18B and displays information about each video in the swapped playback order. At this time, the control unit 21 recalculates the playback times (playback start time and playback end time) of the swapped videos and updates the playback times displayed on the schedule editing screen. This updates the playback schedule displayed on the schedule editing screen. If it is determined that the change to the playback order has not been received (S112: NO), the control unit 21 skips the processing of step S113.

[0115] The control unit 21 determines whether the Enter button on the schedule editing screen has been operated (S114), and if it determines that it has not been operated (S114: NO), the process returns to step S112 and continues accepting changes to the playback order. If it determines that the Enter button on the schedule editing screen has been operated (S114: YES), the control unit 21 proceeds to step S44 and associates the playback start time identified in step S43 with the playback schedule changed via the schedule editing screen and stores them in the storage unit 22 (S44). This makes it possible to set a playback schedule in which the playback order has been arbitrarily changed.

[0116] The above-described process allows a playback schedule for videos relating to each exhibit to be generated in accordance with the viewer's status with respect to each exhibit, the exhibit area, the route of movement, and the status within the shop area, and also allows the playback order of each video to be customized as desired. This allows the playback order of each video to be changed within a range of playback times according to the viewer's level of interest in each exhibit, making it possible to set a playback schedule for more effective sales promotion activities.

[0117] In the above-described processing, the playback schedule set according to the viewer's level of interest, etc., may be configured to change the number of times each video is played, in addition to changing the playback order of each video. FIG. 19 is an explanatory diagram showing another example of a schedule editing screen. The screen shown in FIG. 19A has a configuration similar to that of the screen shown in FIG. 18A. The screen shown in FIG. 19A is configured so that, when a predetermined operation (e.g., right-clicking the mouse) is performed on a display field displaying information about any video, an operation menu for changing the number of times the video in the selected display field is played is displayed. In the example shown in FIG. 19A, the video second in the playback order is selected, and an operation menu is displayed that includes a "Delete" button for stopping playback of this video and a "Make a Copy" button for adding one more playback of this video. When the "Delete" button on the operation menu is operated on this screen, the control unit 21 of the server 20 deletes information about the selected video from the playback schedule and sequentially moves up the playback order of videos that are later in the playback order than the deleted video. At this time, the control unit 21 recalculates the playback times (playback start time and playback end time) of each video to be moved up in the playback order, and displays them on the schedule editing screen.

[0118] Furthermore, when the "Make a copy" button on the operation menu is operated, the control unit 21 of the server 20 generates a copy of the information of the selected video and inserts it into the playback order after the selected video. At this time, the control unit 21 moves the playback order of the videos that are later in the playback order than the inserted video down one by one. At this time, the control unit 21 also recalculates the playback time (playback start time and playback end time) of each video that is moved down in the playback order and displays it on the schedule editing screen. On the screen shown in FIG. 19A, when the "Make a copy" button is selected for the video that is second in the playback order, the information of the video that is second in the playback order is copied to the third position in the playback order, and the information of each video that was originally third or later in the playback order is displayed in the fourth or later positions in the playback order, as shown in FIG. 19B. 19B, the playback time for one cycle is from 13:05 to 13:15, so the ninth video in the playback order exceeds the playback time for one cycle, and a line separates the eighth and ninth videos in the playback order, clearly indicating that these are videos that exceed the playback time for one cycle. A user editing the playback schedule can change the playback order of each video within the playback time of one cycle, and can also increase or decrease the number of times each video is played, allowing the user to set a customized playback schedule.

[0119] In this embodiment, the same effects as those of the first and second embodiments described above can be obtained. Furthermore, in this embodiment, the playback schedule set according to the viewer's level of interest in each exhibit can be changed as desired, so the playback order and number of playback times of videos can be customized according to products (exhibits) that require sales promotion activities and products (exhibits) that do not. This makes it possible to carry out more effective sales promotion activities. The configuration of this embodiment can be applied to the information processing systems of the first and second embodiments described above, and similar effects can be obtained even when applied to the information processing systems of the first and second embodiments. Furthermore, the modified examples described in each of the above embodiments can also be applied to this embodiment as appropriate.

[0120] (Embodiment 4) In the above-described first to third embodiments, videos related to each exhibit are played according to a playback schedule set based on the viewer's level of interest in each exhibit, thereby encouraging purchases at the museum shop that the viewer stops by after viewing the exhibits. In this embodiment, an information processing system is described that reviews the video playback schedule based on the video playback schedule on digital signage 30 and sales (items purchased by the viewer) at the museum shop when videos are played according to each playback schedule. The information processing system of this embodiment can be realized using a device similar to the information processing system of embodiment 1, so a description of the configuration will be omitted.

[0121] In the information processing system of this embodiment, each device also executes the same processing as in Figures 7 and 9 to 12. Therefore, in this embodiment as well, it is possible to detect the state and attributes of the viewers viewing each exhibit and the status of each spot, and to set a playback schedule for the video to be played on the digital signage 30 according to the detected content.

[0122] FIG. 20 is a flowchart showing an example of a playback schedule recommendation process. The control unit 21 of the server 20 of this embodiment identifies the playback time of one cycle in order from the start of video playback by the digital signage 30 (S121). The playback time here is the playback start time of one cycle of video stored in the storage unit 22 in step S44 of FIG. 10. Note that, in addition to the playback start time, the control unit 21 may also identify the time when one cycle of playback time has elapsed from the playback start time (playback end time) as the playback time of one cycle. The control unit 21 acquires the playback schedule for the identified playback time (S122). Here, the control unit 21 reads out the playback schedule stored in the storage unit 22 in association with the playback start time in step S44. Note that the control unit 21 may also acquire the playable time (allocated time) allocated to each video included in the playback schedule.

[0123] Next, the control unit 21 acquires sales information of the museum shop for the playback time (the time from the playback start time to the playback end time) identified in step S121 (S123). Here, the control unit 21 reads out the products sold during the time period from the playback start time to the playback end time and the number of products sold (sales number) from the sales history of each product stored in the product DB 22c. The control unit 21 identifies a predetermined number of products in descending order of sales number based on the sales number of each product acquired in step S123 (S124). For example, the control unit 21 identifies a number of products that is approximately the same as the number of videos included in the playback schedule acquired in step S122.

[0124] The control unit 21 determines whether the playback order of each video included in the playback schedule matches the order of the sales numbers of each product identified in step S124 (S125). For example, the control unit 21 determines whether the order of the sales numbers of products (products corresponding to exhibits) corresponding to the videos with playback orders of 1, 2, etc. is 1, 2, etc. Note that, if the control unit 21 has acquired the playback time (allocated time) allocated to each video included in the playback schedule, it may determine whether the proportion of time of each video matches the order of the sales numbers of each product. For example, the control unit 21 determines whether the order of the sales numbers of the product (product corresponding to exhibits) corresponding to the video with the longest proportion of time is first. The control unit 21 also determines whether the order of the sales numbers of the product corresponding to the video with the second longest proportion of time is second. In this case, the control unit 21 can determine whether the order of the sales numbers of products corresponding to the videos with longest allocated time is 1, 2, etc.

[0125] If the control unit 21 determines that the playback order or the allocated time of each video does not match the order of the sales numbers of the corresponding products (S125: NO), it generates recommendation information for the playback order or the number of playbacks (allocated time) of the videos included in the playback schedule (S126). For example, for an exhibit in which a video is played later and the sales number of the corresponding product is high, the control unit 21 generates recommendation information to move the playback order of the video in question earlier. For example, the control unit 21 generates recommendation information such as "move the playback order of the video with video name 1 forward." Furthermore, for an exhibit in which a video is played earlier and the sales number of the corresponding product is low, the control unit 21 may generate recommendation information to move the playback order of the video in question later. Furthermore, in order to advertise a product with low sales numbers, the control unit 21 may generate recommendation information to move the playback order of the video corresponding to the product with low sales numbers forward. In addition, in order to further increase sales of products with high sales volumes, recommendation information may be generated that moves the playback order of videos corresponding to products with high sales volumes to an earlier position, and if it is determined that products with high sales volumes do not need to be advertised, recommendation information may be generated that moves the playback order of videos corresponding to products with high sales volumes to a later position.

[0126] Furthermore, the control unit 21 may generate recommendation information for increasing the allocated time (number of plays) for a video of an exhibit with a short video time allotted and a high number of corresponding product sales. For example, the control unit 21 may generate recommendation information such as "Increase the allocated time for video with video name 1." Furthermore, for an exhibit with a long video time allotted and a low number of corresponding product sales, the control unit 21 may generate recommendation information for decreasing the allocated time for the video. Furthermore, in order to promote a product with a low number of sales, the control unit 21 may generate recommendation information for increasing the allocated time for a video corresponding to a product with a low number of sales. Furthermore, in order to further increase sales of a product with a high number of sales, the control unit 21 may generate recommendation information for increasing the allocated time for a video corresponding to a product with a high number of sales. If it is determined that a product with a high number of sales does not need to be promoted, the control unit 21 may generate recommendation information for decreasing the allocated time for a video corresponding to a product with a high number of sales. By registering rules for generating recommendation information such as those described above in the storage unit 22 in advance, the control unit 21 can automatically generate recommendation information for the playback order or allocated time for each video in accordance with the rules. The control unit 21 stores the generated recommendation information in the storage unit 22 in association with the playback times of one cycle identified in step S121. If it is determined that the playback order or the allocated time of each video matches the order of the sales numbers of the corresponding products (S125: YES), the control unit 21 skips the processing of step S126.

[0127] The control unit 21 determines whether the above-described processing has been completed for all one cycle of playback schedules until the museum shop closes (S127). If it determines that the processing has not been completed (S127: NO), the control unit 21 returns to the processing of step S121. The control unit 21 then specifies the playback times (playback start time and playback end time) for the next cycle (S121) and repeats the processing of steps S122 to S126 for the specified playback times. As a result, recommendation information is generated that recommends changing the playback order or the number of playbacks of each video for each cycle of playback schedule. If the control unit 21 determines that the processing has been completed for all one cycle of playback schedules (S127: YES), the control unit 21 displays a recommendation screen (not shown) on the display unit 25 that displays the recommendation information generated in step S126 in association with each playback schedule (S128). The control unit 21 may generate recommendation information for each time period obtained by dividing the time from museum opening to closing into multiple periods, based on the recommendation information for each playback schedule. In this case, recommendation information can be presented for multiple time periods, such as the time period from opening to 12:00, the time period from 12:00 to 15:00, and the time period from 15:00 to closing, and recommendation information can also be presented taking time periods into consideration.

[0128] The above-described process can recommend changes to the playback order or number of playbacks of each video, based on the playback schedule set according to the viewer's interest in each exhibit, depending on the sales of products by viewers who are likely to have viewed the videos played according to the playback schedule. This provides an opportunity to review the playback order or number of playbacks of each video included in the playback schedule based on the sales of each product, and the amount of correction to be made to the playback order or number of playbacks of each video when generating a playback schedule in the future can be registered. For example, a correction amount can be registered, such as changing the playback order of the video with video name 1 to first or second, or moving it forward or backward by a predetermined number (e.g., one or two). Furthermore, a correction value can be registered, such as setting the allocated time of the video with video name 1 to a predetermined value (e.g., 60% or 10%), or adding or subtracting a predetermined number (e.g., 10%). In this case, for example, in step S102 in Fig. 15 or step S112 in Fig. 17, the control unit 21 can acquire the correction amount of the playback order or the number of playback times (allocated time) registered for each video as the change content of the playback order or the number of playback times for each video in the playback schedule. Therefore, the playback order or the number of playback times for each video can be determined when generating a subsequent playback schedule, taking into account the playback order or the number of playback times set for each video according to the sales of each product. This makes it possible to set a playback schedule that takes into account the sales situation when each video is displayed and realizes sales promotion activities that are more effective in increasing sales.

[0129] In this embodiment, the server 20 may be configured to determine the movement of viewers in the shop area as a result of the video playback based on the playback schedule of the video played on the digital signage 30 and the viewer's behavior (flow) in the shop area after the video playback according to this playback schedule. The movement of each viewer in the shop area can also be determined based on captured images of the shop area. For example, if a playback schedule with a high playback rate of the video "Video Name 1" is played and many viewers head directly to the display shelves of products related to the video "Video Name 1" after entering the store, it can be determined that sales of products related to the video with a high playback rate are likely to increase. Therefore, by predicting the video with a high playback rate, i.e., video related to exhibits that are of high interest to viewers, and changing the product layout in the shop area, such as by displaying products related to the predicted video in a location that is easy to find from the entrance to the shop area or by creating an easy-to-find path from the entrance to the products, further sales can be expected. Therefore, by predicting the level of interest of visitors to the corresponding exhibits for each product displayed in the shop area and reflecting this in future product lineups and display locations (shelf allocation), it is possible to expect an increase in sales.

[0130] This embodiment achieves the same effects as the above-described embodiments. Furthermore, this embodiment can recommend changes to the playback order or number of playbacks of each video for each playback schedule cycle, depending on the sales of the museum shop during the time period in which the videos are played in this playback schedule. Therefore, it is possible to review the playback order or number of playbacks of each video in each playback schedule, taking into account the content of the recommendation. This allows changes to be made to the playback schedule, which is set based on the viewer's interest in each exhibit, taking into account sales in the shop area. Therefore, it is possible to set a playback schedule that allows for more effective sales promotion activities. The configuration of this embodiment can be applied to the information processing systems of the above-described embodiments 1 to 3, and similar effects can be achieved even when applied to the information processing systems of the above-described embodiments 1 to 3. Furthermore, the modifications described in the above-described embodiments can also be applied to this embodiment, as appropriate.

[0131] In this embodiment, displaying videos on the digital signage 30 is expected to increase sales at the museum shop. Therefore, further sales increases can be expected by changing the playback order or number of playbacks of each video in the playback schedule in accordance with sales at the museum shop. In each of the above-described embodiments, displaying videos on the digital signage 30 can also be expected to predict the behavior of viewers after they leave the museum. Therefore, it is possible to reflect the behavior of viewers after they leave the museum in the playback schedule by changing the playback order or number of playbacks of each video in the playback schedule in accordance with whether or not the expected behavior of the viewers has been performed. In addition, the playback order or number of playbacks of each video in the playback schedule can be changed in accordance with parameters corresponding to the behavior of the viewers after they leave the museum.

[0132] For example, in a configuration in which information about affiliated museums is included in videos about exhibits to encourage visits to those museums, the playback order or number of times each video in the playback schedule is changed depending on a parameter indicating whether the viewer has visited the affiliated museum. In this case, by collecting the time each viewer arrived at the shop area and information indicating their visit to the affiliated museum, playback schedules that the viewer is likely to have viewed can be associated with their visit to the affiliated museum. Note that the time each viewer arrived at the shop area and their visit to the affiliated museum can be collected, for example, through a survey of the viewer. Thus, the behavior of viewers who visit affiliated museums after leaving the exhibition can be reflected in the playback schedule. With this configuration, it is possible to generate a playback schedule that can increase the rate of visits to affiliated museums.

[0133] For example, in a facility where posters of tourist attractions are displayed as exhibits, information about the tourist attractions may be included in the videos related to the posters to encourage visitors to visit the tourist attractions. The playback order or number of times each video is played in the playback schedule may be changed depending on a parameter indicating whether or not the visitor has visited the tourist attractions. In this case, by collecting the time each viewer viewed the video played on the digital signage 30 and information indicating their visit to the tourist attractions, playback schedules that each viewer is likely to have viewed can be associated with their visit to the tourist attractions. Again, the time each viewer viewed the video and their visit to the tourist attractions can be collected, for example, through a survey of the viewer. Therefore, the behavior of viewers who visited the tourist attractions after leaving the facility can be reflected in the playback schedule. This configuration makes it possible to generate a playback schedule that can increase the visit rate of tourist attractions related to the exhibits.

[0134] For example, in a facility where furniture or electrical appliances are exhibited or displayed, videos related to each exhibit or display may include information about the furniture or electrical appliance retailer to encourage visitors to visit the retailer. The playback order or number of times each video is played in the playback schedule may be changed depending on a parameter indicating whether the visitor visited the retailer. In this case, by collecting the time each viewer viewed a video played on the digital signage 30 and information indicating their visit to the retailer, playback schedules that each viewer is likely to have viewed can be associated with their visit to the retailer. Again, the time each viewer viewed a video and their visit to the retailer can be collected, for example, through a survey of the viewer. Furthermore, the system may be configured to cooperate with the retailer to acquire information about each viewer's visit to the retailer or the products purchased at the retailer. Therefore, the behavior of viewers who visited the retailer after leaving the facility can be reflected in the playback schedule. With this configuration, it is possible to generate a playback schedule that increases the visit rate to retailers related to the exhibits or displays.

[0135] Furthermore, one expected behavior of viewers after leaving the museum is, for example, sharing exhibits on social networking services (SNS). Therefore, for example, a video of an exhibit may be configured to include information requesting the viewer to share the exhibit on social networking services, encouraging the viewer to share the exhibit on social networking services. In this case, the playback order or number of videos in the playback schedule may be changed depending on a parameter indicating whether the viewer shared the exhibit on social networking services. In this case, by collecting the time each viewer viewed the video on the digital signage 30 and information indicating that the viewer shared the exhibit on social networking services, playback schedules that each viewer is likely to have viewed can be associated with the viewer's sharing of the exhibit on social networking services. Therefore, the behavior of viewers who shared exhibits on social networking services after leaving the museum can be reflected in the playback schedule. With this configuration, it is possible to generate a playback schedule that can increase the rate at which exhibits are shared on social networking services.

[0136] For example, a video of an exhibit may include information requesting the viewer to register as a member for the museum's services, encouraging the viewer to register. In this case, the playback order or number of times each video is played in the playback schedule may be changed depending on a parameter indicating whether the viewer has registered as a member. In this case, by collecting the time each viewer viewed a video on digital signage 30 and information indicating their membership registration, it is possible to associate the playback schedule that each viewer is likely to have viewed with their membership registration. Therefore, the behavior of viewers who register as members for the museum's services after leaving the museum can be reflected in the playback schedule. With this configuration, it is possible to generate a playback schedule that can increase the membership registration rate for the service.

[0137] For example, a video of an exhibit may include information requesting the installation of a museum-provided application on the user's device, prompting the user to install the application. In this case, the playback order or number of playbacks of each video in the playback schedule may be changed depending on a parameter indicating whether the viewer has installed the application. In this case, by collecting the time each viewer viewed the video on the digital signage 30 and information indicating whether the viewer has installed the application, playback schedules that each viewer is likely to have viewed can be associated with the installation of the application. Therefore, the behavior of viewers who installed an application for a service provided by the museum after leaving the museum can be reflected in the playback schedule. With this configuration, it is possible to generate a playback schedule that can increase the installation rate of museum-provided applications.

[0138] (Embodiment 5) An information processing system is described below that detects the viewing status of viewers viewing video on a digital signage 30 and revises the video playback schedule based on the viewers' viewing status. The information processing system of this embodiment can be implemented using the same devices as the information processing system of the first embodiment, and therefore a description of the configuration is omitted. In the information processing system of this embodiment, an area where the video played on the digital signage 30 can be viewed is designated as a spot, and a camera 10a is provided to capture this area. Therefore, the server 20 executes the process shown in FIG. 7 based on image data captured by the camera 10a of the viewing area of the digital signage 30, thereby detecting the presence or absence of viewers in the viewing area of the digital signage 30 and detecting the status of each detected viewer. Therefore, in this embodiment, information on the digital signage 30 where each viewer is viewing video, information on the viewer, and information on the viewing area are stored in the camera DB 22d. In this embodiment, multiple digital signages 30 may be installed, and a viewing area is set for each digital signage 30.

[0139] Fig. 21 is an explanatory diagram showing an example of the configuration of the camera DB 22d of the fifth embodiment. In addition to the configuration shown in Fig. 6, the camera DB 22d shown in Fig. 21 stores the status of viewers in a viewing area detected using the viewing area of the digital signage 30 as a detection spot, and the congestion status of the viewing area. Specifically, the camera DB 22d stores information such as the stopping time, stopping status, attributes, and congestion status of viewers in the viewing area, in association with information (camera ID) of the camera 10a and information (e.g., signage ID) of the digital signage 30.

[0140] In the information processing system of this embodiment, each device also executes the same processes as those in Figures 9 to 12. Therefore, in this embodiment as well, it is possible to set a playback schedule for the video to be played on the digital signage 30 according to the status and attributes of the viewers viewing each exhibit and the situation of each spot.

[0141] 22 is a flowchart showing another example of the playback schedule recommendation process. The control unit 21 of the server 20 of this embodiment identifies the playback times of one cycle in order from the start of video playback on the digital signage 30 (S131), and acquires the playback schedule for the identified playback times (S132). The processes of steps S131 to S132 are the same as the processes of steps S121 to S122 in FIG. 20. Next, the control unit 21 acquires detection results for the viewing area at the playback times (the time from the playback start time to the playback end time) of each video included in the playback schedule acquired in step S132 (S133). Here, the control unit 21 reads out detection results for viewers whose stopping time is included in the playback times of each video from the detection results for the viewing area stored in the camera DB 22d.

[0142] Based on the acquired detection results, the control unit 21 calculates the sum of the stopping times (total stopping time) of the viewers who stopped in the viewing area at the playback time of each video (S134). The processing of step S134 can use the calculation processing of the total stopping time shown in FIG. 12. Note that in step S64 in FIG. 12, the control unit 21 weights the stopping time according to the distance between the viewer and the digital signage 30. Also, in step S134, the processing of step S70 in FIG. 12 does not have to be executed. This makes it possible to calculate the total stopping time corresponding to each video included in the playback schedule acquired in step S132, and the total stopping time can represent the viewer's (audience's) level of interest in each video.

[0143] Based on the total stopping time for each video calculated in step S134, the control unit 21 rearranges the videos in descending order of total stopping time (S135). For the same video included in the playback schedule, the average total stopping time at each playback time is calculated, and the videos are rearranged in descending order of average value. The control unit 21 then determines whether the playback ratio (proportion of the allocated playback time) of each video included in the playback schedule matches the order of the videos rearranged in descending order of total stopping time (S136). For example, the control unit 21 determines whether the total stopping time for the video with the highest playback ratio is the longest. The control unit 21 also determines whether the total stopping time for the video with the second highest playback ratio is the second longest. In this case, the control unit 21 can determine whether the total stopping times corresponding to the videos No. 1, No. 2, etc., in descending order of playable time (allocated time), are the first, second, etc.

[0144] When the control unit 21 determines that the playback ratio of each video does not match the order of the videos sorted in descending order of total pause time (S136: NO), it generates recommendation information for the playback ratio of the video included in the playback schedule (S137). For example, for a video with a high playback ratio but a short total pause time, the control unit 21 generates recommendation information including a correction value that reduces the playback ratio of the video. Also, for a video with a low playback ratio but a long total pause time, the control unit 21 generates recommendation information including a correction value that increases the playback ratio of the video. That is, the control unit 21 calculates a correction amount for correcting the playback ratio of each video depending on the viewing state of the viewer watching the video. Note that the correction value for the playback ratio of each video is not limited to the above example. The control unit 21 stores the generated recommendation information in the storage unit 22 in association with the playback time of one cycle identified in step S131. If it is determined that the playback ratio of each video matches the order of the total stop time (S136: YES), the control unit 21 skips the process of step S137.

[0145] The control unit 21 determines whether the above-described processing has been completed for all one cycle of playback schedules until the museum shop closes (S138). If it is determined that the processing has not been completed (S138: NO), the control unit 21 returns to the processing of step S131. The control unit 21 then specifies the playback time (playback start time and playback end time) for the next cycle (S131) and repeats the processing of steps S132 to S137 for the specified playback time. As a result, recommendation information recommending a change in the playback ratio of each video for each one cycle of playback schedule is generated. If the control unit 21 determines that the processing has been completed for all one cycle of playback schedules (S138: YES), the control unit 21 displays a recommendation screen (not shown) on the display unit 25, which displays the recommendation information generated in step S137 in association with each playback schedule (S139). Note that the control unit 21 may generate recommendation information for each time period obtained by dividing the time from the opening to closing of the museum, for example, based on the recommendation information for each playback schedule. In this case, recommendation information can be presented for multiple time periods, such as from opening until 12:00, from 12:00 to 15:00, and from 15:00 to closing, and recommendation information can also be presented taking time periods into consideration.

[0146] The above-described process can recommend changes to the playback ratio of each video in a playback schedule set according to the viewer's level of interest in each exhibit, based on the viewer's viewing state (level of interest) after viewing the videos played according to the playback schedule. This provides an opportunity to review the playback ratio of each video included in the playback schedule based on the viewer's actual viewing state, and allows the correction amount for correcting the playback ratio (playback order or number of times played) of each video when generating a playback schedule in the future to be registered. In this case, for example, in step S102 in FIG. 15 or step S112 in FIG. 17, the control unit 21 can acquire the correction amount for the playback ratio (playback order or number of times played) registered for each video as the change in the playback order or number of times played for each video in the playback schedule. Therefore, the playback order or number of times played for each video can be determined when generating a playback schedule in the future, taking into account the viewing state of the viewer who actually views each video, allowing the playback schedule to be set to increase the viewer's viewing rate. Viewers' viewing of such videos is expected to increase sales at the museum shop.

[0147] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0148] 10 Edge PC 11 Control section 12 Storage section 13 Communications Department 14 Camera connection part 20 servers 21 Control section 22 Memory section 23 Communications Department 24 Input section 25 Display section 30 Digital Signage 10a Camera

Claims

1. For each of the plurality of exhibits, count the number of viewers who stop in the area where the exhibit is viewed and the duration of time each viewer stays there; determining a playback method for the video for each of the plurality of exhibits based on the measured number of viewers and the duration of their visit; Output each video in a specific playback format An information processing method in which processing is performed by a computer.

2. Calculating the ratio of the playback time of the video for each of the plurality of exhibits to the playback time of one cycle based on the measured number of viewers and the duration of their visit; Output each video at the calculated ratio The information processing method according to claim 1 , wherein the processing is executed by the computer.

3. For each of the exhibits, a score is calculated based on the measured number of viewers and the time spent standing there, with the score increasing as the number of viewers increases and the time spent standing there by each viewer increases; The percentage of video playback time for each exhibit is calculated in descending order of the calculated score. The information processing method according to claim 2 , wherein the processing is executed by the computer.

4. determining a viewing state of the viewer; weighting the time the viewer has stopped in accordance with the determined viewing state; Calculate the proportion of video playback time for each exhibit based on the weighted dwell time.

4. The information processing method according to claim 2, wherein the processing is executed by the computer.

5. predicting the viewing time of the exhibit in the exhibition area; Based on the predicted viewing time, a time period for measuring the number of viewers and the stopping time is identified.

5. The information processing method according to claim 1, wherein the processing is executed by the computer.

6. determining a status of the display area; weighting the standard viewing time for the exhibition area in accordance with the determined status of the exhibition area; The time period to be measured is identified based on the viewing time after weighting.

6. The information processing method according to claim 5, wherein the processing is executed by the computer.

7. The image is output to a display device located at a position away from the display area of the exhibit.

7. The information processing method according to claim 1, wherein the processing is executed by the computer.

8. predicting a travel time from the exhibition area to the arrangement position of the display device; The display device starts outputting the video at a timing when a predicted movement time has elapsed from the time period during which the number of viewers and stopping time are measured. The information processing method according to claim 7 , wherein the processing is executed by the computer.

9. determining the status of a movement area from the exhibition area to the display device; weighting the reference travel time for the travel area according to the determined situation; Determine the timing to start outputting the video based on the weighted travel time The information processing method according to claim 8 , wherein the processing is executed by the computer.

10. predicting the duration of stay in a sales area for merchandise corresponding to the plurality of exhibits; Based on the predicted stay time, a playback time for one cycle of playing the video related to the exhibit is determined.

10. The information processing method according to claim 1, wherein the processing is executed by the computer.

11. determining the status of the sales area; weighting the reference stay time in the sales area in accordance with the determined status of the sales area; The playback time of the one cycle is determined based on the weighted stay time. The information processing method according to claim 10 , wherein the processing is executed by the computer.

12. determining a playback order for each video based on a ratio of the playback time of each video to the playback time of one cycle; Output each video in a specific playback order 5. The information processing method according to claim 2, wherein the processing is executed by the computer.

13. Accept an instruction to change the playback order of each identified video, Output each video in the changed playback order The information processing method according to claim 12 , wherein the processing is executed by the computer.

14. storing a change value for the proportion of the playback time of the video related to the exhibit in association with the exhibit or the product corresponding to the exhibit; Modifying the calculated proportion of the playback time of each video based on the modification value; Output each video at the changed ratio 14. The information processing method according to claim 2, wherein the processing is executed by the computer.

15. receiving an instruction to change the proportion of the playback time of the video related to the exhibit; The calculated proportion of the playback time of each video is changed based on the change instruction, Output each video at the changed ratio 15. The information processing method according to claim 2, wherein the processing is executed by the computer.

16. Acquire the number of products sold per time period corresponding to each of the plurality of exhibits; Based on the acquired sales figures, a correction amount for correcting the ratio of the playback time of the video of each exhibit to the playback time of one cycle is calculated.

16. The information processing method according to claim 2, wherein the processing is executed by the computer.

17. determining a viewing state of the viewer viewing the output video; A correction amount for correcting the ratio of the playback time of the video of each exhibit to the playback time of one cycle is calculated according to the determined viewing state.

17. The information processing method according to claim 2, wherein the processing is executed by the computer.

18. For each of the plurality of exhibits, count the number of viewers who stop in the area where the exhibit is viewed and the duration of time each viewer stays there; determining a playback method for the video for each of the plurality of exhibits based on the measured number of viewers and the duration of their visit; Output each video in a specific playback format A program that causes a computer to perform a process.

19. a measuring unit that measures, for each of a plurality of exhibits, the number of viewers who stop in an area where the exhibits are viewed and the duration of time each viewer stays there; an identification unit that identifies a playback format for video for each of the plurality of exhibits based on the measured number of viewers and the duration of their visit; an output unit that outputs a playback instruction for each video in a specified playback format; An information processing device comprising:

Images