Display system, information processing apparatus, evaluation method, and computer readable recording medium

By setting up camera devices and content servers in the facility, analyzing and evaluating the effectiveness of projected content, the problem that the prior art cannot evaluate the effectiveness of projected content is solved, dynamic response and content adjustment to user behavior are realized, and content is improved validity and visibility.

CN119006058APending Publication Date: 2024-11-22MITSUBISHI ELECTRIC BUILDING SOLUTIONS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310861657.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-22
Filing Date
2023-07-13
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing projection system cannot effectively determine whether the dynamic content displayed on the projection is effective for the user, and cannot evaluate the guidance effect of the content displayed in the facility on the user.

Method used

The first and second camera devices are used to capture image data around different locations in the facility, and the analysis and judgment unit of the content server is used to analyze the behavior of the user in combination with the image data to evaluate the effectiveness of the content, and generate alternative content if necessary .

Benefits of technology

The accurate and effective evaluation of the displayed content in the facility is achieved, and the display content can be dynamically adjusted according to the user's behavior, thereby improving the visibility and understanding of the content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119006058A_ABST
    Figure CN119006058A_ABST
Patent Text Reader

Abstract

The invention provides a display system, an information processing device, an evaluation method, and a computer-readable recording medium. The invention provides a technology which is advantageous in accurately evaluating the validity of content displayed in a facility with respect to a user. A display system is provided with: a first content display device that displays, at a first position within a facility, first content for guiding a predetermined behavior of a user; a first image capturing device that outputs first image data obtained by capturing an image of a user around the first position; a second image capturing device that outputs second image data obtained by capturing an image of a user around a second position different from the first position within the facility; and a content server. Furthermore, the content server analyzes the behavior of the user on the basis of the first image data and the second image data, and determines the validity of the display of the first content on the basis of the analyzed behavior of the user.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a technology of a display system for displaying information on a floor or a wall. Background Art

[0002] Patent document 1 discloses a technology related to a projection system. For example, the projection system displays product information by a first projection device installed in a shopping mall, and identifies people who are interested in the projected image based on the stop time of the people who watch the projected image. Then, the projection system guides the identified people to the store of the product through the ground display of the second projection device.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2021-89436

[0004] According to the technology of Patent Document 1, the installer of the projection system cannot determine whether the dynamic content projected and displayed in the facility is effective for the user. Summary of the invention

[0005] The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide a technique that is advantageous in accurately evaluating the effectiveness of contents displayed in a facility with respect to users.

[0006] The display system of the present invention comprises: a first content display device, which displays a first content for guiding a user's prescribed behavior at a first position in a facility; a first camera device, which outputs first image data obtained by photographing users around the first position; a second camera device, which outputs second image data obtained by photographing users around a second position in the facility that is different from the first position; and a content server, which comprises an analysis unit and a judgment unit, the analysis unit analyzing the user's behavior based on the first image data and the second image data, and the judgment unit judging the validity of the display of the first content based on the user's behavior analyzed by the analysis unit.

[0007] In addition, the information processing device of the present invention determines the validity of a first content displayed to a user at a first position in a facility for guiding the user's prescribed behavior, wherein the information processing device has: at least one processor; and a memory storing at least one program, wherein the at least one processor is configured to perform the following processing by executing at least one program: an acquisition processing of acquiring first image data obtained by photographing users around the first position and second image data obtained by photographing users around a second position in the facility that is different from the first position; an analysis processing of analyzing the user's behavior based on the first image data and the second image data; and a judgment processing of judging the validity of the display of the first content based on the user's behavior analyzed by the analysis processing.

[0008] In addition, the evaluation method of the present invention evaluates the effectiveness of a first content displayed to a user at a first position in a facility for guiding the user's prescribed behavior, wherein the evaluation method comprises the following steps: an acquisition step of acquiring first image data obtained by photographing users around the first position and second image data obtained by photographing users around a second position in the facility that is different from the first position; an analysis step of analyzing the user's behavior based on the first image data and the second image data; and a judgment step of judging the effectiveness of the display of the first content based on the user's behavior analyzed by the analysis step.

[0009] Furthermore, a computer-readable recording medium of the present invention records a program that causes a computer to execute the following processing: determining the validity of a first content displayed to a user at a first position within a facility for guiding the user to perform a prescribed behavior, wherein the program is configured to cause the computer to execute the following processing: obtaining first image data obtained by photographing users around the first position and second image data obtained by photographing users around a second position within the facility that is different from the first position, analyzing the user's behavior based on the first image data and the second image data, and determining the validity of the display of the first content based on the analyzed user's behavior.

[0010] According to the technology of the present invention, it is possible to accurately evaluate the effectiveness of the contents displayed in a facility with respect to users. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a diagram showing a configuration example of a display system in an embodiment.

[0012] Figure 2 This is a block diagram showing an example of the configuration of a display system according to an embodiment.

[0013] Figure 3 Detailed description of the invention is a block diagram showing functions implemented by a processor of a content server executing a program.

[0014] Figure 4 It is a diagram for explaining a specific example of the determination process.

[0015] Figure 5 It is a diagram for explaining the first embodiment of the determination process.

[0016] Figure 6 It is a diagram for explaining the second embodiment of the determination process.

[0017] Figure 7 It is a diagram for explaining a third specific example of the determination process.

[0018] Figure 8 : is a functional block diagram showing the internal functions of the alternative content generation unit.

[0019] Fig. 9 1 is a flowchart showing a routine of an alternative content generation process executed in the alternative content generation unit.

[0020] Fig.10 It is an internal block diagram showing the internal functions of the model learning unit.

[0021] Fig.11 1 is a flowchart of a routine executed in the display system of the embodiment.

[0022] Fig.12 It is a diagram showing a modified example of hardware resources of a content server.

[0023] Description of symbols

[0024] 4, 6: external server; 8: communication network; 10: first content display device; 12: first camera device; 20, 20a, 20b: second content display device; 22, 22a, 22b: second camera device; 30: content server; 40: processor; 41: acquisition unit; 42: analysis unit; 43: judgment unit; 44: alternative content generation unit; 45: output unit; 46: model learning unit; 47: reflection unit; 50: memory; 52: program; 54: learned model storage unit; 60: data; 70: dedicated hardware; 72: processing circuit; 100: display system; 442: data acquisition unit; 444: reasoning unit; 462: data acquisition unit; 464: model generation unit. DETAILED DESCRIPTION

[0025] Hereinafter, the embodiments will be described with reference to the drawings. In addition, the same reference numerals are given to common elements in the drawings, and duplicate descriptions are omitted.

[0026] Implementation

[0027] 1. Overview of Display System in Embodiment

[0028] Figure 11 is a diagram showing a configuration example of a display system in an embodiment. The display system 100 is a system that displays content consisting of a picture, a character, or a combination thereof on the ground or a wall surface in a facility for the purpose of advertising, guiding, or calling attention to the users of the facility, and evaluates the effectiveness of the displayed content on the users. Here, regarding the display of content on the ground or the wall surface, the content can be displayed by a display set on the ground or the wall surface, or the content can be projected onto the ground or the wall surface by a projection device for display. In addition, the content can be a static image content, or a dynamic image content in which part or all of it has dynamic image materials or animation effects. In addition, the advertisement can exemplify, for example, an advertisement for a product or a store. In addition, the guidance or calling attention here can exemplify a display indicating the guidance direction in the facility, a display indicating whether it is passable, etc. In addition, the facilities are airport facilities, stations, commercial facilities, hospitals, etc. In the following description, the display system 100 guides or calls attention in a commercial facility and the display is based on a projection display.

[0029] The display system 100 includes a first content display device 10 , a first camera 12 , a second content display device 20 , a second camera 22 , and a content server 30 .

[0030] The first content display device 10 is a device that projects and displays the first content at a first position on the ground in the facility. The projection method and structure of the first content display device 10 are not limited. The first content is used to guide the user to a prescribed behavior. For example, when the prescribed behavior is "going straight and turning right", as the content for guiding such a prescribed behavior in the facility, Figure 1 In addition, when the prescribed behavior is "the behavior of going straight and turning left", as the content for guiding such behavior in the facility, an arrow (not shown) for going straight and turning left is displayed.

[0031] The first camera device 12 is a camera configured to capture images of the first position P1 and its surroundings where the first content is displayed. The first camera device 12 periodically captures and outputs images of people located at the first position P1 and its surroundings. There is no limitation on the type, number, and location of the first camera device 12. The first camera device 12 may also be integrally formed with the first content display device 10. The image data captured by the first camera device 12 is hereinafter referred to as "first image data". The first image data is not limited to static image data, but may also be dynamic image data. The first image data is sent to the content server 30 via a communication network 8 such as the Internet.

[0032] The second content display device 20 is a device that projects and displays the second content at a second location on the ground in a facility different from the first location. The number, installation location, projection method, and structure of the second content display device 20 are not limited. Figure 1 In the example shown, two second content display devices 20a and 20b are provided as the second content display device 20. The second content display device 20a projects and displays the second content (OK) at a second position P2a in the middle of the guidance path based on the guidance guide based on the first content. The second content is also used to guide the user's prescribed behavior. For example, in the case where the prescribed behavior is "straight ahead", the "second content (OK)" here, for example, displays a display indicating the straight ahead direction by an arrow, as content for guiding such prescribed behavior in the facility.

[0033] The second content display device 20b projects and displays the second content (NG) at a second position P2b in the middle of the path deviating from the guidance path based on the guidance guide based on the second content. For example, when the prescribed behavior is "stop", the "second content (NG)" here, for example, displays an "×" indicating that the direction of travel is the wrong direction, as content for guiding such a prescribed behavior in the facility.

[0034] The second camera device 22 is a camera that is set to capture a range including the second position P2 where the second content is displayed and its surroundings. The second camera device 22 regularly captures and outputs people located at the second position P2 and its surroundings. The type, number, and installation location of the second camera device 22 are not limited. Figure 1 In the example shown, two second camera devices 22a and 22b are provided as the second camera device 22. The second camera device 22a is provided to capture a range including the second position P2a of the second content display device 20a where the second content (OK) is displayed and its surroundings. The second camera device 22b is provided to capture a range including the second position P2b of the second content display device 20b where the second content (NG) is displayed and its surroundings. In addition, the second camera devices 22a and 22b may be integrally formed with the second content display devices 20a and 20b, respectively. The image data captured by the second camera device 22 is hereinafter referred to as "second image data". In addition, when distinguishing between the second image data captured by the second camera devices 22a and 22b, they are hereinafter referred to as "second image data (OK)" and "second image data (NG)". The second image data is not limited to static image data, but may also be dynamic image data. The second image data is transmitted to the content server 30 via the communication network 8 such as the Internet.

[0035] The content server 30 receives image data captured periodically by the first camera 12 and the second camera 22. This process is hereinafter referred to as "acquisition process". The content server 30 obtains attribute information and behavior information by analyzing the attributes and behaviors of the user based on the acquired image data. This process is hereinafter referred to as "analysis process". The behavior information here may include the gender, age, etc. of the user. In addition, the behavior information here may include the location, stay time, movement direction, etc. of the user. In the analysis process, for example, a tracking process technology called Person Re-Identification is used. An example of the tracking process will be described later. In addition, here, an example is given of the situation where the content server 30 analyzes the attributes and behaviors of the user based on the acquired image data, but it is also possible to have only the function of analyzing the behavior of the user.

[0036] In addition, the content server 30 determines whether the connotation of the displayed content is valid based on the behavior of the user analyzed through the analysis process. In the analysis process, when the attributes are further analyzed in addition to the behavior of the user, the content server 30 can also determine whether the connotation of the displayed content is valid according to each attribute of the user based on the analyzed attributes and behavior of the user. In addition, when the attribute information of the user who is the content object can be obtained, the validity of the content can be determined by further considering the information. This process is hereinafter referred to as "judgment processing". Several examples of judgment processing will be described later.

[0037] The content server 30 outputs the judgment result of the judgment process to the external server 4 of the system installer of the display system 100. This process is hereinafter referred to as "output process". In the output process, the content server 30 may also output the judgment result of the judgment process to the external server 6 of the system installer of the display system installed in a facility of the same industry. Thus, the system installer of the display system can collect information related to the validity of the content displayed in the facility and its main reasons.

[0038] Furthermore, the content server 30 generates alternative content based on the judgment result of the judgment process. This process is hereinafter referred to as "alternative content generation process". The alternative content here is content that is more effective than the first content. For example, in the case of content such as indicating a destination by an arrow, a content with an arrow thicker than the first content can also be used as an alternative content. In this case, it can be said that the alternative content is more useful in the sense that the visibility is higher than the first content. In another example, the content after the contrast between the arrow part and the background part of the first content is improved can also be used as an alternative content. Moreover, in the case where the arrow as the first content is difficult to understand and is useless, a text guide can also be used as an alternative content. As an alternative content of the text guide, Japanese or English can be used. In the alternative content generation process, a learned model for inferring alternative content is used. The learned model here is a model that accepts the input of the first content, the first image data and the second image data and outputs the alternative content. The learned model is pre-generated by the model learning process. In the model learning process, the learned model is generated by machine learning the relationship between the first content, the first image data and the second image data and the alternative content whose effectiveness is known to the user. The model learning process will be described later.

[0039] The content server 30 reflects the substitute content output from the learned model as new content for the first content display device 10 or the second content display device 20. This process is hereinafter referred to as "reflection process".

[0040] According to the display system 100 as described above, it is possible to accurately evaluate the effectiveness of the contents displayed in the facility with respect to the users based on the attributes and actions of the users.

[0041] 2. Display system structure

[0042] Figure 2 The display system 100 includes the first content display device 10 , the first imaging device 12 , one or more second content display devices 20 , one or more second imaging devices 22 , and a content server 30 .

[0043] The content server 30 has the function of an information processing device as a computer. The content server 30 is set in the control object facility. Alternatively, the content server 30 can also be set in a remote location different from the control object facility. As another example, the content server 30 can also be implemented by a server on the cloud. When the content server 30 is set in a remote location, the content server 30 sends or receives data between the first content display device 10, the first camera device 12, the second content display device 20, and the second camera device 22 via a communication network 8 such as the Internet.

[0044] The content server 30 has at least one processor 40 and at least one memory 50. The memory 50 as a storage device stores at least one program 52 executable by the processor 40, a learned model storage unit 54, and various related data 60. The program 52 may also be recorded in a computer-readable recording medium. The data 60 stores in advance information on content that can be displayed in the first content display device 10 and the second content display device 20. The information on the content here includes the purpose of the content and its meaning. Regarding the meaning of the content, for example, if it is for guidance / attention-raising purposes, "destination" can be exemplified, and if it is for advertising purposes, "users with what attributes are targeted" can be exemplified.

[0045] The processor 40 executes the program 52 to realize various processes of the processor 40 . Figure 3 is a block diagram showing functions implemented by a processor of a content server executing a program. Figure 3 As shown, the processor 40 includes an acquisition unit 41, an analysis unit 42, a determination unit 43, an alternative content generation unit 44, an output unit 45, a model learning unit 46, and a reflection unit 47. Figure 1 , explaining the function of the processor 40. In addition, here, the case where the processor 40 has the model learning unit 46 is exemplified, but the model learning unit 46 is not necessarily a structure in the processor 40. That is, the processor 40 may also be a structure that obtains a learned model from an external system and provides the obtained learned model to the processing of the alternative content generation unit 44.

[0046] The acquisition unit 41 is a functional block for performing acquisition processing. In the acquisition processing, the acquisition unit 41 acquires the first image data and the second image data from the first imaging device 12 and the second imaging device 22, respectively.

[0047] The analysis unit 42 is a functional block for performing analysis processing. In the analysis processing, the analysis unit 42 estimates the attributes of the user, such as gender and age, by performing image analysis processing on one or both of the acquired first image data and second image data. At this time, it is also possible to assign unique ID information to each user, associate the estimated attribute information with the ID information, and store it in the data 60 at any time.

[0048] Furthermore, in the analysis process, by using the tracking process of the first image data and the second image data that have been obtained, behavior information representing the behavior of the user can be obtained at any time. In the tracking process, a well-known tracking process for obtaining the behavior information of the user using image data can be used. For example, in the tracking process, the analysis unit 42 uses a technology called Person Re-Identification. In Person Re-Identification, first, a person area where a person is located is detected from the input image data. The image information of the person contained in the detected person area is hereinafter referred to as "person image data". The detected person image data is input as a search query to the neural network model for Person Re-Identification.

[0049] In addition, template image data as a candidate destination is input to the neural network model. Template image data is data obtained by associating inherent ID information for identification with person image data identified by past image data. In the neural network model, template image data as a candidate destination that has the highest similarity to the person image data input as a search query is output as an output result. In addition, in the case where there is no template image data as a candidate destination similar to the person image data, data obtained by associating new ID information with the person image data is stored as part of the new template image data. The analysis unit 42 performs tracking processing based on Person Re-Identification on the input image data along the time series, and stores the behavior information of each user in the data 60.

[0050] The determination unit 43 is a functional block for performing determination processing. In the determination processing, the determination unit 43 determines whether the content of the first content is valid based on the attribute information and behavior information of the user analyzed by the analysis unit 42.

[0051] Figure 4 is a diagram for explaining a specific example of the determination process. In the example shown in the figure, the following situation is shown: at time T=t1, there are three users in the range around the first position P1 where the first content is displayed. The three users are analyzed for their respective attribute information and behavior information through the analysis process. Figure 4 In the example shown, the attributes of the three users are male / middle-aged, male / child, and female / adult. In the first content, a destination display is depicted in which an arrow indicates guidance to go straight and turn right.

[0052] Figure 5 It is a diagram for explaining the first embodiment of the determination process. Figure 5 The first specific example shown shows the following situation: Figure 4 At time T=t2 after the state at time T=t1 shown, three users move to the vicinity of the second position P2a where the second content (OK) is displayed. The attribute information and behavior information of the three users are analyzed by the analysis process.

[0053] Thus, when the analysis process finds that all three users around the first position have moved to the area around the second position P2a, it can be said that the users have moved in the correct direction according to the guidance based on the first content. In this case, the judgment process determines that the first content is content that is easy to understand for users of any attributes.

[0054] Figure 6 It is a diagram for explaining the second embodiment of the determination process. Figure 6 The second specific example shown shows the following situation: Figure 4 At time T=t3 after the state at time T=t1 shown, three users move to the vicinity of the second position P2b where the second content (NG) is displayed. The attribute information and behavior information of the three users are analyzed by the analysis process.

[0055] Thus, if the analysis process finds that all three users around the first position have moved to the second position P2b, it can be said that the users have moved in the wrong direction without following the guidance based on the first content. In this case, the judgment process determines that the first content is difficult for users of any attributes to understand.

[0056] Furthermore, if the analysis process finds that the user who has moved to the area around the second position P2b has not returned or the analysis process finds that the user who has moved to the area around the second position P2b has stayed for more than a predetermined reference stay time, it can be said that the guidance of the user based on the second content has failed. In this case, the judgment process determines that the second content (NG) is content that is difficult for users of any attributes to understand.

[0057] Figure 7 It is a diagram for explaining a third specific example of the determination process. Figure 7 The third specific example shown shows the following situation: Figure 4 At time T=t4 after the state at time T=t1, the male / child user moves to the vicinity of the second position P2b where the second content (NG) is displayed, and the male / middle-aged and female / adult users move to the vicinity of the second position P2a where the second content (OK) is displayed. The attribute information and behavior information of the three users are analyzed by the analysis process.

[0058] Thus, when the analysis process finds that only the male / child user among the three users around the first position has moved to the second position P2b, it can be said that the guidance of the male / child user based on the first content has failed. In this case, the judgment process determines that the first content is difficult for the male / child user to understand.

[0059] Furthermore, if the analysis process finds that the male / child user who moved to the vicinity of the second position P2b did not return afterwards or if the analysis process finds that the male / child user who moved to the vicinity of the second position P2b stayed for more than a predetermined reference stay time, it can be said that the guidance of the male / child user based on the second content has failed. The second content (NG) is judged in the judgment process as content that is difficult for the male / child user to understand.

[0060] The alternative content generation unit 44 is a functional block for performing an alternative content generation process. In the alternative content generation process, the alternative content generation unit 44 generates alternative content based on the judgment result of the judgment process. In the alternative content generation process, specifically, the learned model is used.

[0061] Figure 8 4 is a functional block diagram showing the internal functions of the alternative content generation unit. The alternative content generation unit 44 includes a data acquisition unit 442 and an inference unit 444. The data acquisition unit 442 is a functional block for acquiring input information required for inferring alternative content. The input information may be, for example, first content, first image data, and second image data. The inference unit 444 is a functional block for outputting alternative content using the learned model stored in the learned model storage unit 54.

[0062] Fig. 9 4 is a flowchart showing a routine of the alternative content generation process executed in the alternative content generation unit 44. Fig. 9 In step S10 of the routine shown, the first image data and the second image data are acquired in the data acquisition unit 442. In the next step S12, the acquired first image data and the second image data are input to the inference unit 444. In the inference unit 444, alternative content for the content judged to be difficult to understand is inferred based on the input judgment result. Then, in step S14, the alternative content inferred by the inference unit 444 is output to the first content display device 10 as the display object.

[0063] The output unit 45 is a functional block for performing output processing and outputs the determination result of the determination processing to the external server 4 of the system installer of the display system 100 or the external server 6 of the system installer of the display system installed in a facility of the same industry.

[0064] The model learning unit 46 is a functional block for performing model learning processing in advance. Fig.10 4 is an internal block diagram showing the internal functions of the model learning unit. The model learning unit 46 includes a data acquisition unit 462 and a model generation unit 464. The data acquisition unit 462 is a functional block for acquiring learning data. The learning data is data obtained by associating input 1 with input 2 that is a correct answer to input 1. For example, input 1 is a first content, a first image data, and a second image data. Input 2 may exemplify an alternative content whose effectiveness to the user is known.

[0065] The model generation unit 464 learns the output for the input according to the learning algorithm. The learning algorithm here is not limited to the supervised learning mentioned above, and well-known learning algorithms such as unsupervised learning, semi-supervised learning, and reinforcement learning can also be used. Typically, the learning algorithm can be exemplified by neural network, deep learning, genetic programming, functional logic programming, SVM (Support Vector Machine), k-NN (k-nearest neighbor algorism), etc.

[0066] The reflection unit 47 is a functional block for performing reflection processing. In the reflection processing, the reflection unit 47 reflects the alternative content generated by the alternative content generation unit 44 as new content to be displayed on the first content display device 10 or the second content display device 20.

[0067] 3. Specific processing performed in the display system

[0068] Fig.11 1 is a flowchart of a routine executed in the display system of the embodiment. In addition, this routine also represents a part of the evaluation method for evaluating the effectiveness of the content displayed in the display system 100.

[0069] In step S100, content is displayed on each content device of the display system 100. Specifically, the first content is displayed on the first content display device 10, and the second content is displayed on the second content display device 20.

[0070] In step S102, information of each content currently displayed is acquired from the content server 30. Here, the content server 30 reads out the content information corresponding to each content currently displayed from the data 60 in the memory 50.

[0071] In step S104, the image data captured by the first camera 12 and the second camera 22 are sent to the content server 30. In step S106, the attribute information and behavior information of the user in the image data are obtained by analysis processing. In step S108, it is determined whether the displayed first content and the second content are valid through judgment processing. As a result, if it is determined that the first content and the second content are valid, this routine ends. If it is determined that either the first content or the second content is not valid, the processing proceeds to step S110.

[0072] In step S110, the judgment result of the judgment processing is presented to the external server 4 of the system setter of the display system 100. In step S112, substitute content is generated by substitute content generation processing for the content judged as not valid in step S108. In step S11, it is determined whether the content is replaced with substitute content. Here, for example, it is determined whether a replacement instruction to substitute content is received from the system setter. As a result, if the judgment is not established, this routine ends, and if the judgment is established, the processing proceeds to step S116.

[0073] In step S116 , the content determined to be ineffective in step S108 is changed to the alternative content generated in step S112 .

[0074] According to the display system 100 described above, the effectiveness of the content displayed in the facility for the user can be accurately evaluated. In addition, when the displayed content is not effective, alternative content can be generated and replaced based on the learning data.

[0075] 3. Modifications

[0076] The display system 100 of this embodiment may also adopt the following modified forms.

[0077] 3-1. Hardware resources of information processing devices

[0078] Fig.12 FIG. 1 is a diagram showing a modified example of hardware resources of a content server as an information processing device. Fig.12 In the illustrated example, the content server 30 as an information processing device has a processing circuit 72 including a processor 40 , a memory 50 , and dedicated hardware 70 , for example. Fig.12 The example in which a part of the functions of the content server 30 is implemented by the dedicated hardware 70 is shown. All the functions of the content server 30 may be implemented by the dedicated hardware 70. The dedicated hardware 70 may also be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0079] 3-2. Functional Configuration of Content Server 30

[0080] Some of the functions of the content server 30 may also be installed in other devices such as the first content display device 10 , the second content display device 20 , the first imaging device 12 , and the second imaging device 22 .

[0081] 3-3. Model learning process

[0082] The model learning unit 46 may generate a learned model that can accept input of information such as the user's age, gender, behavior, and stay time, and generate alternative content in consideration of the information. In this case, the data acquisition unit 442 acquires information related to the user's age, gender, behavior, and stay time, such as user attribute information, behavior information, and congestion, in addition to the first content, the first image data, and the second image data. Then, the inference unit 444 uses the acquired information as input to infer alternative content using the learned model.

[0083] 3-4. Judgment and processing

[0084] The determination process performed by the determination unit 43 is not limited to the determination of the validity of the first content, and the determination of the validity of the second content may also be performed. In this case, the determination unit 43 can determine the validity of the second content based on the user's behavior information or the behavior information and attribute information analyzed from the second image data, for example.

[0085] In addition, at least one of the first content and the second content may be provided for guiding behavior with specific attributes. Specifically, the information of the first content stored in the first content display device 10 includes attribute information of the target user, and the judgment unit 43 may also judge the validity of the display of the first content based on the attribute information of the target user. Similarly, the information of the second content stored in the second content display device 20 may include attribute information of the target user, and the judgment unit 43 may judge the validity of the display of the second content based on the attribute information of the target user. In this case, the effectiveness of the content displayed in the facility with respect to users with specified attributes can be evaluated more accurately.

[0086] 4. Others

[0087] Although preferred embodiments and the like have been described in detail above, the present invention is not limited to the above-described embodiments and the like, and various modifications and substitutions can be made to the above-described embodiments and the like without departing from the scope described in the claims.

[0088] Hereinafter, various aspects of the present invention will be collectively described as supplementary notes.

[0089] (Note 1)

[0090] A display system, wherein the display system comprises:

[0091] a first content display device for displaying first content for guiding a user to perform a predetermined behavior at a first location in the facility;

[0092] a first camera device that outputs first image data obtained by photographing the user around the first position;

[0093] a second imaging device that outputs second image data obtained by photographing the user around a second position different from the first position in the facility; and

[0094] A content server comprises an analysis unit and a judgment unit, wherein the analysis unit analyzes the user's behavior based on the first image data and the second image data, and the judgment unit judges the validity of displaying the first content based on the user's behavior analyzed by the analysis unit.

[0095] (Note 2)

[0096] The display system according to Supplement 1, wherein:

[0097] The content server further includes an alternative content generating unit configured to generate alternative content to be displayed at the first position instead of the first content, when the determining unit determines that display of the first content is not valid.

[0098] (Note 3)

[0099] The display system according to Supplement 2, wherein:

[0100] The display system includes a learned model that is generated in advance by learning the relationship between the first content, the first image data, the second image data, and the substitute content,

[0101] The alternative content generating unit comprises:

[0102] a data acquisition unit that acquires the first content, the first image data, and the second image data; and

[0103] An inference unit that uses the learned model to output the alternative content based on the first image data, the second image data, and the first content acquired by the data acquisition unit.

[0104] (Note 4)

[0105] The display system according to any one of Supplements 1 to 3, wherein:

[0106] The analyzing unit is configured to further analyze the attributes of the user based on at least one or both of the first image data and the second image data.

[0107] The determination unit is configured to determine validity of display of the first content based on the attribute and behavior of the user analyzed by the analysis unit.

[0108] (Note 5)

[0109] The display system according to Supplement 4, wherein:

[0110] The information of the first content stored in the first content display device includes attribute information of a target user.

[0111] The determination unit is configured to determine validity of display of the first content based on attribute information of the target user.

[0112] (Note 6)

[0113] The display system according to any one of Supplementary Notes 1 to 5, wherein:

[0114] The display system includes a second content display device that displays second content for guiding the user to perform a predetermined behavior at the second position.

[0115] The analyzing unit is configured to analyze attributes of a user based on at least one or both of the first image data and the second image data.

[0116] The determination unit determines validity of display of the second content based on the attribute and behavior of the user analyzed by the analysis unit.

[0117] (Note 7)

[0118] The display system according to Supplementary Note 6, wherein:

[0119] The information of the second content stored in the second content display device includes attribute information of a target user.

[0120] The determination unit determines validity of display of the second content based on attribute information of the target user.

[0121] (Note 8)

[0122] The display system according to any one of Supplementary Notes 1 to 7, wherein:

[0123] The content server further includes an output unit that outputs a result of the validity determined by the determination unit to an external server.

[0124] (Note 9)

[0125] An information processing device for determining validity of first content displayed to a user at a first location in a facility for guiding the user to a predetermined behavior, wherein the information processing device comprises:

[0126] At least 1 processor; and

[0127] A memory storing at least one program,

[0128] The at least one processor is configured to perform the following processing by executing the at least one program:

[0129] an acquisition process of acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position;

[0130] analyzing the user's behavior based on the first image data and the second image data; and

[0131] The determination process determines the validity of displaying the first content based on the behavior of the user analyzed by the analysis process.

[0132] (Note 10)

[0133] An evaluation method for evaluating the effectiveness of first content displayed to a user at a first location in a facility for guiding the user to perform a predetermined behavior, wherein the evaluation method comprises the following steps:

[0134] an acquisition step of acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position;

[0135] an analyzing step of analyzing the user's behavior based on the first image data and the second image data; and

[0136] A judging step of judging the validity of displaying the first content based on the behavior of the user analyzed in the analyzing step.

[0137] (Note 11)

[0138] A computer-readable recording medium having a program recorded thereon, the program causing the computer to execute the following processing: determining the validity of first content displayed to a user at a first location in a facility for guiding the user's behavior, wherein:

[0139] The program is configured to cause a computer to execute the following processing:

[0140] acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position,

[0141] analyzing the user's behavior based on the first image data and the second image data,

[0142] The effectiveness of displaying the first content is determined based on the analyzed behavior of the user.

Claims

1. A display system, wherein: The display system has: a first content display device for displaying first content for guiding a user to perform a predetermined behavior at a first location in the facility; a first camera device that outputs first image data obtained by photographing the user around the first position; a second imaging device that outputs second image data obtained by photographing the user around a second position different from the first position in the facility; as well as A content server comprises an analysis unit and a judgment unit, wherein the analysis unit analyzes the user's behavior based on the first image data and the second image data, and the judgment unit judges the validity of displaying the first content based on the user's behavior analyzed by the analysis unit.

2. The display system according to claim 1, wherein: The content server further includes an alternative content generating unit configured to generate alternative content to be displayed at the first position instead of the first content, when the determining unit determines that display of the first content is not valid.

3. The display system according to claim 2, wherein: The display system includes a learned model that is generated in advance by learning the relationship between the first content, the first image data, the second image data, and the substitute content, The alternative content generating unit comprises: a data acquisition unit that acquires the first content, the first image data, and the second image data; and An inference unit that uses the learned model to output the alternative content based on the first image data, the second image data, and the first content acquired by the data acquisition unit.

4. The display system according to any one of claims 1 to 3, wherein: The analyzing unit is configured to further analyze the attributes of the user based on at least one or both of the first image data and the second image data. The determination unit is configured to determine validity of display of the first content based on the attribute and behavior of the user analyzed by the analysis unit.

5. The display system according to claim 4, wherein: The information of the first content stored in the first content display device includes attribute information of a target user. The determination unit is configured to determine validity of display of the first content based on attribute information of the target user.

6. The display system according to any one of claims 1 to 3, wherein: The display system includes a second content display device that displays second content for guiding the user to perform a predetermined behavior at the second position. The analyzing unit is configured to analyze attributes of a user based on at least one or both of the first image data and the second image data. The determination unit determines validity of display of the second content based on the attribute and behavior of the user analyzed by the analysis unit.

7. The display system according to claim 6, wherein: The information of the second content stored in the second content display device includes attribute information of a target user. The determination unit determines validity of display of the second content based on attribute information of the target user.

8. The display system according to any one of claims 1 to 3, wherein: The content server further includes an output unit that outputs a result of the validity determined by the determination unit to an external server.

9. An information processing device for determining the validity of first content displayed to a user at a first location in a facility for guiding the user to perform a predetermined behavior, wherein: The information processing device has: At least 1 processor; and A memory storing at least one program, The at least one processor is configured to perform the following processing by executing the at least one program: an acquisition process of acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position; Analysis processing, analyzing the user's behavior based on the first image data and the second image data; as well as The determination process determines the validity of displaying the first content based on the behavior of the user analyzed by the analysis process.

10. An evaluation method for evaluating effectiveness of first content displayed to a user at a first location in a facility for guiding the user to perform a predetermined behavior, wherein: The evaluation method has the following steps: an acquisition step of acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position; an analyzing step of analyzing the user's behavior based on the first image data and the second image data; as well as A judging step of judging the validity of displaying the first content based on the behavior of the user analyzed in the analyzing step.

11. A computer-readable recording medium having a program recorded thereon, the program causing the computer to execute the following processing: determining the validity of first content displayed to a user at a first location in a facility for guiding the user to a predetermined behavior, wherein: The program is configured to cause a computer to execute the following processing: acquiring first image data obtained by photographing the user around the first position and second image data obtained by photographing the user around a second position in the facility that is different from the first position, analyzing the user's behavior based on the first image data and the second image data, The effectiveness of displaying the first content is determined based on the analyzed behavior of the user.