Displaying system, information processing device, evaluating method, and computer-readable recording medium

The display system uses imaging devices and a content server to assess user behavior and generate alternative content, addressing the challenge of evaluating and enhancing the effectiveness of displayed content in facilities.

JP2024167624AActive Publication Date: 2024-12-04MITSUBISHI ELECTRIC BUILDING SOLUTIONS CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023083830
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-12-04
Estimated Expiration
2043-05-22

AI Technical Summary

Technical Problem

Existing systems cannot accurately evaluate the effectiveness of displayed content for users in facilities, such as shopping malls, leading to ineffective guidance or advertising.

Method used

A display system comprising first and second content display devices with imaging devices capturing user behavior at different positions, a content server analyzing this behavior, and a determination unit to assess content effectiveness, with the option to generate and implement alternative content based on learned models.

Benefits of technology

Accurately evaluates content effectiveness by analyzing user behavior and generates alternative content to improve understanding and engagement, ensuring effective guidance or advertising.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024167624000001_ABST
    Figure 2024167624000001_ABST
Patent Text Reader

Abstract

To provide a display system, an information processing device, an evaluating method and a recording medium useful for appropriately evaluating the effectiveness of contents displayed within a facility to a user.SOLUTION: A display system 100 that displays information on a floor surface or on a wall surface includes: a first content display device 10 that displays, on a first position P1 within a facility, first content that prompts a user to take a predetermined action; a first imaging device 12 that outputs first image data obtained by imaging the user around the first position; second imaging devices 22a and 22b that output respective second image data obtained by imaging the user around respective second positions P2a and P2b different from the first position within the facility; and a content server 30 which analyzes the activity of the user based on the first image data and on the respective second image data, and which determines the effectiveness of the display of the first content based on the analyzed activity of the user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technology for a display system that displays information on a floor or wall surface. [Background technology]

[0002] Patent Document 1 discloses a technology related to a projection system. This projection system displays product information on a first projection device installed in, for example, a shopping mall, and identifies people who are interested in the projected image based on the time that people stop looking at the projected image. The projection system then guides the identified people to the store or other location of the product by displaying the product on the floor using a second projection device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-89436 Summary of the Invention [Problem to be solved by the invention]

[0004] With the technology of Patent Document 1, the installer of the projection system cannot determine whether the dynamic content projected and displayed within the facility was useful to the users.

[0005] The present disclosure has been made to solve the problems described above, and aims to provide a technology that is advantageous for accurately evaluating the effectiveness of content displayed within a facility for users. [Means for solving the problem]

[0006] The display system of the present disclosure includes a first content display device that displays first content at a first location within a facility to guide a user to take a specific action, a first imaging device that outputs first image data capturing an image of users in the vicinity of the first location, a second imaging device that outputs second image data capturing an image of users in the vicinity of a second location different from the first location within the facility, an analysis unit that analyzes user behavior based on the first image data and the second image data, and a judgment unit that judges the validity of displaying the first content based on the user behavior analyzed by the analysis unit.

[0007] In addition, the information processing device of the present disclosure is an information processing device that is displayed to a user at a first location within a facility and determines the effectiveness of a first content for guiding the user to take a predetermined action, and is equipped with at least one processor and a memory having at least one program stored therein, and the at least one processor is configured to execute the at least one program to perform an acquisition process for acquiring first image data capturing an image of a user in the vicinity of the first location and second image data capturing an image of a user in the vicinity of a second location different from the first location within the facility, an analysis process for analyzing the user's behavior based on the first image data and the second image data, and a judgment process for determining the effectiveness of displaying the first content based on the user's behavior analyzed by the analysis process.

[0008] In addition, the evaluation method disclosed herein is an evaluation method for evaluating the effectiveness of first content that is displayed to a user at a first location within a facility and is intended to guide the user to take a specified action, and includes an acquisition step of acquiring first image data that captures a user in the vicinity of the first location and second image data that captures a user in the vicinity of a second location within the facility that is different from the first location, an analysis step of analyzing the user's behavior based on the first image data and the second image data, and a judgment step of determining the effectiveness of the display of the first content based on the user's behavior analyzed by the analysis step.

[0009] Furthermore, the computer-readable recording medium of the present disclosure is a computer-readable recording medium having recorded thereon a program that causes a computer to execute the steps of: determining the effectiveness of a first content that is displayed to a user at a first location within a facility and that guides the user to take a specified action; the program is configured to cause the computer to acquire first image data that captures users in the vicinity of the first location and second image data that captures users in the vicinity of a second location within the facility that is different from the first location; analyze the user's behavior based on the first image data and the second image data; and determine the effectiveness of displaying the first content based on the analyzed user's behavior. Effect of the Invention

[0010] According to the technology disclosed herein, it becomes possible to accurately evaluate the effectiveness of content displayed within a facility for users. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a display system according to an embodiment. [Diagram 2] 1 is a block diagram showing an example of a configuration of a display system according to an embodiment; [Diagram 3] 2 is a block diagram showing functions realized by a processor of the content server executing a program. FIG. [Figure 4] FIG. 11 is a diagram for explaining a specific example of a determination process. [Diagram 5] FIG. 11 is a diagram for explaining a first embodiment of a determination process. [Figure 6] FIG. 11 is a diagram for explaining a second embodiment of the determination process. [Figure 7] FIG. 11 is a diagram for explaining a third specific example of the determination process. [Figure 8] 4 is a functional block diagram showing internal functions of an alternative content generation unit. FIG. [Figure 9]13 is a flowchart showing a routine of an alternative content generation process executed in an alternative content generation unit. [Figure 10] FIG. 2 is an internal block diagram showing the internal functions of a model learning unit. [Figure 11] 4 is a flowchart of a routine executed in the display system according to the embodiment. [Figure 12] FIG. 13 is a diagram showing a modified example of the hardware resources of the content server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment will be described with reference to the drawings. In addition, elements common to the various drawings are given the same reference numerals, and duplicated explanations will be omitted.

[0013] Embodiment 1. Overview of the display system according to the embodiment FIG. 1 is a diagram showing an example of the configuration of a display system according to an embodiment. The display system 100 is a system that displays content consisting of figures, characters, or a combination of these on the floor or wall of a facility for purposes such as advertising, guidance, or attention to facility users, and evaluates the effectiveness of the displayed content to users. Here, the display of content on the floor or wall may be a display provided on the floor or wall, or a display projected onto the floor or wall by a projection device. The content may be a still image content, or may be a video material or a video content with an animation effect in part or in whole. The advertisement may be, for example, an advertisement for a product or a store. The guidance or attention here may be, for example, a display showing the direction of guidance within the facility, a display showing whether passage is possible, and the like. The facilities are targeted at airport facilities, stations, commercial facilities, hospitals, and the like. In the following description, a case will be described in which the display system 100 guides or calls attention within a commercial facility, and the display is a projection display.

[0014] The display system 100 includes a first content display device 10, a first imaging device 12, a second content display device 20, a second imaging device 22, and a content server 30.

[0015] The first content display device 10 is a device that projects and displays a first content at a first position on the floor surface in a facility. There are no limitations on the projection method and structure of the first content display device 10. The first content is intended to guide a predetermined action by a user. For example, when the predetermined action is "going straight and turning right", an arrow going straight and turning right is displayed as the first content in FIG. 1 as the content for guiding such a predetermined action within the facility. Also, when the predetermined action is "going straight and turning left", an arrow going straight and turning left (not shown) is displayed as the content for guiding such an action within the facility.

[0016] The first imaging device 12 is a camera installed so as to capture an image of the first position P1 where the first content is displayed and its surroundings. The first imaging device 12 periodically captures and outputs images of people at the first position P1 and its surroundings. There is no limitation on the type, number, and installation location of the first imaging device 12. The first imaging device 12 may be configured integrally with the first content display device 10. The image data captured by the first imaging device 12 is hereinafter referred to as "first image data." The first image data is not limited to still image data, and may be video data. The first image data is transmitted to the content server 30 via a communication network 8 such as the Internet.

[0017] The second content display device 20 is a device that projects and displays the second content at a second position on the floor surface of the facility different from the first position. There are no limitations on the number, installation location, projection method, and structure of the second content display device 20. In the example shown in FIG. 1, two second content display devices 20a and 20b are installed as the second content display device 20. The second content display device 20a projects and displays the second content (OK) at a second position P2a on the guide route by the guidance guide based on the first content. The second content is also intended to guide the user to a predetermined action. Here, the "second content (OK)" displays, for example, an arrow indicating the straight-ahead direction as the content for guiding such a predetermined action within the facility when the predetermined action is "go straight."

[0018] The second content display device 20b projects and displays the second content (NG) at a second position P2b midway along a route that deviates from the guidance route according to the guidance using the second content. Here, the "second content (NG)" displays, for example, an "X" indicating that the direction of travel is the wrong direction as content for guiding the user to take a predetermined action within the facility when the predetermined action is "stop."

[0019] The second imaging device 22 is a camera installed so as to capture an image of the second position P2 where the second content is displayed and a range including the periphery thereof. The second imaging device 22 periodically captures and outputs an image of people at the second position P2 and the periphery thereof. There is no limitation on the type, number, and installation location of the second imaging device 22. In the example shown in FIG. 1, two second imaging devices 22a and 22b are installed as the second imaging device 22. The second imaging device 22a is installed so as to capture an image of the second position P2a where the second content (OK) of the second content display device 20a is displayed and a range including the periphery thereof. The second imaging device 22b is installed so as to capture an image of the second position P2b where the second content (NG) of the second content display device 20b is displayed and a range including the periphery thereof. The second imaging devices 22a and 22b may be integral with the second content display devices 20a and 20b, respectively. The image data captured by the second imaging device 22 will be referred to as "second image data" hereinafter. In addition, when distinguishing between the second image data captured by the second imaging devices 22a and 22b, they are hereinafter referred to as "second image data (OK)" and "second image data (NG)". The second image data is not limited to still image data, but may be video data. The second image data is transmitted to the content server 30 via a communication network 8 such as the Internet.

[0020] The content server 30 receives image data periodically captured by the first imaging device 12 and the second imaging device 22. This process is hereinafter referred to as "acquisition process". The content server 30 obtains attribute information and behavior information by analyzing the attributes and behavior of the user based on the acquired image data. This process is hereinafter referred to as "analysis process". Examples of the behavior information here include the gender and age of the user. Examples of the behavior information here include the user's location, stay time, movement direction, etc. In the analysis process, for example, a tracking process technology called Person Re-Identification is used. An example of the tracking process will be described later. Here, a case is illustrated in which the content server 30 analyzes the attributes and behavior of the user based on the acquired image data, but the content server 30 may only have a function of analyzing the behavior of the user.

[0021] Furthermore, the content server 30 judges whether the contents of the displayed content are valid based on the user's behavior analyzed by the analysis process. If the attributes are further analyzed in addition to the user's behavior in the analysis process, the content server 30 may judge whether the contents of the displayed content are valid for each user attribute based on the analyzed user's attributes and behavior. Furthermore, if attribute information of the user targeted by the content is available, the validity of the content may be judged by further taking that information into consideration. This process is hereinafter referred to as "judgment process." Some examples of the judgment process will be described later.

[0022] The content server 30 outputs the result of the judgment process to an external server 4 of the system installer of the display system 100. This process is hereinafter referred to as the "output process." In the output process, the content server 30 may output the result of the judgment process to an external server 6 of a system installer of a display system installed in a facility of the same business type. This allows the system installer of the display system to collect information on the effectiveness of the content displayed in the facility and the factors behind it.

[0023] Furthermore, the content server 30 generates alternative content based on the result of the determination process. This process is hereinafter referred to as "alternative content generation process". The alternative content here is content that is more effective than the first content. For example, in the case of a content that indicates a destination with an arrow, a content with an arrow thicker than the first content may be used as the alternative content. In this case, the alternative content is more useful in the sense that it has higher visibility than the first content. In another example, the alternative content may be one in which the contrast between the arrow part of the first content and the background part is increased. Furthermore, if the arrow as the first content is difficult to understand and is not useful, a guide in text may be used as the alternative content. Japanese or English may be used as the alternative content for the text guide. In the alternative content generation process, a trained model that infers alternative content is used. The trained model here is a model that receives inputs of the first content, the first image data, and the second image data, and outputs the alternative content. The trained model is generated in advance by a model training process. In the model training process, a trained model is generated by machine learning the relationship between the first content, the first image data, and the second image data, and the alternative content whose effectiveness for the user is known. The model training process will be described later.

[0024] The content server 30 reflects the alternative content output from the trained model as new content in the first content display device 10 or the second content display device 20. This process is hereinafter referred to as a "reflection process."

[0025] According to the display system 100 as described above, it is possible to accurately evaluate the effectiveness of the content displayed within the facility for the user, based on the attributes and actions of the user.

[0026] 2. Display system configuration 2 is a block diagram showing an example of a configuration of a display system according to an embodiment. The display system 100 includes the above-mentioned first content display device 10, a first imaging device 12, one or more second content display devices 20, one or more second imaging devices 22, and a content server 30.

[0027] The content server 30 has a function of an information processing device as a computer. The content server 30 is provided in the facility to be controlled. Alternatively, the content server 30 may be provided in a remote location different from the facility to be controlled. As another example, the content server 30 may be realized by a server on the cloud. When the content server 30 is provided in a remote location, the content server 30 transmits and receives data between the first content display device 10, the first imaging device 12, the second content display device 20, and the second imaging device 22 via a communication network 8 such as the Internet.

[0028] The content server 30 includes at least one processor 40 and at least one memory 50. The memory 50 as a storage device stores at least one program 52 executable by the processor 40, a trained model storage unit 54, and various related data 60. The program 52 may be recorded in a computer-readable recording medium. The data 60 stores information on content that can be displayed on the first content display device 10 and the second content display device 20 in advance. The content information here includes the use of the content and its meaning. Examples of the meaning of the content include "destination" for guidance / attention purposes, and "what kind of users are targeted" for advertising purposes.

[0029] The processor 40 executes the program 52 to realize various processes by the processor 40. FIG. 3 is a block diagram showing functions realized by the processor of the content server executing the program. As shown in FIG. 3, the processor 40 includes an acquisition unit 41, an analysis unit 42, a determination unit 43, an alternative content generation unit 44, an output unit 45, a model learning unit 46, and a reflection unit 47. Hereinafter, the functions of the processor 40 will be described with reference to FIG. 1. Note that, although the processor 40 includes the model learning unit 46 here, the model learning unit 46 is not an essential component of the processor 40. That is, the processor 40 may be configured to acquire a trained model from an external system and provide the acquired trained model for processing by the alternative content generation unit 44.

[0030] The acquisition unit 41 is a functional block for performing an acquisition process, in which the acquisition unit 41 acquires first image data and second image data from the first imaging device 12 and the second imaging device 22, respectively.

[0031] The analysis unit 42 is a functional block for performing an analysis process. In the analysis process, the analysis unit 42 estimates attributes of the user, such as gender and age, by performing image analysis process on one or both of the acquired first image data and second image data. At this time, unique ID information may be given to each user, and the estimated attribute information may be linked to the ID information and stored in the data 60 as needed.

[0032] In addition, in the analysis process, behavioral information representing the user's behavior is acquired at any time by a tracking process using the acquired first image data and second image data. In the tracking process, a known tracking process for acquiring the user's behavioral information using image data may be adopted. For example, in the tracking process, the analysis unit 42 uses a technique called Person Re-Identification. In Person Re-Identification, first, a person area containing a person is detected from the input image data. Image information of a person included in the detected person area is hereinafter referred to as "person image data". The detected person image data is input as a search query to a neural network model for Person Re-Identification.

[0033] Further, the neural network model receives template image data of the candidate. The template image data is data in which unique ID information for identification is linked to person image data identified in past image data. In the neural network model, the template image data of the candidate that is most similar to the person image data input as the search query is output as an output result. Furthermore, if there is no template image data of the candidate similar to the person image data, data in which new ID information is linked to the person image data is stored as a part of the new template image data. The analysis unit 42 performs tracking processing by Person Re-Identification on each of the input image data in the time series, and stores the behavioral information of each user in the data 60.

[0034] The determination unit 43 is a functional block for performing a determination process. In the determination process, the determination unit 43 determines whether the details of the first content are valid based on the attribute information and behavior information of the user analyzed by the analysis unit 42.

[0035] FIG. 4 is a diagram for explaining a specific example of the determination process. In the example shown in this figure, three users are present in the area surrounding the first position P1 where the first content is displayed at time T=t1. The attribute information and behavior information of each of the three users are analyzed by the analysis process. In the example shown in FIG. 4, the attributes of the three users are male / elderly, male / child, and female / adult. The first content shows a destination display with an arrow indicating a guide to go straight and then turn right.

[0036] Fig. 5 is a diagram for explaining a first embodiment of the determination process. The first specific example shown in Fig. 5 shows a state in which three users move around the second position P2a where the second content (OK) is displayed at time T=t2 after the state of time T=t1 shown in Fig. 4. The attribute information and behavior information of each of the three users are analyzed by the analysis process.

[0037] In this way, if the analysis process finds that all three users around the first location have moved to the area around the second location P2a, it can be said that the users have moved in the correct direction following the guidance of the first content. In this case, the judgment process judges that the first content is easy to understand for users of any attribute.

[0038] Fig. 6 is a diagram for explaining a second embodiment of the determination process. The second specific example shown in Fig. 6 shows a state in which three users move around the second position P2b where the second content (NG) is displayed at time T=t3 after the state of time T=t1 shown in Fig. 4. The attribute information and behavior information of each of the three users are analyzed by the analysis process.

[0039] In this way, if the analysis process finds that all three users around the first location have moved to the vicinity of the second location P2b, it can be said that the users have moved in the wrong direction without following the guidance of the first content. In this case, the judgment process judges that the first content is difficult for users of any attribute to understand.

[0040] In addition, if the analysis process finds that the user who moved to the area around the second position P2b did not return afterwards, or if the user who moved to the area around the second position P2b stayed there for longer than a predetermined standard stay time, it can be said that the guidance of the user through the second content has failed. In this case, the judgment process finds that the second content (NG) is difficult for users of any attribute to understand.

[0041] Fig. 7 is a diagram for explaining a third specific example of the determination process. The third specific example shown in Fig. 7 shows a state in which, at time T=t4 after the state of time T=t1 shown in Fig. 4, a male / child user moves to the vicinity of the second position P2b where the second content (NG) is displayed, and a male / elderly user and a female / adult user move to the vicinity of the second position P2a where the second content (OK) is displayed. The attribute information and behavior information of these three users are analyzed by the analysis process.

[0042] In this way, if it is analyzed in the analysis process that, among the three users around the first location, only the male / child user has moved to the vicinity of the second location P2b, it can be said that the guidance of the male / child user by the first content has failed. In this case, it is determined in the judgment process that the first content is difficult for the male / child user to understand.

[0043] In addition, if it is analyzed in the analysis process that the male / child user who moved to the vicinity of the second position P2b did not turn back, or if it is analyzed that the male / child user who moved to the vicinity of the second position P2b stayed there for longer than a predetermined reference stay time, it can be said that the guidance of the male / child user by the second content has failed. In the judgment process, it is judged that the second content (NG) is content that is difficult for the male / child user to understand.

[0044] The alternative content generation unit 44 is a functional block for performing an alternative content generation process. In the alternative content generation process, the alternative content generation unit 44 generates alternative content based on a determination result from a determination process. Specifically, in the alternative content generation process, a trained model is used.

[0045] 8 is a functional block diagram showing the internal functions of the alternative content generation unit 44. The alternative content generation unit 44 includes a data acquisition unit 442 and an inference unit 444. The data acquisition unit 442 is a functional block for acquiring input information required to infer alternative content. Examples of the input information include the first content, the first image data, and the second image data. The inference unit 444 is a functional block for outputting alternative content using a trained model stored in the trained model storage unit 54.

[0046] Fig. 9 is a flowchart showing a routine of the alternative content generation process executed in the alternative content generation unit 44. In step S10 of the routine shown in Fig. 9, the data acquisition unit 442 acquires first image data and second image data. In the next step S12, the acquired first image data and second image data are input to the inference unit 444. The inference unit 444 infers alternative content for the content determined to be difficult to understand based on the input judgment result. Then, in step S14, the alternative content inferred by the inference unit 444 is output to the first content display device 10 to be displayed.

[0047] The output unit 45 is a functional block for performing output processing. The output unit 45 outputs the determination result of the determination processing to the external server 4 of the system installer of the display system 100 or the external server 6 of the system installer of a display system installed in a facility of the same business type.

[0048] The model learning unit 46 is a functional block for performing a model learning process in advance. FIG. 10 is an internal block diagram showing the internal functions of the model learning unit. The model learning unit 46 includes a data acquisition unit 462 and a model generation unit 464. The data acquisition unit 462 is a functional block for acquiring learning data. The learning data is data in which an input 1 and an input 2 as a correct answer to the input 1 are associated with each other. For example, the input 1 is a first content, a first image data, and a second image data. An example of the input 2 is an alternative content whose effectiveness for the user is known.

[0049] The model generation unit 464 learns the output for the input according to a learning algorithm. The learning algorithm here is not limited to the above-mentioned supervised learning, and any known learning algorithm such as unsupervised learning, semi-supervised learning, reinforcement learning, etc. Typical examples of the learning algorithm include neural networks, deep learning, genetic programming, functional logic programming, SVM (Support Vector Machine), k-NN (k-nearest neighbor algorithm), etc.

[0050] The reflection unit 47 is a functional block for performing a reflection process. In the reflection process, the reflection unit 47 reflects the alternative content generated in the alternative content generation unit 44 as new content in the first content display device 10 or the second content display device 20 to be displayed.

[0051] 3. Specific processing executed in the display system 11 is a flowchart of a routine executed in the display system of the embodiment. Note that this routine also represents a part of an evaluation method for evaluating the effectiveness of content displayed in the display system 100.

[0052] In step S100, content is displayed on each content device of the display system 100. Specifically, the first content is displayed on the first content display device 10, and the second content is displayed on the second content display device 20.

[0053] In step S102, information on each piece of content currently being displayed is acquired by the content server 30. Here, the content server 30 reads out from the data 60 in the memory 50 the content information corresponding to each piece of content currently being displayed.

[0054] In step S104, image data captured by the first imaging device 12 and the second imaging device 22 is transmitted to the content server 30. In step S106, user attribute information and behavior information in the image data is acquired by analysis processing. In step S108, whether the displayed first content and second content are valid is determined by judgment processing. As a result, if it is determined that the first content and the second content are valid, this routine is terminated, and if it is determined that either the first content or the second content is invalid, the process proceeds to step S110.

[0055] In step S110, the determination result of the determination process is presented to the external server 4 of the system installer of the display system 100. In step S112, alternative content is generated by an alternative content generation process for the content determined to be invalid in step S108. In step S114, it is determined whether or not to replace the content with alternative content. Here, it is determined, for example, whether or not a command to replace with alternative content has been received from the system installer. As a result, if the determination is not established, this routine is terminated, and if the determination is established, the process proceeds to step S116.

[0056] In step S116, the content determined to be invalid in step S108 is replaced with the alternative content generated in step S112.

[0057] According to the display system 100 described above, it is possible to accurately evaluate the effectiveness of the content displayed in the facility for users. Also, if the displayed content is not effective, it is possible to generate alternative content based on the learning data and replace it.

[0058] 3. Variations The display system 100 of this embodiment may employ the following modified aspects.

[0059] 3-1.Hardware resources of information processing devices

[0060] Fig. 12 is a diagram showing a modified example of the hardware resources of a content server as an information processing device. In the example shown in Fig. 12, the content server 30 as an information processing device includes, for example, a processor 40, a memory 50, and a processing circuit 72 including dedicated hardware 70. Fig. 12 shows an example in which a part of the functions of the content server 30 is realized by the dedicated hardware 70. All of the functions of the content server 30 may be realized by the dedicated hardware 70. As the dedicated hardware 70, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these can be adopted.

[0061] 3-2. Functional layout of the content server 30 Some of the functions of the content server 30 may be installed in other devices such as the first content display device 10, the second content display device 20, the first imaging device 12, the second imaging device 22, etc.

[0062] 3-3. Model learning process The model learning unit 46 may receive input of information such as a user's age, sex, behavior, and duration of stay, and generate a trained model that can generate alternative content by taking the information into consideration. In this case, the data acquisition unit 442 acquires information related to the user's age, sex, behavior, duration of stay, and the like, such as user attribute information, behavior information, and congestion level, in addition to the first content, the first image data, and the second image data. Then, the inference unit 444 uses the acquired information as input to infer alternative content using the trained model.

[0063] 3-4. Decision-making process The determination process performed by the determination unit 43 is not limited to determining the validity of the first content, and may also determine the validity of the second content. In this case, the determination unit 43 can determine the validity of the second content based on, for example, behavioral information of the user analyzed from the second image data, or behavioral information and attribute information.

[0064] Furthermore, at least one of the first content and the second content may be provided to induce behavior for a specific attribute. Specifically, the information of the first content stored in the first content display device 10 may include attribute information of a target user, and the determination unit 43 may determine the effectiveness of displaying the first content based on the attribute information of the target user. Similarly, the information of the second content stored in the second content display device 20 may include attribute information of a target user, and the determination unit 43 may determine the effectiveness of displaying the second content based on the attribute information of the target user. In this case, it is possible to more accurately evaluate the effectiveness of the content displayed in the facility for users with a specific attribute.

[0065] 4.Other Although the preferred embodiments have been described in detail above, the present disclosure is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the claims.

[0066] Various aspects of the present disclosure are summarized below as appendices.

[0067] (Appendix 1) a first content display device that displays a first content for guiding a user to take a predetermined action at a first position within a facility; a first imaging device that outputs first image data obtained by imaging the user around the first position; a second imaging device that outputs second image data obtained by imaging the user in the vicinity of a second location different from the first location within the facility; a content server including an analysis unit that analyzes the behavior of the user based on the first image data and the second image data, and a judgment unit that judges the validity of displaying the first content based on the behavior of the user analyzed by the analysis unit; A display system comprising: (Appendix 2) The content server, The display device further includes an alternative content generating unit that generates an alternative content to be displayed at the first position in place of the first content when the determining unit determines that the display of the first content is invalid. 2. A display system as described in claim 1. (Appendix 3) A trained model is generated in advance by learning the relationship between the first content, the first image data, and the second image data, and the alternative content; The alternative content generation unit a data acquisition unit that acquires the first content, the first image data, and the second image data; an inference unit that uses the trained model to output the alternative content based on the first image data, the second image data, and the first content acquired by the data acquisition unit. 10. A display system as described in claim 2. (Appendix 4) The analysis unit is further analyzing attributes of a user based on at least one or both of the first image data and the second image data; The determination unit determines the effectiveness of displaying the first content based on the attributes and behavior of the user analyzed by the analysis unit. The display system according to any one of claims 1 to 3, configured as follows: (Appendix 5) the information on the first content stored in the first content display device includes attribute information of a target user; The determination unit determines the validity of displaying the first content based on attribute information of the target user. 5. The display system of claim 4, configured as follows: (Appendix 6) a second content display device that displays a second content at the second position for inducing a predetermined action by the user; The analysis unit is The system is configured to analyze attributes of a user based on at least one or both of the first image data and the second image data; A display system as described in any one of Supplementary Note 1 to Supplementary Note 5, wherein the judgment unit judges the effectiveness of displaying the second content based on the attributes and behavior of the user analyzed by the analysis unit. (Appendix 7) the information on the second content stored in the second content display device includes attribute information of a target user; The display system according to claim 6, wherein the determination unit determines the validity of displaying the second content based on attribute information of the target user. (Appendix 8) The content server, The display system according to any one of claims 1 to 7, further comprising an output unit that outputs the validity judgment result judged by the judgment unit to an external server. (Appendix 9) An information processing device that determines effectiveness of a first content that is displayed to a user at a first location in a facility and that guides the user to take a predetermined action, At least one processor; a memory having at least one program stored therein; The at least one processor executes the at least one program to an acquisition process for acquiring first image data of the user in the vicinity of the first position and second image data of the user in the vicinity of a second position different from the first position within the facility; an analysis process of analyzing the behavior of the user based on the first image data and the second image data; a determination process for determining the validity of displaying the first content based on the behavior of the user analyzed by the analysis process; An information processing device configured to execute the above. (Appendix 10) 1. A method for evaluating effectiveness of a first content displayed to a user at a first location in a facility for inducing a predetermined action by the user, comprising: acquiring first image data of the user in the vicinity of the first location and second image data of the user in the vicinity of a second location different from the first location in the facility; an analysis step of analyzing a behavior of the user based on the first image data and the second image data; a determination step of determining the validity of displaying the first content based on the behavior of the user analyzed by the analysis step; An evaluation method comprising: (Appendix 11) A computer-readable recording medium having a program recorded thereon that causes a computer to execute a process of determining the effectiveness of a first content that is displayed to a user at a first location in a facility and that guides the user to take an action, The program is acquiring first image data of the user in the vicinity of the first location and second image data of the user in the vicinity of a second location in the facility that is different from the first location; Analyzing the behavior of the user based on the first image data and the second image data; Determining the effectiveness of displaying the first content based on the analyzed user behavior. Make the computer do something A computer-readable recording medium configured to: [Explanation of symbols]

[0068] 4,6 external server, 8 communication network, 10 first content display device, 12 first imaging device, 20,20a,20b second content display device, 22,22a,22b second imaging device, 30 content server, 40 processor, 41 acquisition unit, 42 analysis unit, 43 judgment unit, 44 alternative content generation unit, 45 output unit, 46 model learning unit, 47 reflection unit, 50 memory, 52 program, 54 trained model storage unit, 60 data, 70 dedicated hardware, 72 processing circuit, 100 display system, 442 data acquisition unit, 444 inference unit, 462 data acquisition unit, 464 model generation unit

Claims

1. a first content display device that displays a first content for guiding a user to take a predetermined action at a first position within a facility; a first imaging device that outputs first image data obtained by imaging the user around the first position; a second imaging device that outputs second image data obtained by imaging the user in the vicinity of a second location different from the first location within the facility; a content server including an analysis unit that analyzes the behavior of the user based on the first image data and the second image data, and a judgment unit that judges the validity of displaying the first content based on the behavior of the user analyzed by the analysis unit; A display system comprising:

2. The content server includes: The display device further includes an alternative content generating unit that generates an alternative content to be displayed at the first position in place of the first content when the determining unit determines that the display of the first content is invalid. The display system of claim 1 .

3. A trained model is generated in advance by learning the relationship between the first content, the first image data, and the second image data, and the alternative content; The alternative content generation unit a data acquisition unit that acquires the first content, the first image data, and the second image data; an inference unit that uses the trained model to output the alternative content based on the first image data, the second image data, and the first content acquired by the data acquisition unit. The display system of claim 2 .

4. The analysis unit is further analyzing attributes of a user based on at least one or both of the first image data and the second image data; The determination unit determines the effectiveness of displaying the first content based on the attributes and behavior of the user analyzed by the analysis unit. The display system according to any one of claims 1 to 3, configured as follows:

5. the information on the first content stored in the first content display device includes attribute information of a target user; The determination unit determines the validity of displaying the first content based on attribute information of the target user.

5. The display system according to claim 4, configured so as to:

6. a second content display device that displays a second content at the second position for inducing a predetermined action by the user; The analysis unit is The system is configured to analyze attributes of a user based on at least one or both of the first image data and the second image data; The display system according to claim 1 , wherein the determination unit determines the effectiveness of displaying the second content based on the attributes and behavior of the user analyzed by the analysis unit.

7. the information on the second content stored in the second content display device includes attribute information of a target user; The display system according to claim 6 , wherein the determination unit determines the validity of displaying the second content based on attribute information of the target user.

8. The content server includes: The display system according to claim 1 , further comprising an output unit that outputs the result of the validity judged by the judger to an external server.

9. An information processing device that determines effectiveness of a first content that is displayed to a user at a first location in a facility and that guides the user to take a predetermined action, At least one processor; A memory having at least one program stored therein, The at least one processor executes the at least one program to an acquisition process for acquiring first image data of the user in the vicinity of the first position and second image data of the user in the vicinity of a second position different from the first position within the facility; an analysis process of analyzing the behavior of the user based on the first image data and the second image data; a determination process for determining the validity of displaying the first content based on the behavior of the user analyzed by the analysis process; An information processing device configured to execute the above.

10. 1. A method for evaluating effectiveness of a first content displayed to a user at a first location in a facility for inducing a predetermined action by the user, comprising: acquiring first image data of the user in the vicinity of the first location and second image data of the user in the vicinity of a second location different from the first location within the facility; an analysis step of analyzing a behavior of the user based on the first image data and the second image data; a determination step of determining the validity of displaying the first content based on the behavior of the user analyzed by the analysis step; The evaluation method includes:

11. A computer-readable recording medium having recorded thereon a program for causing a computer to execute a process of determining the effectiveness of a first content that is displayed to a user at a first location in a facility and that induces the user to take a predetermined action, The program is acquiring first image data of the user in the vicinity of the first location and second image data of the user in the vicinity of a second location in the facility that is different from the first location; Analyzing the behavior of the user based on the first image data and the second image data; Determining the effectiveness of displaying the first content based on the analyzed user behavior. Make the computer do something A computer-readable recording medium configured to:

Citation Information

Patent Citations

  • Information display method and system

    JP2004110377A

  • Guiding system, server, program, and service providing method

    JP2021103420A

  • Reproduction schedule creation device and reproduction schedule creation method

    JP2021131816A

  • Recommendation control system

    JP2023032032A

  • Advertisement evaluation system

    JP2023066306A