Information processing apparatus, information processing method, and information processing system

Abstract

When at least a first person and a second person are included in a captured image, an information processing device selects a second classification determined by a determination unit for an attribute of the second person when a first determination and a second determination are performed. The first determination and determination unit determines that the display performance of a first advertisement, which is an advertisement corresponding to a first classification determined with respect to the attribute of a first person, exceeds a first reference value, which is a reference value corresponding to the first classification. The second determination determines that the display performance of a second advertisement, which is an advertisement corresponding to the second classification, does not exceed a second reference value, which is a reference value corresponding to the second classification.

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing method and an information processing system. Background Art

[0002] Research and development of technology for displaying advertisements on display devices is ongoing.

[0003] In this regard, an information processing device is known, comprising: a necessary display count acquisition unit, which acquires necessary display count information related to the number of times specified content data should be displayed by a specified display device within a displayable period of the specified content data; a display performance count acquisition unit, which acquires display performance count information related to the number of times specified content data has been displayed by a specified display device from the displayable period to the current time point; a display scheduled count determination unit, which determines the display scheduled number of times the specified content data should be displayed by the specified display device in any period after the current time point within the displayable period based on the displayable period, the necessary display count information, and the display performance count information; a display time period acquisition unit, which acquires display time period information related to the time period in which the specified content data can be displayed by the specified display device; and a display start time determination unit, which determines the display start time for displaying the content data on the specified display device (refer to patent document 1).

[0004] [Prior art literature]

[0005] [Patent Document]

[0006] Patent Document 1: Japanese Patent Application Publication No. 2010-087836 Summary of the invention

[0007] [Problems to be Solved by the Invention]

[0008] Here, in the information processing device described in Patent Document 1, it is possible to suppress the situation where only specific content data is displayed on the display device. That is, the information processing device can suppress the situation where the increase of display performance (for example, cumulative display times, display ratio, cumulative display time, etc.) on the display device is biased toward specific content data. However, sometimes the information processing device causes the display device to display content data with attributes that are not suitable for viewers who watch the content data displayed on the display device. That is, it is difficult for the information processing device to balance the situation where the increase of display performance is suppressed to be biased toward specific content data and the situation where content data with attributes that are suitable for viewers is displayed.

[0009] The present invention was completed in consideration of such a situation, and its object is to provide an information processing device, an information processing method and an information processing system that can suppress the situation where the increase in display performance is biased towards specific advertisements and display advertisements corresponding to the attributes of the viewer on a display device.

[0010] [Methods for solving the problem]

[0011] An information processing device according to one embodiment of the present invention comprises: an acquisition unit for acquiring a captured image obtained by capturing a captured area including a position where a display screen of a display device can be visually recognized; a storage unit for storing a reference value corresponding to each of a plurality of classifications predetermined for attributes of viewers of an advertisement displayed on the display screen; a determination unit for determining which of the plurality of classifications the attributes of a person included in the captured image match; a selection unit for selecting one of the plurality of classifications based at least on display performance of the advertisement and a determination result of the determination unit; and a display control unit for causing the display screen to display a value corresponding to the selected classification. Regarding the advertisement corresponding to the classification selected by the selection unit, when the captured image includes at least a first person and a second person, the selection unit selects the second classification determined by the determination unit with respect to the attribute of the second person when performing a first determination and a second determination, the first determination determining that the display performance of the advertisement corresponding to the first classification determined by the determination unit with respect to the attribute of the first person, i.e., the first advertisement, exceeds the benchmark value corresponding to the first classification, i.e., the first benchmark value, and the second determination determining that the display performance of the advertisement corresponding to the second classification, i.e., the second advertisement, does not exceed the benchmark value corresponding to the second classification, i.e., the second benchmark value.

[0012] An information processing method according to one embodiment of the present invention comprises: an acquisition step of acquiring a captured image obtained by capturing a captured area including a position where a display screen of a display device can be visually recognized; a determination unit of determining which of a plurality of categories predetermined for attributes of viewers of an advertisement displayed on the display screen an attribute of a person included in the captured image corresponds to; a selection step of selecting one of the plurality of categories based at least on display performance of the advertisement and a determination result of the determination unit; and a display control step of causing the display screen to display the advertisement corresponding to the category selected by the selection step, and selecting the advertisement in the captured image. When the image includes at least a first person and a second person, the selection step selects the second category determined by the determination unit with respect to the attribute of the second person when a first judgment and a second judgment are performed, the first judgment determines that the display performance of the advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person, i.e., the first advertisement, exceeds the benchmark value corresponding to the first category among the benchmark values ​​corresponding to each of the multiple categories, i.e., the first benchmark value, and the second judgment determines that the display performance of the advertisement corresponding to the second category, i.e., the second advertisement, does not exceed the benchmark value corresponding to the second category, i.e., the second benchmark value.

[0013] An information processing system according to one embodiment of the present invention comprises a photographing unit and an information processing device, wherein the photographing unit photographs a photographing area including a position where a display screen of a display device can be visually identified, wherein the information processing device comprises: an acquisition unit that acquires a photographed image photographed by the photographing unit; a storage unit that stores a reference value corresponding to each of a plurality of classifications predetermined for attributes of viewers of an advertisement displayed on the display screen; a determination unit that determines which of the plurality of classifications the attributes of a person included in the photographed image match; a selection unit that selects one of the plurality of classifications based at least on display performance of the advertisement and a determination result of the determination unit; and a display control unit. , causing the display screen to display the advertisement corresponding to the category selected by the selection unit, and when the captured image includes at least a first person and a second person, the selection unit selects the second category determined by the determination unit based on the attribute of the second person when performing a first determination and a second determination, the first determination determining that the display performance of the advertisement corresponding to the first category determined by the determination unit based on the attribute of the first person, i.e., the first advertisement, exceeds the benchmark value corresponding to the first category, i.e., the first benchmark value, and the second determination determining that the display performance of the advertisement corresponding to the second category, i.e., the second advertisement, does not exceed the benchmark value corresponding to the second category, i.e., the second benchmark value.

[0014] [Effects of the invention]

[0015] According to the present invention, it is possible to suppress the increase in display performance from being biased toward a specific advertisement, and to display an advertisement corresponding to the attributes of the viewer on the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a diagram showing an example of the configuration of the information processing system 1 .

[0017] Figure 2 It is a diagram showing an example of the hardware configuration of the information processing device 30 .

[0018] Figure 3 It is a diagram showing an example of the functional configuration of the information processing device 30 .

[0019] Figure 4 1 is a diagram showing an example of a flow of processing in which the information processing device 30 obtains a result of totaling the attributes of each of a plurality of persons photographed by the imaging unit 20 in a first time zone within a target period.

[0020] Figure 5 1 is a diagram showing an example of a flow of processing in which the information processing device 30 determines a reference value in the first time zone based on the human identification information.

[0021] Figure 6 1 is a diagram showing an example of a flow of processing in which the information processing device 30 causes the display device 10 to display an advertisement in the first time period within the advertisement display period.

[0022] Figure 7 This is a diagram showing an example of a situation where two people are located in the imaging area RA. DETAILED DESCRIPTION

[0023] <Implementation Method>

[0024] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0025] <Overview of Information Processing System>

[0026] First, the overview of the information processing system according to the present embodiment will be described.

[0027] The information processing system of the present embodiment includes a shooting unit and an information processing device. The shooting unit shoots a shooting area including a position of a display screen where a display device can be visually identified. The information processing device includes an acquisition unit, a storage unit, a determination unit, a selection unit, and a display control unit. The acquisition unit acquires a captured image captured by the shooting unit. The storage unit stores reference values ​​corresponding to a plurality of categories predetermined for the attributes of viewers of advertisements displayed on the display screen. The determination unit determines which of the plurality of categories the attributes of the person included in the captured image match. The selection unit selects one of the plurality of categories based at least on the display performance of the advertisement and the determination result of the determination unit. The display control unit displays the advertisement corresponding to the category selected by the selection unit on the display screen. Furthermore, when the captured image includes at least a first person and a second person, the selection unit selects the second category determined by the determination unit with respect to the attribute of the second person when performing a first determination and a second determination, wherein the first determination determines that a display performance of the first advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds a benchmark value corresponding to the first category, i.e., a first benchmark value, and the second determination determines that a display performance of the second advertisement corresponding to the second category does not exceed a benchmark value corresponding to the second category, i.e., a second benchmark value.

[0028] Thus, the information processing system according to the embodiment and the information processing device included in the information processing system can suppress the increase in display performance from being biased toward a specific advertisement, and can display an advertisement corresponding to the attribute of the viewer on the display device.

[0029] Hereinafter, the configuration of the information processing system according to the embodiment, the configuration of the information processing device included in the information processing system, and the processing performed by the information processing device will be described in detail.

[0030] <Structure of Information Processing System>

[0031] Hereinafter, as an example of the information processing system according to the embodiment, the configuration of the information processing system according to the embodiment will be described by taking the information processing system 1 as an example.

[0032] In addition, as an example, the following describes a case where the display performance of an advertisement is the display ratio of the advertisement. The details of the display ratio of an advertisement will be described later. In addition, the display performance of an advertisement can be the cumulative number of times the advertisement is displayed, or the cumulative display time of the advertisement, or other types of values ​​that represent the display performance of the advertisement. In addition, as an example, the following describes a case where an advertisement is composed of a dynamic image. And, hereinafter, for the sake of convenience, the dynamic image that constitutes a certain advertisement will be referred to as the dynamic image of the advertisement for explanation. In addition, an advertisement can be composed of both a dynamic image and sound, or it can be composed of a still image, or it can be composed of both a still image and sound, or it can be composed of sound.

[0033] Figure 1 It is a diagram showing an example of the configuration of the information processing system 1 .

[0034] The information processing system 1 displays an advertisement during a predetermined advertisement display period. The advertisement display period is, for example, one week, but may alternatively be a period shorter than one week or a period longer than one week. Furthermore, the information processing system 1 photographs viewers who watch the advertisement during the advertisement display period, and detects attributes of the viewers based on the photographed images. Furthermore, during the advertisement display period, the information processing system 1 selects an advertisement corresponding to the detected attributes from a plurality of advertisements, and displays the selected advertisement. Thus, the information processing system 1 can display advertisements corresponding to the attributes of the viewers on the display device. As a result, the information processing system 1 can improve the promotional effect of the advertisements during the advertisement display period.

[0035] Here, the information processing system 1 selects an advertisement corresponding to the detected attribute from a plurality of advertisements based on the display performance of each of the plurality of advertisements and a predetermined reference value for the display performance of each of the plurality of advertisements. Thus, the information processing system 1 can preferentially select an advertisement whose display performance does not exceed the reference value from among the plurality of advertisements. To achieve this, the reference value is predetermined for each time period and is determined in a manner that does not cause deviations in the display performance of each of the plurality of advertisements. Thus, the information processing system 1 can suppress the situation where the increase in display performance in each time period during the advertisement display period is biased toward a specific advertisement. In addition, the reference value may be a common value for all time periods instead of a structure predetermined for each time period.

[0036] The information processing system 1 includes, for example, a display device 10, a camera 20, and an information processing device 30. In addition to the display device 10, the camera 20, and the information processing device 30, the information processing system 1 may also be a structure including other components, other devices, and the like. In addition, the information processing system 1 may also be a structure not including the display device 10. In this case, the information processing system 1 is communicatively connected to an external display device. In addition, the information processing system 1 may also be a structure not including the camera 20. In this case, the information processing system 1 is communicatively connected to an external camera.

[0037] The display device 10 is, for example, a display device including a display panel such as a liquid crystal display panel, an organic EL (Electro Luminescence) display panel, etc. as a display screen of the display device 10. The display device 10 is connected to the information processing device 30 so as to be communicable wirelessly or by wire. The display device 10 obtains an advertisement output from the information processing device 30. The display device 10 displays the advertisement obtained from the information processing device 30 on the display screen. In addition, the display device 10 may be a structure having a speaker or a structure not having a speaker. For example, in the case where the advertisement is composed of both a dynamic image and sound, the display device 10 has a speaker.

[0038] The imaging unit 20 is a camera having a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) as an imaging element for converting the focused light into an electrical signal. The imaging unit 20 is disposed at a position where it can capture an imaging area RA including a position where the display screen of the display device 10 can be visually recognized. Figure 1 In the example shown, the imaging unit 20 is integrally formed with the display device 10, and is disposed above the display screen on the surface of the display device 10 on which the display screen is disposed. Alternatively, the imaging unit 20 may be formed separately from the display device 10. Here, Figure 1 The shaded area in represents an example of the shooting area RA. The shooting unit 20 may be a structure that shoots a still image of the range that the shooting unit 20 can shoot, or a structure that shoots a dynamic image of the range. As an example, the following describes a case where the shooting unit 20 shoots a dynamic image of the range. The shooting unit 20 is connected to the information processing device 30 so as to be communicable wirelessly or by wire. The shooting unit 20 sequentially outputs the frames of the dynamic image shot by the shooting unit 20 to the information processing device 30 as shot images.

[0039] The information processing device 30 is, for example, a notebook PC (Personal Computer), a desktop PC, a workstation, a tablet PC, a multi-function mobile phone terminal (smartphone), a PDA (Personal Digital Assistant) or other information processing devices, but is not limited thereto.

[0040] The information processing device 30 determines the above-mentioned advertisement display period according to the accepted operation. The advertisement display period is, for example, one week. In addition, the advertisement display period can be a period shorter than one week or a period longer than one week. In addition, the advertisement display period can also be a predetermined period.

[0041] The information processing device 30 performs the advertisement display process described below during the determined advertisement display period.

[0042] The information processing device 30 acquires the image captured by the image capturing unit 20 from the image capturing unit 20 every time a predetermined sampling period elapses. Furthermore, every time the information processing device 30 acquires the image captured, it determines the number of persons included in the acquired image.

[0043] When the information processing device 30 determines that the number of people included in the acquired captured image is one person (that is, when the number of people located in the captured area RA is determined to be one person), it determines which of the multiple categories predetermined for the attributes of the viewers of the advertisement displayed on the display screen of the display device 10 the attributes of the people included in the captured image match. Hereinafter, for the sake of convenience, this determination will be referred to as classification determination. In addition, in the following, for the sake of convenience, the classification obtained as a result of the classification determination will be referred to as object classification. In addition, as an example, the following will describe a case where these multiple classifications are four categories, namely, category X1 to category X4, which are described below. These four categories are the following categories. Category X1: Men in their 20s to 50s Category X2: Women in their 20s to 50s Category X3: Men and women over 60 years old Category X4: Males and females in their teens

[0044] Thus, these four categories are based on both age and gender. In addition, in the above-mentioned multiple categories, it is also possible to have a structure that replaces part or all of these four categories, or includes other categories in addition to part or all of these four categories. In addition, these four categories may also be based on either age or gender. In addition, these four categories may also be based on attributes of a different type from age and gender.

[0045] In addition, these four categories correspond to different advertisements. Therefore, in the following, for the convenience of explanation, the advertisement corresponding to the category X1 is referred to as advertisement C1 for explanation. Advertisement C1 is an advertisement that is inferred to obtain a sales promotion effect by making people who meet the attributes of the category X1 watch it (that is, an advertisement suitable for people who meet the attributes of the category X1). In addition, in the following, for the convenience of explanation, the advertisement corresponding to the category X2 is referred to as advertisement C2 for explanation. Advertisement C2 is an advertisement that is inferred to obtain a sales promotion effect by making people who meet the attributes of the category X2 watch it (that is, an advertisement suitable for people who meet the attributes of the category X2). In addition, in the following, for the convenience of explanation, the advertisement corresponding to the category X3 is referred to as advertisement C3 for explanation. Advertisement C3 is an advertisement that is inferred to obtain a sales promotion effect by making people who meet the attributes of the category X3 watch it (that is, an advertisement suitable for people who meet the attributes of the category X3). In addition, in the following, for the convenience of explanation, the advertisement corresponding to the category X4 is referred to as advertisement C4 for explanation. Advertisement C4 is an advertisement that is inferred to achieve a sales promotion effect by being viewed by people who match the attributes of category X4 (i.e., an advertisement suitable for people who match the attributes of category X4). In addition, hereinafter, for the sake of convenience of explanation, among the four advertisements of advertisements C1 to C4, the advertisement corresponding to the target category selected by the information processing device 30 is referred to as a target advertisement.

[0046] After selecting the object classification, the information processing device 30 outputs the object advertisement corresponding to the selected object classification to the display device 10 and causes the display device 10 to display the object advertisement.

[0047] On the other hand, when the information processing device 30 determines that the number of people included in the captured image is N (that is, when the number of people located in the capturing area RA is N), the information processing device 30 sorts these N people based on a predetermined arrangement rule. Here, N can be any integer as long as it is an integer greater than 2. The arrangement rule is, for example, to sort the N people in the order of proximity to the display device 10. In the following, for the sake of convenience, the nth person among the sorted N people is referred to as the nth person for explanation. In this case, the nth person is a person photographed by the shooting unit 20 at a position closer to the display device 10 than the n+1th person. Among them, n is any integer greater than 1 and less than N. In addition, the arrangement rule may be to sort the N people randomly, or to sort the N people in order away from the display device 10, or to sort the N people in order from high to low in terms of the degree of their faces facing the display device 10, or other rules that can sort the N people. In addition, the arrangement rule may also be a combination of these rules. In this case, the arrangement rule may be, for example, a case where N persons are arranged in descending order of the degree of proximity to the display device 10 and the orientation of their faces toward the display device 10. After the information processing device 30 has arranged the N persons based on the arrangement rule, it performs the above-mentioned classification determination one by one from the first person to the nth person. Then, each time the information processing device 30 performs such a classification determination, it performs a reference value determination. The reference value determination is a determination of whether the current display performance of the object advertisement corresponding to the object classification obtained as a result of the classification determination exceeds the reference value for the display performance.

[0048] Here, the information processing device 30 determines the time period including the current time in the reference value determination. Hereinafter, as an example, a case where the 24 hours of each day included in the advertisement display period are divided into four time periods, namely, a first time period of 00:00 to 08:59, a second time period of 09:00 to 11:59, a third time period of 12:00 to 16:59, and a fourth time period of 17:00 to 23:59 will be described. In addition, in the following, for the sake of convenience, the time period determined as the time period including the current time in the reference value determination among these four time periods will be referred to as the target time period for description.

[0049] The information processing device 30 calculates the display performance of the target advertisement in the target time period during the advertisement display period. The display performance of the target advertisement in this example is, as described above, the display ratio of the target advertisement. In this case, the display performance of the target advertisement in the target time period during the advertisement display period is, for example, the ratio obtained by dividing the total of the cumulative display time of each of the advertisements C1 to C4 in the target time period during the period from the beginning of the advertisement display period to the present by the cumulative display time of the target advertisement in the target time period during the period from the beginning of the advertisement display period to the present. In addition, the display performance of the target advertisement may be replaced by the cumulative display time of the target advertisement in the target time period during the period from the beginning of the advertisement display period to the present, the cumulative number of displays of the target advertisement in the target time period during the period from the beginning of the advertisement display period to the present, or other types of values ​​indicating the display performance of the target advertisement in the target time period during the period from the beginning of the advertisement display period to the present.

[0050] In addition, in the information processing device 30, reference values ​​corresponding to the four categories X1 to X4 are stored in each of the above-mentioned four time periods. In the following, for the sake of convenience, the reference value corresponding to the category X1 is referred to as reference value T1 for explanation. In the following, for the sake of convenience, the reference value corresponding to the category X2 is referred to as reference value T2 for explanation. In the following, for the sake of convenience, the reference value corresponding to the category X3 is referred to as reference value T3 for explanation. In the following, for the sake of convenience, the reference value corresponding to the category X4 is referred to as reference value T4 for explanation. These four reference values ​​T1 to reference value T4 are values ​​that serve as references for the display performance of the four advertisements C1 to C4. Specifically, reference value T1 is a value that serves as a reference for the display performance of advertisement C1. In addition, reference value T2 is a value that serves as a reference for the display performance of advertisement C2. In addition, reference value T3 is a value that serves as a reference for the display performance of advertisement C3. Furthermore, the reference value T4 is a value that serves as a reference for the display performance of the advertisement C4.

[0051] These four reference values ​​are determined in such a way that the display performance of each of the four advertisements, Advertisement C1 to Advertisement C4, is within the reference value so that the increase in display performance does not favor any one of the four advertisements. In addition, these four reference values ​​may be determined by the information processing device 30, by an information processing device other than the information processing device 30, by a user of the information processing device 30, or by other methods. A specific example of the method for determining these four reference values ​​will be described later.

[0052] In the aforementioned reference value determination, after calculating the display performance of the target advertisement, the information processing device 30 selects a reference value corresponding to the target classification obtained as a result of the classification determination from the four reference values ​​of reference value T1 to reference value T4 in the determined target time period as the target reference value. Then, in the reference value determination, the information processing device 30 determines whether the calculated display performance of the target advertisement exceeds the selected target reference value. When it is determined that the calculated display performance of the target advertisement exceeds the selected target reference value, the information processing device 30 performs classification determination and reference value determination on the person ranked next among the N persons ranked based on the arrangement rule. Thus, the information processing device 30 can suppress the situation in which the display device 10 displays the target advertisement whose display performance exceeds the target reference value in the target time period within the advertisement display period. As a result, the information processing device 30 can suppress the situation in which the increase of the display performance in the target time period within the advertisement display period is biased toward one of the advertisements C1 to C4. On the other hand, when it is determined that the calculated display performance of the target advertisement does not exceed the selected target reference value, the information processing device 30 does not classify the person ranked next among the N persons ranked based on the arrangement rule, but outputs the target advertisement to the display device 10, causing the display device 10 to display the target advertisement. Thus, the information processing device 30 can cause the display device 10 to display an advertisement suitable for a person who meets the attributes of the target classification in this case.

[0053] In this way, when it is determined that the number of people included in the acquired captured image is N, the information processing device 30 repeats the classification determination and the reference value determination from the first person to the Nth person in sequence until it is determined that the calculated display performance of the target advertisement does not exceed the selected target reference value. Furthermore, when it is determined that the calculated display performance of the target advertisement does not exceed the selected target reference value, the information processing device 30 outputs the target advertisement at that time point to the display device 10, and causes the display device 10 to display the target advertisement. As a result, the information processing device 30 can suppress the situation where the increase in display performance is biased toward one of the advertisements C1 to C4, and can display the advertisement corresponding to the attribute of the viewer of the advertisement displayed on the display device 10 on the display device 10.

[0054] On the other hand, when the information processing device 30 determines that the number of people included in the acquired captured image is 0 (i.e., when the number of people located in the captured area RA is 0), the information processing device 30 also determines the time period including the current moment as the target time period. Then, the information processing device 30 calculates the display performance of the target advertisement in the target time period within the advertisement display period. Thereafter, the information processing device 30 selects the category corresponding to the advertisement C1 to C4 whose display performance in the target time period from the start of the advertisement display period to the present is the largest below the reference value (i.e., the difference between the display performance and the reference value) as the target category. Specifically, in this case, the information processing device 30 selects the following classification as the target classification, which is the classification corresponding to the advertisement corresponding to the largest value among the degree to which the display performance of the advertisement C1 in the target time period from the start of the advertisement display period to the present is lower than the reference value T1, the degree to which the display performance of the advertisement C2 in the target time period from the start of the advertisement display period to the present is lower than the reference value T2, the degree to which the display performance of the advertisement C3 in the target time period from the start of the advertisement display period to the present is lower than the reference value T3, and the degree to which the display performance of the advertisement C4 in the target time period from the start of the advertisement display period to the present is lower than the reference value T4. Then, the information processing device 30 outputs the advertisement corresponding to the selected target classification to the display device 10 as the target advertisement, and causes the display device 10 to display the target advertisement. In addition, in this case, the information processing device 30 may also adopt a configuration in which advertisements other than the four advertisements of advertisements C1 to C4 are selected as the target advertisements, and the display device 10 displays the selected target advertisements.

[0055] Information processing device 30 may be configured to store part or all of advertisements C1 to C4 or to obtain part or all of advertisements C1 to C4 from another device (eg, a server).

[0056] <Hardware Configuration of Information Processing Device>

[0057] Below, refer to Figure 2 , the hardware structure of the information processing device 30 is described. Figure 2 It is a diagram showing an example of the hardware configuration of the information processing device 30 .

[0058] The information processing device 30 includes, for example, a processor 31, a storage unit 32, an input receiving unit 33, a communication unit 34, and a display unit 35. These components are connected via a bus so as to be able to communicate with each other. In addition, the information processing device 30 communicates with the display device 10, the imaging unit 20, etc. via the communication unit 34.

[0059] The processor 31 is, for example, a CPU (Central Processing Unit). Alternatively, the processor 31 may be another processor such as an FPGA (Field Programmable Gate Array) instead of a CPU. The processor 31 executes various programs stored in the storage unit 32 .

[0060] The storage unit 32 includes, for example, a HDD (Hard Disk Drive), an SSD (Solid State Drive), an EEPROM (Electrically Erasable Programmable Read Only Memory), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. In addition, the storage unit 32 may be an external storage device connected via a digital input / output port such as a USB (Universal Serial Bus) instead of a storage device built into the information processing device 30. The storage unit 32 stores various information, various programs, various images, etc. processed by the information processing device 30.

[0061] The input receiving unit 33 is, for example, an input device such as a keyboard, a mouse, or a touch pad. Alternatively, the input receiving unit 33 may be a touch panel integrally formed with the display unit 35 .

[0062] The communication unit 34 is configured to include, for example, a digital input / output port such as a USB, an Ethernet (registered trademark) port, an antenna for communication, and the like.

[0063] The display unit 35 is a display device including a display panel such as a liquid crystal display panel or an organic EL display panel.

[0064] <Functional Structure of Information Processing Device>

[0065] Below, refer to Figure 3 , the functional structure of the information processing device 30 is explained. Figure 3 It is a diagram showing an example of the functional configuration of the information processing device 30 .

[0066] The information processing device 30 includes a storage unit 32 , an input receiving unit 33 , a communication unit 34 , a display unit 35 , and a control unit 36 ​​.

[0067] The control unit 36 ​​controls the entire information processing device 30. The control unit 36 ​​includes an image acquisition unit 361, a determination unit 362, a selection unit 363, a determination unit 364, a shooting control unit 365, and a display control unit 366. These functional units included in the control unit 36 ​​are implemented, for example, by the processor 31 executing various programs stored in the storage unit 32. In addition, part or all of the functional units may be hardware functional units such as LSI (Large Scale Integration) and ASIC (Application Specific Integrated Circuit).

[0068] The image acquisition unit 361 sequentially acquires frames of the moving image captured by the imaging unit 20 as captured images.

[0069] The determination unit 362 performs various determinations performed by the information processing device 30. For example, the determination unit 362 performs the above-mentioned classification determination and the like.

[0070] The selection unit 363 selects, for example, an object classification, an object reference value, etc., based on the determination result of the determination unit 362 .

[0071] The determination unit 364 determines the reference values ​​T1 to T4, respectively. The information processing device 30 may be configured not to include the determination unit 364. In this case, the information processing device 30 stores the reference values ​​T1 to T4, respectively, in the storage unit 32 according to the received operation.

[0072] The imaging control unit 365 controls the imaging unit 20 .

[0073] The display control unit 366 generates various images according to the received operation. The display control unit 366 causes the display unit 15 to display the generated images. In addition, the display control unit 366 causes the display device 10 to display the target advertisement by outputting the target advertisement described above to the display device 10.

[0074] The image analysis unit 367 performs various image analyses performed by the information processing device 30 .

[0075] <Processing of determining reference value by information processing device>

[0076] The following is a description of the process by which the information processing device 30 determines the reference values. The information processing device 30 uses the total result of the attributes of the plurality of persons photographed by the photographing unit 20 in each time period within the past predetermined target period (i.e., each time period of the first time period to the fourth time period described above) to determine four reference values, namely, reference value T1 to reference value T4. Figure 4, a process in which the information processing device 30 obtains the total result of the attributes of each of the plurality of persons photographed by the imaging unit 20 in each time period within the target period is described. Figure 4 2 is a diagram showing an example of a process flow in which the information processing device 30 obtains the total result of the attributes of each of the plurality of persons photographed by the photographing unit 20 in the first time period within the target period. In addition, the process in which the information processing device 30 obtains the total result of the attributes of each of the plurality of persons photographed by the photographing unit 20 in each of the second time period to the fourth time period within the target period is similar to the process in which the information processing device 30 obtains the total result of the attributes of each of the plurality of persons photographed by the photographing unit 20 in each of the second time period to the fourth time period within the target period. Figure 4 The processing is the same as that of the flowchart shown in FIG. 1 , so the description is omitted. In addition, the period used as the target period may be a past advertisement display period, a period set to obtain the aggregate result, or another period. The following describes, as an example, a case where the target period is a period set to obtain the aggregate result. In addition, the following describes, as an example, Figure 4 The first aggregation start operation is a case where a first aggregation start operation is received at a timing before the processing of step S110 shown in the figure. The first aggregation start operation is an operation to start the following processing, that is, to obtain the aggregation result of the attributes of each of the plurality of persons photographed by the photographing unit 20 in the first time period within the target period. In addition, as an example, the case where the photographing unit 20 starts photographing at this timing is described below. The information processing device 30 repeats the process every time the first time period within the target period starts. Figure 4 The information processing device 30 can thereby obtain the total result of the attributes of each of the plurality of persons photographed by the imaging unit 20 during the first time period within the target period.

[0077] When the first time period in the target period starts, the image acquisition unit 361 acquires the captured image captured by the imaging unit 20 from the imaging unit 20 (step S110 ).

[0078] Next, the image analysis unit 367 determines whether or not one or more persons are included in the captured image based on the captured image acquired in step S110 (step S120). Figure 4 In FIG. 1 , the process of step S120 is represented as “Has a person been detected?” The method by which the image analysis unit 367 performs the process of step S120 may be a known method or a method to be developed in the future.

[0079] When the image analyzing unit 367 determines that the captured image acquired in step S110 does not include a single person (step S120 —No), the image acquiring unit 361 proceeds to step S110 and acquires the captured image captured by the capturing unit 20 again from the capturing unit 20 .

[0080] On the other hand, when it is determined that the captured image obtained in step S110 contains more than one person (step S120-Yes), the image analysis unit 367 detects feature information indicating the features of each of the more than one person captured in the captured image (step S130). Hereinafter, for the sake of convenience, the more than one person captured in the captured image will be referred to as a photographed person. The feature information indicating the features of each of the more than one photographed person may be a feature quantity indicating the features of each of the more than one photographed person, or may be other types of information indicating the features of each of the more than one photographed person.

[0081] Next, the determination unit 362 determines whether the more than one photographed persons include one or more new persons who have not been detected today by the information processing device 30 based on the one or more feature information detected in step S130 (step S140). Here, the image analysis unit 367 causes the storage unit 32 to store person identification information for identifying one or more new persons who have not been detected today by the information processing device 30 in the processing of steps S150 to S180 described later. Furthermore, the person identification information for identifying a certain person includes feature information indicating the features of the person and date and time information indicating the date and time when the person identification information was generated. Therefore, the determination unit 362 can determine whether the more than one photographed persons include one or more new persons who have not been detected today by the information processing device 30 based on the one or more feature information detected in step S130 and the feature information and date and time information included in each person identification information of all the person identification information stored in the storage unit 32. In addition, the determination unit 362 can determine whether the more than one photographed persons include one or more new persons who have not been detected today based on the date and time information included in the person identification information. Figure 4 Such determination is made independently for each day of the flow chart shown.

[0082] If the determination unit 362 determines that the one or more persons being photographed do not include one or more new persons who have not been detected by the information processing device 30 today (step S140 —No), it determines whether to end the process. Figure 4 For example, if the current time exceeds the end time of the first time period, the determination unit 362 determines that the first time period has ended. Figure 4 On the other hand, for example, if the current time does not exceed the end time of the first time period, the determination unit 362 determines that the first time period is not to be ended. Figure 4 The process of the flowchart shown in FIG. 360 is shown in FIG. 361 . In addition, the determination unit 362 may perform the determination of step S190 by other methods.

[0083] If the determination unit 362 determines that the Figure 4In the case of the processing of the flowchart shown in the figure (step S190 —No), the image acquisition unit 361 moves to step S110 and acquires the captured image captured by the imaging unit 20 from the imaging unit 20 again.

[0084] On the other hand, the determination unit 362 determines that the Figure 4 In the case of the process of the flowchart shown in the figure (step S190-Yes), the process ends. Figure 4 The process of the flowchart shown.

[0085] On the other hand, in step S140, when the determination unit 362 determines that the one or more photographed persons include one or more new persons who have not been detected by the information processing device 30 today (step S140-Yes), the image analysis unit 367 selects the one or more new persons one by one as the first target persons, and repeats the processing of steps S160 to S180 for each selected first target person (step S150). Figure 4 In the example, “for each newcomer” is used to represent the processing of step S150.

[0086] After the first target person is selected in step S150, the image analysis unit 367 generates person identification information including information for identifying the selected first target person (e.g., ID (Identifier) ​​for identifying the first target person), feature information indicating the features of the first target person detected in step S130, and date and time information indicating the current date and time. Thus, the image analysis unit 367 assigns the generated person identification information to the first target person (step S160).

[0087] Next, the image analysis unit 367 detects the attributes of the first target person based on the captured image obtained in step S110 (step S170). In addition, the method by which the image analysis unit 367 detects the attributes of the first target person from the captured image in step S170 may be a known method or a method to be developed in the future. In addition, the processing of step S160 and step S170 may be performed in parallel or in reverse order.

[0088] Next, the determination unit 362 determines which of the categories X1 to X4 the attribute detected in step S170 corresponds to. Then, the image analysis unit 367 associates the classification information indicating the category obtained as a result of the determination by the determination unit 362 with the human identification information assigned to the first target person in step S160 and stores the association in the storage unit 32 (step S180).

[0089] After performing the processing of step S180, the image analysis unit 367 transfers to step S150 to select the next first target person. In addition, if the decision unit 364 determines in step S150 that there is no person who has not been selected as the first target person, the determination unit 362 ends the processing of steps S150 to S180 and transfers to step S190 to determine whether to end. Figure 4 The process of the flowchart shown.

[0090] By repeating the above-mentioned processing for each first time period within the target period, the information processing device 30 can make the storage unit 32 store the person identification information corresponding to the classification information as the total result of the attributes of each of the plurality of persons photographed by the photographing unit 20 in the first time period within the target period. Then, the information processing device 30 performs the following operations based on the total result thus obtained (i.e., the person identification information corresponding to the classification information). Figure 5 The processing of the flowchart shown thereby determines the reference values ​​T1 to T4 in the first time period. Figure 5 is a diagram showing an example of a process flow of the information processing device 30 determining the reference value in the first time zone based on the human identification information. In addition, the process of the information processing device 30 determining the reference value of each of the second time zone to the fourth time zone based on the human identification information is similar to Figure 5 The processing of the flowchart shown in FIG. 1 is the same as that of the flowchart shown in FIG. 1 , so the description is omitted. Figure 5 The following describes a case where the information processing device 30 receives a reference value determination start operation at a timing before the processing of step S210 shown in FIG. 1 , wherein the reference value determination start operation is an operation that causes the information processing device 30 to start the processing of determining the reference value in the first time period. Figure 4 The description will be made of a case where the processing of the flowchart shown in FIG. 1 is performed and the storage unit 32 stores the person identification information for identifying each person detected from the captured image in the first time zone within the target period.

[0091] After receiving the reference value determination start operation, the determination unit 364 reads out from the storage unit 32 all the personal identification information stored in the first time zone within the target period, among all the personal identification information stored in the storage unit 32 (step S210 ).

[0092] Next, the decision unit 364 calculates the proportion of people who match the attributes of categories X1 to X4, based on all the personal identification information read out in step S210 (step S220). Figure 5In the process of step S220, "calculating a ratio" is used to indicate the processing of step S220. For example, in step S220, the decision unit 364 calculates the number XN1 of human identification information including classification information indicating classification X1, the number XN2 of human identification information including classification information indicating classification X2, the number XN3 of human identification information including classification information indicating classification X3, and the number XN4 of human identification information including classification information indicating classification X4, based on all the human identification information read out in step S210. Then, the decision unit 364 calculates the value obtained by dividing the number XN1 by the sum of the numbers XN1 to XN4 as the ratio of people who meet the attributes of classification X1. In addition, the decision unit 364 also calculates the ratio of people who meet the attributes of classification X2 to classification X4 respectively by the same method. In addition, the decision unit 364 may also be a structure in which the ratio of people who meet the attributes of classification X1 to classification X4 respectively is calculated by other methods in step S220. In the following, for the sake of convenience, the ratio of people who meet the attributes of classification X1 is referred to as ratio XR1 for explanation. In addition, for the sake of convenience, the proportion of people who meet the attributes of category X2 is referred to as proportion XR2 for description. In addition, for the sake of convenience, the proportion of people who meet the attributes of category X3 is referred to as proportion XR3 for description. In addition, for the sake of convenience, the proportion of people who meet the attributes of category X4 is referred to as proportion XR4 for description.

[0093] Next, the decision unit 364 determines the reference values ​​T1 to T4, respectively, based on the ratios calculated in step S220 (step S230). For example, in step S230, the decision unit 364 determines the ratio of the ratios XR1 to XR4 that exceeds the upper limit of the reference value as the exceeding upper limit ratio. The upper limit of the reference value is a value predetermined as a common upper limit of each of the reference values ​​T1 to T4, for example, 50%. In addition, the upper limit of the reference value can be any ratio as long as it is a ratio of 50% or more, or it can be another ratio. In the case of determining the upper limit of the reference value in this way, even if the ratio XR1 to XR4 includes the exceeding upper limit ratio, the exceeding upper limit ratio is only one of the ratios XR1 to XR4. In addition, for example, in step S230, the decision unit 364 determines the ratio of the ratio XR1 to XR4 that is lower than the lower limit of the reference value as the exceeding lower limit ratio. The lower limit of the reference value is a value predetermined as a common lower limit of each of the reference values ​​T1 to T4, for example, 10%. The lower limit of the reference value may be any value as long as it is a ratio lower than the upper limit of the reference value, and may be a ratio lower than 10% or a ratio higher than 10%.

[0094] When the ratios XR1 to XR4 do not include a ratio exceeding the upper limit and a ratio exceeding the lower limit, the decision unit 364 decides the ratios XR1 to XR4 as reference values ​​T1 to T4, respectively. That is, in this case, the decision unit 364 decides the ratio XR1 as reference value T1, the ratio XR2 as reference value T2, the ratio XR3 as reference value T3, and the ratio XR4 as reference value T4.

[0095] On the other hand, when the ratios XR1 to XR4 include the ratio exceeding the upper limit and the ratio exceeding the lower limit, the decision unit 364 determines the reference value for the classification corresponding to the ratio exceeding the upper limit to be the same value as the upper limit of the reference value. Then, the decision unit 364 determines the value obtained by adding (the ratio exceeding the upper limit - the upper limit of the reference value) to the ratio exceeding the lower limit as the reference value for the classification corresponding to the ratio exceeding the lower limit. However, the addition and subtraction operations of the ratios are addition and subtraction operations of the values ​​excluding "%" (i.e., for example, "5% + (60% - 50%)" is calculated as 15%). In addition, the decision unit 364 determines the remaining two ratios as the reference values ​​for the classifications corresponding to the remaining two ratios. For example, consider the case where the ratio XR1 is 60%, the ratio XR2 is 5%, the ratio XR3 is 15%, and the ratio XR4 is 20%. In this case, the ratio exceeding the upper limit is the ratio XR1. In addition, in this case, the ratio exceeding the lower limit is the ratio XR2. Therefore, in this case, the decision unit 364 determines the reference value T1 for the category X1 corresponding to the ratio XR1 that exceeds the upper limit ratio to be the same value as the upper limit value of the reference value (50% in this example). In addition, in this case, the decision unit 364 determines the value obtained by adding (exceeding upper limit ratio - upper limit value of the reference value) to the ratio XR2 that exceeds the lower limit ratio (15% in this example) as the reference value T2 for the category X2 corresponding to the ratio XR2. Then, in this case, the decision unit 364 determines the ratio XR3 as the reference value T3 for the category X3 corresponding to the ratio XR3, and determines the ratio XR4 as the reference value T4 for the category X4 corresponding to the ratio XR4.

[0096] In addition, when the ratio XR1 to the ratio XR4 include a ratio exceeding the upper limit, the decision unit 364 determines the reference value for the classification corresponding to the ratio exceeding the upper limit to be the same value as the upper limit of the reference value. Then, the decision unit 364 determines the value obtained by adding (the ratio exceeding the upper limit - the upper limit of the reference value) to the lowest ratio among the remaining three ratios as the reference value for the classification corresponding to the lowest ratio. In addition, the decision unit 364 determines the remaining two ratios as the reference values ​​for the classifications corresponding to the remaining two ratios. For example, consider a case where the ratio XR1 is 60%, the ratio XR2 is 10%, the ratio XR3 is 15%, and the ratio XR4 is 15%. In this case, the ratio exceeding the upper limit is the ratio XR1. In addition, in this case, the lowest ratio is the ratio XR2. Therefore, in this case, the decision unit 364 determines the reference value T1 for the classification X1 corresponding to the ratio XR1 as the ratio exceeding the upper limit to be the same value as the upper limit of the reference value (50% in this example). In this case, the decision unit 364 determines the value obtained by adding (the upper limit value of the ratio exceeding the upper limit - the upper limit value of the reference value) to the ratio XR2 as the reference value T2 for the category X2 corresponding to the ratio XR2 (20% in this example). Then, in this case, the decision unit 364 determines the ratio XR3 as the reference value T3 for the category X3 corresponding to the ratio XR3, and determines the ratio XR4 as the reference value T4 for the category X4 corresponding to the ratio XR4. In addition, when the ratios XR1 to XR2 include two or more lowest ratios, the decision unit 364 determines, for example, the value obtained by equally allocating (the upper limit value of the ratio exceeding the upper limit - the upper limit value of the reference value) to the two or more ratios as the reference values ​​for the categories corresponding to the two or more ratios.

[0097] In addition, when the ratios XR1 to XR4 include a ratio exceeding the lower limit, the decision unit 364 determines the reference value for the classification corresponding to the ratio exceeding the lower limit to be the same value as the lower limit of the reference value. Then, the decision unit 364 determines the value obtained by subtracting (the lower limit of the reference value - the ratio exceeding the lower limit) from the highest ratio among the remaining three ratios as the reference value for the classification corresponding to the highest ratio. In addition, the decision unit 364 determines the remaining two ratios as the reference values ​​for the classifications corresponding to the remaining two ratios. For example, consider a case where the ratio XR1 is 50%, the ratio XR2 is 5%, the ratio XR3 is 15%, and the ratio XR4 is 30%. In this case, the ratio exceeding the lower limit is the ratio XR2. In addition, in this case, the highest ratio is the ratio XR1. Therefore, in this case, the decision unit 364 determines the reference value T2 for the classification X2 corresponding to the ratio XR2 that exceeds the lower limit to be the same value as the lower limit of the reference value (10% in this example). In this case, the decision unit 364 determines the value obtained by subtracting (the lower limit value of the reference value - the ratio exceeding the lower limit) from the ratio XR1, which is the highest ratio (45% in this example), as the reference value T1 for the category X1 corresponding to the ratio XR1. Then, in this case, the decision unit 364 determines the ratio XR3 as the reference value T3 for the category X3 corresponding to the ratio XR3, and determines the ratio XR4 as the reference value T4 for the category X4 corresponding to the ratio XR4. In addition, when the ratios XR1 to XR2 include two or more highest ratios, the decision unit 364 determines the value obtained by, for example, equally allocating -(the lower limit value of the reference value - the ratio exceeding the lower limit) to the two or more ratios as the reference values ​​for the categories corresponding to the two or more ratios.

[0098] Furthermore, the information processing device 30 may be configured such that either or both of the upper limit value of the reference value and the lower limit value of the reference value are not determined.

[0099] After the process of step S230 is performed, the determination unit 364 stores the reference values ​​T1 to T4 determined in step S230 in the storage unit 32 as the reference values ​​T1 to T4 in the first time period, respectively (step S240). Figure 5 The process of the flowchart shown.

[0100] As described above, the information processing device 30 determines the reference values ​​T1 to T4 based on the number of people whose attributes are determined to be included in the captured image in the first time period within the target period and that match the respective categories X1 to X4. Thus, the information processing device 30 can determine the reference values ​​T1 to T4 in each time period according to the proportion of the attributes of the plurality of people who watch the display device 10 in each time period. As a result, the information processing device 30 can suppress the situation where the increase in display performance is biased toward a specific advertisement, and can more reliably display an advertisement corresponding to the attributes of the viewer on the display device 10.

[0101] <Processing by which the information processing device causes the display device to display an advertisement>

[0102] Below, refer to Figure 6 , a process in which the information processing device 30 causes the display device 10 to display an advertisement during the first time period within the advertisement display period is described. Figure 6 The diagram shows an example of the flow of processing in which the information processing device 30 causes the display device 10 to display an advertisement in the first time period during the advertisement display period. The information processing device 30 repeats the process of displaying an advertisement every time the first time period during the advertisement display period starts. Figure 6 Thus, the information processing device 30 can display an advertisement corresponding to the attributes of the viewer on the display device 10 while suppressing the increase in display performance from being biased toward a specific advertisement in the first time period within the advertisement display period.

[0103] When the first time period in the advertisement display period starts, the image acquisition unit 361 acquires the image captured by the image capture unit 20 from the image capture unit 20 (step S310 ).

[0104] Next, the image analysis unit 367 determines whether or not two or more persons are included in the captured image based on the captured image acquired in step S310 (step S320). Figure 6 In the example, the process of step S320 is indicated by “have two or more persons been detected?” The method by which the image analysis unit 367 performs the process of step S320 may be a known method or a method to be developed in the future.

[0105] Based on the captured image acquired in step S310, when the image analysis unit 367 determines that the captured image does not contain more than two people (step S320-No), the selection unit 363 selects a target classification (step S330). Specifically, for example, when the captured image does not contain anyone, the selection unit 363 specifies the time period (in this example, the first time period) including the current time as the target time period. Then, the selection unit 363 calculates the display performance of each advertisement (i.e., each of advertisements C1 to C4) in the target time period within the advertisement display period. Thereafter, the selection unit 363 selects the classification corresponding to the advertisement among advertisements C1 to C4 whose display performance in the target time period from the start of the advertisement display period to the present is the largest below the reference value (i.e., the difference between the display performance and the reference value) as the target classification. In addition, a specific example of the method of selecting the target classification in this case has been described, so the description is omitted. On the other hand, for example, when a person is included in the captured image, the determination unit 362 determines which of the plurality of categories predetermined for the attributes of viewers of the advertisement displayed on the display screen of the display device 10 the attribute of the person included in the captured image corresponds to. Furthermore, even if the display performance of the advertisement corresponding to the category obtained as a result of the determination performed by the determination unit 362 exceeds the reference value corresponding to the category, the selection unit 363 selects the category as the target category.

[0106] The display control unit 366 outputs the target advertisement corresponding to the target category selected in step S330 to the display device 10 , and starts displaying the target advertisement on the display device 10 (step S340 ).

[0107] Next, the determination unit 362 waits until the display of the target advertisement (that is, the display of the moving image of the target advertisement) started in step S340 is completed (step S350 ).

[0108] When the determination unit 362 determines that the display of the target advertisement started in step S340 has ended (step S350 —Yes), it determines whether to end the display of the target advertisement. Figure 6 For example, if the current time exceeds the end time of the first time period, the determination unit 362 determines that the first time period has ended. Figure 6 On the other hand, for example, if the current time does not exceed the end time of the first time period, the determination unit 362 determines that the first time period is not to be ended. Figure 6 The process of the flowchart shown in FIG. 360 is shown in FIG. 361 . In addition, the determination unit 362 may perform the determination of step S360 by other methods.

[0109] If the determination unit 362 determines that the Figure 6In the case of the processing of the flowchart shown in the figure (step S360 —No), the image acquisition unit 361 moves to step S310 and acquires the captured image captured by the imaging unit 20 from the imaging unit 20 again.

[0110] On the other hand, the determination unit 362 determines that the Figure 6 In the case of the processing of the flowchart shown in the figure (step S360-Yes), the end Figure 6 The process of the flowchart shown.

[0111] On the other hand, when the image analysis unit 367 determines that two or more persons are included in the captured image based on the captured image acquired in step S310 (step S320-Yes), the selection unit 363 sorts the two or more persons included in the captured image based on the arrangement rule. Then, the selection unit 363 selects the sorted two or more persons one by one from the first person as the target person, and repeats the processing of steps S380 to S390 for each selected target person (step S370). Here, the sorting based on the arrangement rule in step S370 is described.

[0112] Figure 7 2 is a diagram showing an example of a situation where two people are located in the imaging area RA. Figure 7 In the example shown, the distance between person M1 and the display device 10 is L1. On the other hand, in this example, the distance between person F1 and the display device 10 is L2. Moreover, L1 is a distance shorter than L2. In this case, the selection unit 363 sorts person M1 and person F1 in the order of person M1 and person F1. That is, in this case, the selection unit 363 sets person M1 as the first person and person F1 as the second person. In this way, the selection unit 363 selects person M1, which is photographed by the photographing unit 20 at a position closer to the display device 10 than person F1, as the first person.

[0113] After the target person is selected in step S370 , the image analysis unit 367 detects the attributes of the selected target person based on the captured image acquired in step S310 (step S380 ).

[0114] Next, the determination unit 362 determines which of the categories X1 to X4 the attribute detected in step S380 corresponds to by classification determination. Then, the selection unit 363 determines whether the target advertisement corresponding to the target category obtained as a result of the determination by the determination unit 362 exceeds the reference value corresponding to the target category (step S390).

[0115] When the determination unit 362 determines that the target advertisement corresponding to the target classification exceeds the reference value corresponding to the target classification (step S390-Yes), the selection unit 363 transfers to step S370 and selects the next target person. In addition, when the selection unit 363 determines in step S370 that there is no person who has not been selected as the target person, the processing of steps S370 to S390 is terminated. Then, in the repeated processing of steps S370 to S390 that have been terminated, the selection unit 363 reselects the advertisement with the smallest difference between the display performance and the reference value (that is, the degree to which the display performance exceeds the reference value) among advertisements C1 to C4 as the target advertisement, thereby selecting the category corresponding to the target advertisement among categories X1 to X4 as the target category (step S400). Thereafter, the display control unit 366 transfers to step S340, outputs the target advertisement corresponding to the target classification selected in step S400 to the display device 10, and causes the display device 10 to display the target advertisement.

[0116] On the other hand, when the selection unit 363 determines that the object advertisement corresponding to the object classification exceeds the reference value corresponding to the object classification (step S390-No), the display control unit 366 terminates the processing of steps S370 to S390, transfers to step S340, outputs the object advertisement corresponding to the currently selected object classification to the display device 10, and causes the display device 10 to display the object advertisement.

[0117] As described above, the information processing device 30 obtains a captured image obtained by capturing a capturing area RA including a position of a display screen where the display device 10 can be visually identified, stores reference values ​​(in this example, reference value T1 to reference value T4) corresponding to a plurality of classifications (in this example, classification X1 to classification X4) predetermined for attributes of viewers of an advertisement displayed on the display screen, determines which of the plurality of classifications the attributes of the person included in the captured image match, selects one of the plurality of classifications based at least on the display performance of the advertisement and the determination result, and displays the advertisement corresponding to the selected classification on the display screen. Here, when the captured image includes at least the first person and the second person, the information processing device 30 selects the second category determined for the attribute of the second person when performing the first determination and the second determination, wherein the first determination determines that the display performance of the first advertisement (e.g., advertisement C1, etc.) corresponding to the first category (e.g., category X1, etc.) determined for the attribute of the first person exceeds the reference value corresponding to the first category, i.e., the first reference value (e.g., reference value T1), and the second determination determines that the display performance of the second advertisement (e.g., advertisement C2, etc.) corresponding to the second category (e.g., category X2, etc.) does not exceed the reference value corresponding to the second category, i.e., the second reference value (e.g., reference value T2, etc.). Thus, the information processing device 30 can suppress the increase in display performance from being biased toward a specific advertisement and display the advertisement corresponding to the attribute of the viewer on the display device 10.

[0118] In addition, when the captured image includes the first person, the second person, and the third person, the information processing device 30 selects the third category determined for the attribute of the third person when performing the first determination, the third determination, and the fourth determination, wherein the third determination determines that the display performance of the second advertisement exceeds the second reference value, and the fourth determination determines that the display performance of the advertisement corresponding to the third category (for example, category X3, etc.), that is, the third advertisement (for example, advertisement C3, etc.), does not exceed the reference value corresponding to the third category, that is, the third reference value (for example, reference value T3, etc.). Thus, the information processing device 30 can more reliably suppress the increase in display performance from being biased toward a specific advertisement, and can display the advertisement corresponding to the attribute of the viewer on the display device 10.

[0119] In addition, the image analysis unit 367 may also be configured to detect the attributes of the two or more persons contained in the captured image before transferring to step S370, when it is determined in step S320 based on the captured image obtained in step S310 that the captured image contains two or more persons. In this case, the processing of step S380 is omitted. In addition, in this case, the determination unit 362 determines which of the categories X1 to X4 the attributes detected for the two or more persons correspond to before transferring to step S370. Then, when the determination unit 362 determines that the attributes of the two or more persons correspond to the same one of the categories, for example, even if the display performance of the advertisement corresponding to the one category exceeds the reference value corresponding to the one category, the selection unit 363 omits the repeated processing of steps S370 to S390 and transfers to step S400, selecting the one category as the target category.

[0120] In addition, the matters described above can be combined arbitrarily.

[0121] <Notes>

[0122] [1] An information processing device, comprising: an acquisition unit that acquires a captured image, the captured image being obtained by capturing a captured area including a position where a display screen of a display device can be visually recognized; a storage unit that stores a reference value corresponding to each of a plurality of classifications predetermined for attributes of viewers of an advertisement displayed on the display screen; a determination unit that determines which of the plurality of classifications the attributes of a person included in the captured image match; a selection unit that selects one of the plurality of classifications based at least on display performance of the advertisement and a determination result of the determination unit; and a display control unit that causes the display screen to display a value corresponding to the attribute selected by the selection unit. For the advertisement corresponding to the selected category, when the captured image includes at least a first person and a second person, the selection unit selects the second category determined by the determination unit based on the attribute of the second person when performing a first determination and a second determination, the first determination determines that the display performance of the advertisement corresponding to the first category determined by the determination unit based on the attribute of the first person, i.e., the first advertisement, exceeds the benchmark value corresponding to the first category, i.e., the first benchmark value, and the second determination determines that the display performance of the advertisement corresponding to the second category, i.e., the second advertisement, does not exceed the benchmark value corresponding to the second category, i.e., the second benchmark value.

[0123] [2] An information processing device according to [1], wherein the second judgment is performed after the first judgment, and the second judgment is performed after the first judgment based on at least one of the orientation of the faces of the first person and the second person contained in the captured image and the distance between the first person and the second person contained in the captured image and the display device.

[0124] [3] An information processing device according to [1], wherein, in a case where the captured image includes the first person and the second person, when the determination unit determines that the attributes of the first person and the attributes of the second person both meet one of the first classification and the second classification, the selection unit selects the one even if the display performance of the advertisement corresponding to the one exceeds the reference value corresponding to the one.

[0125] [4] An information processing device according to any one of [1] to [3], wherein the multiple classifications are classifications based on at least one of age and gender.

[0126] [5] An information processing device according to any one of [1] to [4], wherein, when the captured image includes the first person, the second person and the third person, the selection unit selects the third category determined by the determination unit regarding the attribute of the third person when performing the first determination, the third determination and the fourth determination, the third determination determines that the display performance of the second advertisement exceeds the second reference value, and the fourth determination determines that the display performance of the advertisement corresponding to the third category, i.e., the third advertisement, does not exceed the reference value, i.e., the third reference value, corresponding to the third category.

[0127] [6] An information processing device according to any one of [1] to [5], wherein, when the captured image includes at least the first person and the second person, the selection unit selects the first category when performing a fifth judgment, and the fifth judgment determines that the display performance of the first advertisement does not exceed the first benchmark value.

[0128] [7] An information processing device according to any one of [1] to [6], wherein the first person is a person photographed at a position closer to the display device than the second person.

[0129] [8] An information processing device according to any one of [1] to [7], wherein the information processing device further comprises a determination unit that determines the first reference value and the second reference value based on the number of persons whose attributes are determined by the determination unit to be included in the captured image as meeting the first classification within a first period determined in the past and the number of persons whose attributes are determined by the determination unit to be included in the captured image as meeting the second classification within the first period.

[0130] [9] An information processing device according to any one of [1] to [8], wherein when the captured image does not include a person, the selection unit selects one of the first category and the second category based on the display performance of the first advertisement, the display performance of the second advertisement, the first benchmark value, and the second benchmark value.

[0131]

[10] An information processing device according to [9], wherein, when the captured image does not contain a person, the selection unit selects the first category when the difference between the display performance of the first advertisement and the first benchmark value is smaller than the difference between the display performance of the second advertisement and the second benchmark value, and the selection unit selects the second category when the difference between the display performance of the first advertisement and the first benchmark value is greater than the difference between the display performance of the second advertisement and the second benchmark value.

[0132]

[11] An information processing device comprises: an acquisition unit that acquires a captured image, the captured image being obtained by capturing a captured area including a position where a display screen of a display device can be visually identified; a storage unit that stores a plurality of reference values ​​corresponding to a plurality of categories predetermined for attributes of viewers of an advertisement displayed on the display screen; a determination unit that determines which of the plurality of categories the attributes of a person included in the captured image match; a selection unit that selects one of the plurality of categories based at least on display performance of the advertisement and a determination result of the determination unit; and a display control unit that causes the display screen to display the advertisement corresponding to the category selected by the selection unit, wherein, when the captured image includes at least a first person, and when the display performance of the advertisement corresponding to a first category determined by the determination unit for the attributes of the first person exceeds the reference value corresponding to the first category, the selection unit selects one of the plurality of categories according to conditions that differ depending on whether the captured image includes other persons who are not the first person.

[0133]

[12] An information processing device according to claim 11, wherein when the captured image does not include any person other than the first person, the selection unit selects the first category even if the display performance of the advertisement corresponding to the first category exceeds the first reference value.

[0134]

[13] The information processing device according to claim 11, wherein, in a case where the captured image includes the first person and the second person, when the display performance of the advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds the first reference value corresponding to the first category, the selection unit determines whether the display performance of the advertisement corresponding to the second category determined by the determination unit with respect to the attribute of the second person, i.e., the second advertisement, does not exceed the reference value, i.e., the second reference value, corresponding to the second category, and selects one of the multiple categories based on such determination result.

[0135]

[14] An information processing method comprises: an acquisition step of acquiring a captured image obtained by capturing a captured area including a position where a display screen of a display device can be visually recognized; a determination unit of determining which of a plurality of categories predetermined for the attributes of viewers of an advertisement displayed on the display screen the attributes of a person included in the captured image match; a selection step of selecting one of the plurality of categories based at least on the display performance of the advertisement and the determination result of the determination unit; and a display control step of causing the display screen to display the advertisement corresponding to the category selected by the selection step, wherein when at least a first person and a second person are included in the captured image, the selection step selects the second category determined by the determination unit for the attributes of the second person when a first determination and a second determination are performed, the first determination determining that the display performance of the advertisement corresponding to the first category determined by the determination unit for the attributes of the first person, i.e., a first advertisement, exceeds the first reference value corresponding to the first category among the reference values ​​corresponding to each of the plurality of categories, i.e., a first reference value, and the second determination determining that the display performance of the advertisement corresponding to the second category, i.e., a second advertisement, does not exceed the second reference value corresponding to the second category.

[0136]

[15] An information processing system comprising a photographing unit and an information processing device, wherein the photographing unit photographs a photographing area including a position where a display screen of a display device can be visually identified, wherein the information processing device comprises: an acquisition unit for acquiring a photographed image photographed by the photographing unit; a storage unit for storing a reference value corresponding to each of a plurality of categories predetermined for attributes of viewers of an advertisement displayed on the display screen; a determination unit for determining which of the plurality of categories the attributes of a person included in the photographed image conform to; a selection unit for selecting one of the plurality of categories based at least on the display performance of the advertisement and the determination result of the determination unit; and a display control unit for controlling the display performance of the advertisement. The display screen displays the advertisement corresponding to the category selected by the selection unit, and when the captured image includes at least a first person and a second person, the selection unit selects the second category determined by the determination unit based on the attributes of the second person when performing a first judgment and a second judgment, the first judgment determining that the display performance of the advertisement corresponding to the first category determined by the determination unit based on the attributes of the first person, i.e., the first advertisement, exceeds the benchmark value corresponding to the first category, i.e., the first benchmark value, and the second judgment determining that the display performance of the advertisement corresponding to the second category, i.e., the second advertisement, does not exceed the benchmark value corresponding to the second category, i.e., the second benchmark value.

[0137] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to the embodiments and changes, replacements, deletions, etc. may be made without departing from the gist of the present invention.

[0138] In addition, the program for realizing the functions of any component in the device described above can also be recorded in a computer-readable recording medium, so that the computer system reads the program and executes it. Here, the device is, for example, an information processing device 30. In addition, the "computer system" mentioned here includes hardware such as OS and peripheral devices. In addition, "computer-readable recording medium" refers to removable media such as floppy disks, optical magnetic disks, ROMs, CD (Compact Disk)-ROMs, and storage devices such as hard disks built into the computer system. Furthermore, "computer-readable recording medium" also includes a medium that keeps the program for a certain period of time, such as a volatile memory inside a computer system that becomes a server or client when the program is sent via a network such as the Internet or a communication line such as a telephone line.

[0139] In addition, the above-mentioned program can also be transmitted from a computer system storing the program in a storage device, etc., to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having the function of transmitting information, such as a network such as the Internet, a communication line such as a telephone line, etc.

[0140] In addition, the above-mentioned program may be used to realize a part of the above-mentioned functions. Furthermore, the above-mentioned program may be a program that can realize the above-mentioned functions by combining with a program already recorded in the computer system, that is, a so-called differential file or differential program.

[0141] [Explanation of Reference Numerals]

[0142] 1 Information Processing System

[0143] 10 Display device

[0144] 15 Display

[0145] 20 Photography Department

[0146] 30 Information processing device

[0147] 31 Processor

[0148] 32 Storage

[0149] 33 Input Acceptance Department

[0150] 34 Ministry of Communications

[0151] 35 Display

[0152] 36 Control Department

[0153] 361 Image Acquisition Unit

[0154] 362 Judgment Department

[0155] 363 Selection Department

[0156] 364 Decision Department

[0157] 365 Shooting Control Department

[0158] 366 Display Control Unit

[0159] 367 Image Analysis Department

[0160] RA Shooting Area

Claims

1. An information processing device comprising: an acquisition unit that acquires a captured image obtained by capturing a captured area including a position where a display screen of the display device can be visually recognized; a storage unit storing a reference value corresponding to each of a plurality of categories predetermined for an attribute of a viewer of the advertisement displayed on the display screen; a determination unit for determining which of the plurality of categories an attribute of a person included in the captured image corresponds to; a selection unit that selects one of the plurality of categories based on at least the display performance of the advertisement and the determination result of the determination unit; and a display control unit configured to cause the display screen to display the advertisement corresponding to the category selected by the selection unit; When the captured image includes at least a first person and a second person, the selection unit selects a second category determined by the determination unit with respect to the attribute of the second person when the first determination and the second determination are performed. The first determination determines that the display performance of the first advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds the first reference value corresponding to the first category. The second determination determines that the display performance of the second advertisement corresponding to the second category does not exceed the second reference value corresponding to the second category.

2. The information processing device according to claim 1, wherein: The second determination is performed after the first determination, The second determination is performed after the first determination based on at least one of the orientation of the faces of the first person and the second person included in the captured image and the distance between the first person and the second person included in the captured image and the display device.

3. The information processing device according to claim 1, wherein: In the case where the captured image includes the first person and the second person, when the determination unit determines that the attributes of the first person and the attributes of the second person both meet one of the first classification and the second classification, the selection unit selects the one even if the display performance of the advertisement corresponding to the one exceeds the benchmark value corresponding to the one.

4. The information processing device according to claim 1, wherein: The plurality of categories are categories based on at least one of age and gender.

5. The information processing device according to claim 1, wherein: When the captured image includes the first person, the second person, and the third person, the selection unit selects the third category determined by the determination unit with respect to the attribute of the third person when the first determination, the third determination, and the fourth determination are performed. In the case where the third determination determines that the display performance of the second advertisement exceeds the second reference value, The fourth determination determines that the display performance of the third advertisement, which is the advertisement corresponding to the third category, does not exceed the third reference value, which is the reference value corresponding to the third category.

6. The information processing device according to claim 1, wherein: When the captured image includes at least the first person and the second person, the selection unit selects the first category when performing a fifth determination that determines that the display performance of the first advertisement does not exceed the first reference value.

7. The information processing device according to claim 1, wherein: The first person is a person photographed at a position closer to the display device than the second person.

8. The information processing device according to claim 1, wherein: The information processing device also includes a determination unit that determines the first reference value and the second reference value based on the number of persons whose attributes are determined by the determination unit to be included in the captured image as conforming to the first classification during a first period predetermined in the past and the number of persons whose attributes are determined by the determination unit to be included in the captured image as conforming to the second classification during the first period.

9. The information processing device according to claim 1, wherein: When the captured image does not include a person, the selection unit selects one of the first category and the second category based on the display performance of the first advertisement, the display performance of the second advertisement, the first reference value, and the second reference value.

10. The information processing device according to claim 9, wherein: When the captured image does not contain a person, The selection unit selects the first category when the difference between the display performance of the first advertisement and the first reference value is smaller than the difference between the display performance of the second advertisement and the second reference value. The selection unit selects the second category when the difference between the display performance of the first advertisement and the first reference value is greater than or equal to the difference between the display performance of the second advertisement and the second reference value.

11. An information processing device comprising: an acquisition unit that acquires a captured image obtained by capturing a captured area including a position where a display screen of the display device can be visually recognized; a storage unit storing a plurality of reference values ​​corresponding to a plurality of categories predetermined for attributes of viewers of the advertisement displayed on the display screen; a determination unit for determining which of the plurality of categories an attribute of a person included in the captured image corresponds to; a selection unit that selects one of the plurality of categories based on at least the display performance of the advertisement and the determination result of the determination unit; and a display control unit configured to cause the display screen to display the advertisement corresponding to the category selected by the selection unit; In a case where at least a first person is included in the captured image, when the display performance of the advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds the benchmark value corresponding to the first category, i.e., the first benchmark value, the selection unit selects one of the multiple categories according to different conditions depending on whether the captured image includes other persons who are not the first person.

12. The information processing device according to claim 11, wherein: When the captured image does not include a person other than the first person, the selection unit selects the first category even if the display performance of the advertisement corresponding to the first category exceeds the first reference value.

13. The information processing device according to claim 11, wherein: In the case where the captured image includes the first person and the second person, when the display performance of the advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds the first reference value corresponding to the first category, the selection unit determines whether the display performance of the advertisement corresponding to the second category determined by the determination unit with respect to the attribute of the second person, i.e., the second advertisement, does not exceed the reference value, i.e., the second reference value, corresponding to the second category, and selects one of the multiple categories based on such determination result.

14. An information processing method comprising: An acquisition step of acquiring a captured image obtained by capturing a captured area including a position where a display screen of the display device can be visually recognized; a determination unit for determining which of a plurality of categories predetermined for attributes of viewers of the advertisement displayed on the display screen the attribute of the person included in the captured image corresponds to; A selection step of selecting one of the plurality of categories based at least on the display performance of the advertisement and the determination result of the determination unit; and a display control step of causing the display screen to display the advertisement corresponding to the category selected in the selection step; When the captured image includes at least a first person and a second person, the selecting step selects a second category determined by the determination unit with respect to the attribute of the second person when the first determination and the second determination are performed. The first determination determines that the display performance of the advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person, namely, the first advertisement, exceeds the first reference value, namely, the reference value corresponding to the first category among the reference values ​​corresponding to each of the plurality of categories, The second determination determines that the display performance of the second advertisement corresponding to the second category does not exceed the second reference value corresponding to the second category.

15. An information processing system comprising an imaging unit and an information processing device, wherein the imaging unit images an imaging area including a position where a display screen of a display device can be visually recognized, wherein: The information processing device comprises: an acquisition unit, which acquires the image captured by the capturing unit; a storage unit storing a reference value corresponding to each of a plurality of categories predetermined for an attribute of a viewer of the advertisement displayed on the display screen; a determination unit for determining which of the plurality of categories an attribute of a person included in the captured image corresponds to; a selection unit that selects one of the plurality of categories based on at least the display performance of the advertisement and the determination result of the determination unit; and a display control unit configured to cause the display screen to display the advertisement corresponding to the category selected by the selection unit; When the captured image includes at least a first person and a second person, the selection unit selects a second category determined by the determination unit with respect to the attribute of the second person when the first determination and the second determination are performed. The first determination determines that the display performance of the first advertisement corresponding to the first category determined by the determination unit with respect to the attribute of the first person exceeds the first reference value corresponding to the first category. The second determination determines that the display performance of the second advertisement corresponding to the second category does not exceed the second reference value corresponding to the second category.

Images