Signage system, signage distribution method, signage authentication system, signage authentication method, and signage authentication program

Abstract

To provide a signage system capable of collecting viewing information of advertisements displayed on digital signage.SOLUTION: The signage system is composed of one of more computers that cause a first digital signage and a second digital signage to display images. The computer causes the first digital signage to display a first image with a first mark superimposed thereon and causes the second digital signage to display a second image with a second mark different from the first mark superimposed thereon.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a signage system, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program. [Background technology]

[0002] Patent Document 1 discloses a display system that includes a management server, a display unit that displays information related to a lottery, and a plurality of display devices that communicate with a terminal device and the management server, and that executes a lottery process corresponding to any of the unique information accumulated for the user information of the terminal device to determine lottery result information. In the display system, the management server registers the user information of the terminal device, and accumulates the unique information for the user information of the terminal device based on the terminal device acquiring the unique information corresponding to the display device, and executes a lottery process to determine lottery result information in response to the terminal device acquiring the unique information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-203414 Summary of the Invention [Problem to be solved by the invention]

[0004] In the configuration of Patent Document 1, a terminal device acquires unique information (the store ID) assigned to a display device (digital signage device) by reading a QR code (registered trademark) displayed on the display unit of the display device. However, simply reading a QR code (registered trademark) makes it possible to reuse an image captured of the QR code (registered trademark), and therefore the store cannot know which users actually viewed the advertising information displayed on the display device, and therefore cannot know whether the advertising information is effective.

[0005] The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to provide a signage system that collects viewing information of advertisements displayed on digital signage, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program. [Means for solving the problem]

[0006] The present disclosure provides a signage system configured with one or more computers that display images on a first digital signage and a second digital signage, wherein the computers display on the first digital signage a first image in which a first mark is superimposed on the image, and display on the second digital signage a second image in which a second mark different from the first mark is superimposed on the image.

[0007] The present disclosure also provides a signage distribution method performed by a signage system configured with one or more computers that displays images on a first digital signage and a second digital signage, the signage distribution method comprising: displaying a first image on the first digital signage, the first image having a first mark superimposed on the image; and displaying a second image on the second digital signage, the second image having a second mark different from the first mark superimposed on the image.

[0008] The present disclosure also provides a signage authentication system composed of one or more computers that authenticates a digital signage based on a captured image of an image displayed by the digital signage, wherein the computer records information about the multiple digital signages in association with information about multiple different marks superimposed on the image displayed on each of the digital signages, acquires the captured image, extracts the marks that appear in the acquired captured image, and authenticates the digital signage corresponding to the image displayed in the captured image based on a comparison between the extracted marks and the recorded information about the multiple different marks.

[0009] The present disclosure also provides a signage authentication method performed by a system comprised of one or more computers, which authenticates digital signage based on a captured image of an image displayed on the digital signage, the signage authentication method including: recording information on a plurality of the digital signages in association with information on a plurality of different marks superimposed on the image displayed on each of the digital signages; acquiring the captured image; extracting the marks appearing in the acquired captured image; and authenticating the digital signage corresponding to the image appearing in the captured image based on a comparison between the extracted marks and the recorded information on the different marks.

[0010] The present disclosure also provides a signage authentication program for realizing the following steps: capturing an image displayed on a digital signage on a terminal device that is a computer communicatively connected between a signage system and the signage system; transmitting the captured image to the signage system; extracting a mark that appears in the captured image, comparing the extracted mark with information about a plurality of pre-recorded marks, and obtaining an authentication result that authenticates the digital signage corresponding to the image displayed on the captured image based on information about the matched mark about the digital signage; and outputting the obtained authentication result. [Effects of the Invention]

[0011] According to the present disclosure, it is possible to collect viewing information about advertisements displayed on digital signage. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a signage system according to a first embodiment. [Figure 2] 1 is a block diagram showing an example of the internal configuration of an advertisement delivery server, a digital signage, and a user terminal according to a first embodiment; [Figure 3] FIG. 1 is a block diagram showing an example of the internal configuration of a server and a service information management device according to a first embodiment; [Figure 4] FIG. 1 is a sequence diagram illustrating an example of an operation procedure before content distribution in the signage system according to the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of extraction processing and recording processing of video feature information by a server. [Figure 6] FIG. 10 is a sequence diagram illustrating a modified example of an operation procedure before content distribution of the signage system according to the first embodiment. [Figure 7] FIG. 1 is a sequence diagram illustrating an example of an operation procedure after content distribution starts in the signage system according to the first embodiment. [Figure 8] A flowchart illustrating a modified example of the operation procedure after the start of content distribution of the user terminal according to the first embodiment. [Figure 9] FIG. 1 is a diagram showing an example of the overall configuration of a signage system according to a modification of the first embodiment. [Figure 10] FIG. 10 is a sequence diagram illustrating an example of an operation procedure after content distribution starts in a signage system according to a modification of the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, with reference to the drawings as appropriate, detailed descriptions will be given of embodiments that specifically disclose the configurations and operations of a signage system, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program according to the present disclosure. However, unnecessary detailed descriptions may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure and are not intended to limit the subject matter recited in the claims.

[0014] (Embodiment 1) First, use case examples and configuration examples of signage system 100 according to embodiment 1 will be described with reference to Fig. 1 to Fig. 3. Fig. 1 is a block diagram showing an example of the internal configuration of signage system 100 according to embodiment 1. Fig. 2 is a block diagram showing an example of the internal configuration of each of advertisement delivery server S1, digital signage SN1, ..., SNN, and user terminals P1, ..., PM according to embodiment 1. Fig. 3 is a block diagram showing an example of the internal configuration of each of server S2 and service information management device S3 according to embodiment 1.

[0015] 1 to 3 are merely examples, and the present invention is not limited to these. For example, the advertisement delivery server S1 and the server S2 may be realized by a single integrated computer. Furthermore, the server S2 and the service information management device S3 may be realized by a single integrated computer. Furthermore, the advertisement delivery server S1, the server S2, and the service information management device S3 may each be realized by a single integrated computer.

[0016] Signage system 100, which is an example of a signage authentication system, includes an advertisement distribution server S1, one or more digital signages SN1, ..., SNN, one or more user terminals P1, ..., PM, a server S2, a service information management device S3, and one or more networks NW1, NW2. Note that, in Figures 1 to 3, the networks NW1, NW2 are shown as separate entities to make the explanation of signage system 100 easier to understand, but this is not limiting.

[0017] Each of the one or more digital signages SN1, ..., SNN distributes advertising videos or advertising images (hereinafter referred to as "content"). Each of the user terminals P1, ..., PM captures the content (monitor 23) distributed (displayed) by each of the digital signages SN1, ..., SNN based on user operation, and transmits each of the captured images PIC1, ..., PICM to the server S2. The server S2 detects marks Mk1, Mk2, Mk3, ..., MkM appearing in each of the captured images PIC1, ..., PICM, and identifies the digital signage from which each of the captured images PIC1, ..., PICM was distributed. When the server S2 determines that the user has viewed the content distributed by each of the digital signages SN1, ..., SNN, it grants the user a service (e.g., points, coupons, etc. that can be used for a predetermined service) corresponding to the content viewing result.

[0018] For example, in the example shown in Figure 1, server S2 identifies captured image PIC1 as a captured image of content distributed by "Signage A" based on mark Mk1, captured image PIC2 as a captured image of content distributed by "Signage A" based on mark Mk2, captured image PIC3 as a captured image of content distributed by "Signage B" based on mark Mk3, and captured image PIC1 as a captured image of content distributed by "Signage C" based on mark MkM.

[0019] The advertisement distribution server S1 is a server that distributes content (advertising images, advertising videos) to each of the digital signages SN1, ..., SNN. The advertisement distribution server S1 is connected to each of one or more digital signages SN1, ..., SNN via a network NW1 so as to be able to communicate wirelessly or via wire, and transmits (distributes) content, information regarding marks to be added to the content, etc. The advertisement distribution server S1 includes a communication unit 10, a processor 11, and a memory 12.

[0020] The wireless communication here refers to communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark).

[0021] The communication unit 10 is communicably connected between each of the plurality of digital signages SN1, ..., SNN and the server S2 via the networks NW1 and NW2. Note that the connection relationship between the advertisement distribution server S1 and the server S2 is not shown in FIG.

[0022] The communication unit 10 acquires (receives) various control commands (electrical signals) transmitted from each digital signage SN1, ..., SNN or server S2, and outputs them to the processor 11. The communication unit 10 also transmits various control commands and information related to content output from the processor 11 to the corresponding digital signage SN1, ..., SNN or server S2.

[0023] The processor 11 is configured using, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array), and controls the operation of each part of the processor 11. The processor 11 cooperates with the memory 12, refers to the programs and data stored in the memory 12, and executes the programs to realize each function of the processor 11.

[0024] The processor 11 superimposes a mark on the content distributed by each of the digital signages SN1, ..., SNN based on distribution schedule information for the content distributed by each of the digital signages SN1, ..., SNN (e.g., the time periods during which the content is distributed by each of the digital signages SN1, ..., SNN), mark information (e.g., the characteristics of the mark), and mark schedule information (e.g., the mark information to be superimposed on each content).

[0025] The mark superimposition process may be performed by each of the digital signages SN1, ..., SNN. In such a case, the processor 11 associates distribution schedule information, mark information, and mark schedule information with the content data distributed by each of the digital signages SN1, ..., SNN, and transmits the content data to each of the digital signages SN1, ..., SNN.

[0026] The memory 12 includes, for example, a RAM (Random Access Memory) as a work memory used when the processor 11 executes each process, and a ROM (Read Only Memory) that stores programs and data that define the operation of the processor 11. The memory 12 may include a storage device such as a solid state drive (SSD) or a hard disk drive (HDD). The RAM temporarily stores data or information generated or acquired by the processor 11. The ROM stores programs that define the operation of the processor 11. The memory 12 includes a video recording unit 121 and a mark information recording unit 122.

[0027] The video recording unit 121 records information (data) related to the content, which is advertising video or advertising images. The video recording unit 121 records each of the multiple contents. The video recording unit 121 may record content information (which allows each of the multiple recorded contents to be identified), digital signage information on which each content is distributed, and distribution schedule information on which the content is distributed (for example, distribution time slots, etc.) in association with each other.

[0028] The mark information recording unit 122 records mark information and mark schedule information as information about marks that are distributed by each digital signage and superimposed on content for each predetermined time period. The mark information recording unit 122 records the mark information and mark schedule information for each piece of content information.

[0029] The mark information includes information about the characteristics of the mark (for example, placement, color, pattern, shape, etc.) The mark schedule information includes information about the time period during which the mark is superimposed on the content.

[0030] Each of the digital signages SN1, ..., SNN distributes content on which a mark is superimposed. Each of the digital signages SN1, ..., SNN includes at least one monitor 23 and may be capable of distributing multiple different contents independently and simultaneously. Each of the digital signages SN1, ..., SNN includes a communication unit 20, a processor 21, a memory 22, and the monitor 23.

[0031] The communication unit 20 is communicably connected to the advertisement delivery server S1 via the network NW1. The communication unit 20 acquires (receives) various control commands (electrical signals), information about content (e.g., content data, delivery schedule information, etc.), or information about marks (e.g., mark data, mark information, mark schedule information, etc.) transmitted from the advertisement delivery server S1, and outputs the information to the processor 21. The communication unit 20 also transmits various control commands output from the processor 21 to the advertisement delivery server S1.

[0032] The processor 21 is configured using, for example, a CPU, a GPU, a DSP, or an FPGA, and controls the operation of each part of the processor 21. The processor 21 cooperates with the memory 22 to refer to the programs and data stored in the memory 22 and executes the programs, thereby realizing each function of the processor 21.

[0033] The processor 21 distributes content on which a mark has been superimposed in advance by the advertisement distribution server S1 based on distribution schedule information included in the information on the content, or distributes content with a mark superimposed on it based on mark schedule information included in the information on the mark.

[0034] Here, the marks superimposed on each content are generated so that marks with exactly the same characteristics are not superimposed on the same content distributed by two or more digital signages at the same time. This allows the server S2, described later, to identify the digital signage that distributed the content and the time period when the image was captured, based on the marks superimposed on the content displayed in the captured image.

[0035] Furthermore, multiple marks may be superimposed on one piece of content. This makes it possible to identify the digital signage that distributed the content or the time period during which the content was distributed based on the combination of the characteristics of each of the multiple marks, even if there are many digital signages distributing the same content at the same time.

[0036] The mark superimposed on each content may be generated so that marks having exactly the same characteristics are not superimposed on all content distributed at the same time by each digital signage. In such a case, the server S2, which will be described later, can identify the content on which the mark is superimposed, the digital signage on which the content was distributed, and the time period during which the captured image was taken, based on the mark.

[0037] Here, the effect obtained by superimposing a mark will be described. Specifically, when a mark is superimposed on content as shown in the first embodiment, the read distance of the mark is determined based on the size of the digital signage monitor, the size of the display area of ​​each content, the size of the superimposed mark, etc., and is therefore not limited to the readable distance of a typical QR code (registered trademark), which is about several centimeters to 1 meter. As a result, the signage system 100 can realize simultaneous imaging (viewing) of the content displayed on the digital signage by more user terminals than when a QR code (registered trademark) is displayed on the digital signage.

[0038] The memory 22 includes, for example, a RAM as a work memory used when the processor 21 executes each process, and a ROM for storing programs and data that define the operation of the processor 21. The memory 22 may include a storage device including either an SSD or an HDD. The RAM temporarily stores data or information generated or acquired by the processor 21. The ROM stores programs that define the operation of the processor 21. The memory 22 records information related to content (e.g., content data, distribution schedule information, etc.) and information related to marks (e.g., mark data, mark information, mark schedule information, etc.) in association with each other.

[0039] The monitor 23 is configured using a display such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display, etc. The monitor 23 displays the content output by the processor 21 based on the distribution schedule information.

[0040] Each of the user terminals P1, ..., PM, which are examples of terminal devices, is a terminal device (e.g., a smartphone, a tablet device, smart glasses, etc.) owned by each of multiple users who view content, and captures content displayed on each of the digital signages SN1, ..., SNN. Each of the user terminals P1, ..., PM also receives service information corresponding to the captured image. Each of the user terminals P1, ..., PM includes a communication unit 30, a processor 31, a memory 32, a camera 33, and a monitor 34.

[0041] The communication unit 30 is connected to the server S2 or the service information management device S3 via the network NW2 so as to be able to communicate with the server S2 or the service information management device S3. The communication unit 30 acquires various control commands (electrical signals) and service information transmitted from the server S2 or the service information management device S3 and outputs them to the processor 31. The communication unit 30 also associates the captured image output from the processor 31 with the user information and transmits them to the server S2 or the service information management device S3.

[0042] The processor 31 is configured using, for example, a CPU, a GPU, a DSP, or an FPGA, and controls the operation of each part of the processor 31. The processor 31 cooperates with the memory 32 to refer to the programs and data stored in the memory 32 and executes the programs, thereby realizing the functions of the application 311 and the like.

[0043] The application 311 is started and ended based on a user operation. Based on a user operation, the application 311 starts the camera 33 and causes it to capture images of the content displayed (distributed) on each of the digital signages SN1, ..., SNN.

[0044] The application 311 associates the captured image output from the camera 33 with the user information and transmits them to the server S2. Note that the application 311 may further associate the captured image and the user information with information on the time at which the captured image was captured as a timestamp and transmit them to the server S2.

[0045] Furthermore, the application 311 generates a result notification screen (not shown) based on the result information transmitted from the server S2 or the service information management device S3, and outputs and displays it on the monitor 34. Furthermore, the application 311 acquires the service information transmitted from the server S2 or the service information management device S3.

[0046] The memory 32 includes, for example, a RAM as a work memory used when the processor 31 executes each process, and a ROM for storing programs and data that define the operation of the processor 31. The memory 32 may include a storage device such as an SSD or HDD. The RAM temporarily stores data or information generated or acquired by the processor 31. The ROM stores programs that define the operation of the processor 31. The memory 32 records images captured by the camera 33.

[0047] The camera 33 is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is a solid-state imaging element such as a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor), and converts an optical image formed on the imaging surface into an electrical signal.

[0048] The camera 33 captures an image of at least an area including the mark superimposed on the content on the monitor 23 of the digital signage SN1, ..., SNN where the content including the mark is being distributed (displayed). The camera 33 outputs the captured image or video to the processor 31.

[0049] The monitor 34 is configured using a display such as an LCD or an organic EL display, etc. The monitor 34 displays a result notification screen (not shown) that is generated and output by the processor 31.

[0050] The monitor 34 may be configured using a touch panel and receives user operations from the user. The monitor 34 converts the received user operations into electrical signals and outputs them to the processor 31.

[0051] The server S2 detects marks superimposed on content from each of the captured images PIC1, ..., PICM transmitted from each of the user terminals P1, ..., PM. The server S2 identifies the digital signage from which the detected mark was distributed, based on information about the content distributed by each of the digital signages SN1, ..., SNN (e.g., content data, distribution schedule information, etc.) and information about the mark (e.g., mark data, mark information, mark schedule information, etc.). The server S2 includes a communication unit 40, a processor 41, and a memory 42.

[0052] The communication unit 40 is communicably connected to the advertisement delivery server S1, each of the plurality of user terminals P1, ..., PM, and the service information management device S3 via the network NW2. The communication unit 40 outputs each of the captured images PIC1, ..., PICM transmitted from each of the plurality of user terminals P1, ..., PM to the processor 41, and acquires various control commands (electrical signals), service information, etc. transmitted from the server S2 or the service information management device S3 and outputs them to the processor 41. The communication unit 40 also transmits various control commands (electrical signals) and various information (specified digital signage information, result information, service information, etc.) output from the processor 41 to the advertisement delivery server S1, each of the plurality of user terminals P1, ..., PM, or the service information management device S3.

[0053] The processor 41 is configured using, for example, a CPU, a GPU, a DSP, or an FPGA, and controls the operation of each part of the processor 41. The processor 41 cooperates with the memory 42, refers to the programs and data stored in the memory 42, and executes the programs to realize the functions of the feature extraction unit 411 and the like.

[0054] The feature extraction unit 411 acquires at least one content transmitted from the advertisement distribution server S1 and extracts video feature information from the acquired content. Note that the video feature information here is data indicating the features and feature amounts of the content, such as at least one advertising image included in the content, each of multiple advertising images corresponding to each scene in the content, partial images in which at least a partial area is extracted from each of the multiple advertising images constituting the content, metadata, feature amount parameters, etc. The feature extraction unit 411 records the extracted video feature information in the video feature recording unit 421.

[0055] The feature extraction unit 411 detects marks from each of the captured images PIC1, ..., PICM transmitted from each of the multiple user terminals P1, ..., PM, and extracts mark information from the detected marks. The feature extraction unit 411 refers to the mark information recording unit 422, compares the mark schedule information with the capture time information of each of the captured images PIC1, ..., PICM, and compares the extracted mark information with the mark information stored in the mark information recording unit 422 and corresponding to the capture time information, to identify the digital signage SN1, ..., SNN corresponding to each of the captured images PIC1, ..., PICM.

[0056] The memory 42 includes, for example, a RAM as a work memory used when the processor 41 executes each process, and a ROM for storing programs and data that define the operation of the processor 41. The memory 42 may include a storage device such as an SSD or an HDD. The RAM temporarily stores data or information generated or acquired by the processor 41. The ROM stores programs that define the operation of the processor 41. The memory 42 records information related to the content (for example, content data, etc.), and includes a video feature recording unit 421 and a mark information recording unit 422.

[0057] Video feature recording unit 421 records information (features) about each content, and records the video feature information of the content distributed by each of digital signages SN1, . . . , SNN for each piece of content.

[0058] The mark information recording unit 422 records information related to marks, and records mark information and mark schedule information to be superimposed on content distributed by each of the digital signages SN1, . . . , SNN for each piece of content.

[0059] The service information management device S3 manages service information corresponding to each content. The service information management device S3 includes a communication unit 50, a processor 51, and a memory 52.

[0060] The communication unit 50 is connected to the server S2 or each of the plurality of user terminals P1, ..., PM via the network NW2 so as to be able to communicate with them. The communication unit 50 transmits and assigns service information corresponding to the user's viewing results to each of the plurality of user terminals P1, ..., PM, based on various control commands (electrical signals) transmitted from the server S2 or each of the plurality of user terminals P1, ..., PM.

[0061] The processor 51 is configured using, for example, a CPU, a DSP, a GPU, or an FPGA, and controls the operation of each part of the processor 51. The processor 51 cooperates with the memory 52 to refer to the programs and data stored in the memory 52 and execute the programs, thereby realizing the functions of the processor 51.

[0062] The memory 52 includes, for example, a RAM as a work memory used when the processor 51 executes each process, and a ROM for storing programs and data that define the operation of the processor 51. The memory 52 may include a storage device including either an SSD or an HDD. The RAM temporarily stores data or information generated or acquired by the processor 51. The ROM stores programs that define the operation of the processor 51. The memory 52 records a service information recording unit 521 and a viewing result recording unit 522.

[0063] The service information recording unit 521 records the service information corresponding to each content. When different pieces of service information are assigned in accordance with the user's viewing results, the service information recording unit 521 may further record the conditions under which each of the different pieces of service information is assigned.

[0064] Viewing result recording unit 522 records the user information transmitted from server S2, the identified signage information, and the image capture time information in association with each other.

[0065] Next, an example of an operation procedure before content distribution of signage system 100 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a sequence diagram illustrating an example of an operation procedure before content distribution of signage system 100 according to embodiment 1. Fig. 5 is a diagram illustrating an example of an extraction process and a recording process of video feature information by server S2. Note that, for ease of understanding, Figs. 4 and 5 describe an example in which content A is distributed by digital signage SN1, but it goes without saying that the present invention is not limited to this.

[0066] The processor 11 of the advertisement distribution server S1 generates distribution schedule information for distributing content A on each of the digital signages SN1, ..., SNN (St11). The processor 11 transmits the generated distribution schedule information to at least one digital signage SN1 that will distribute content A (St12). The processor 11 generates a control command requesting transmission of content A data to the digital signage SN1, and transmits the control command to the video recording unit 121 (St13).

[0067] Based on the control command, the video recording unit 121 of the advertisement delivery server S1 extracts data of the content A (advertising video data, advertising image data, etc.) (St14), outputs it to the communication unit 10, and causes it to be transmitted to the digital signage SN1 (St15).

[0068] The processor 11 generates mark information to be superimposed on the content A based on the distribution schedule information of the content A (St16). For example, the processor 11 generates a "mark A1" for the content A distributed in the time slot A1, and a "mark A2" for the content A distributed in the time slot A2. The "mark A1" and "mark A2" generated here may be marks that differ in any of the characteristics of the marks, such as placement, color, shape, etc.

[0069] The processor 11 associates the generated mark information ("Mark A1", "Mark A2") with the mark schedule information on which each mark is displayed, and records the association in the mark information recording unit 122 (St17), and transmits the mark information and mark schedule information to the digital signage SN1 that distributes content on which each of "Mark A1" and "Mark A2" is superimposed (St18).

[0070] The mark information recording unit 122 records the mark information and mark schedule information corresponding to the content A in association with the content information of the content A (St19).

[0071] The processor 11 generates a feature extraction command requesting extraction of features of the content A, and transmits the command to the server S2 (St20).

[0072] The server S2 acquires the feature extraction command sent from the advertisement distribution server S1 (St21), and based on this feature extraction command, generates a control command requesting the advertisement distribution server S1 to send data of content A (advertising video data, advertising image data, etc.), and sends it to the advertisement distribution server S1 (St22).

[0073] The video recording unit 121 of the advertisement delivery server S1 extracts the data of the content A based on the control command transmitted from the server S2 (St23), outputs the data to the communication unit 10, and causes it to be transmitted to the server S2 (St24).

[0074] The server S2 extracts video feature information from the content A and records it in the video feature recording unit 421 (St25). Note that the feature extraction unit 411 may extract and record at least one of the image for matching, the partial image for matching, the metadata, and the feature amount parameters as video feature information (features).

[0075] Specifically, feature extraction unit 411 of server S2 extracts image data for matching (hereinafter referred to as "matching image") from the acquired data of content A, or extracts partial image data for matching (hereinafter referred to as "matching partial image") obtained by extracting a portion from the image data of content A. In the example shown in Fig. 5, feature extraction unit 411 extracts matching images Img1 and Img2 corresponding to each scene in content A, and extracts matching partial images Pt1 and Pt2 obtained by partially extracting each person appearing in content A.

[0076] Furthermore, the feature extraction unit 411 extracts metadata Dt1 from the acquired data of content A, and extracts feature amount parameters that indicate the likeliness of content A.

[0077] In this way, by extracting features, server S2 can reduce the amount of matching data used for matching in the digital signage identification process, and reduce the amount of calculations required for the matching process.

[0078] The mark information recording unit 122 of the advertisement distribution server S1 extracts the mark information and the mark schedule information corresponding to the content A transmitted to the server S2, and transmits them to the server S2 (St26).

[0079] The server S2 associates the mark information corresponding to the content A transmitted from the advertisement distribution server S1 with the mark schedule information, and records the information in the mark information recording unit 422 (St27).

[0080] The digital signage SN1 starts distributing content based on the distribution schedule information (St28). For example, the digital signage SN1 superimposes mark A1 on content A and distributes the content based on the distribution schedule information, and then superimposes mark A2 having at least one different mark characteristic from mark A1 on the content A and distributes the content (St28). Note that the mark superimposition process may be executed in advance by the advertisement distribution server S1.

[0081] Next, a modified example of the operation procedure example before advertisement distribution of signage system 100 will be described with reference to Fig. 6. Fig. 6 is a sequence diagram illustrating a modified example of the operation procedure example before advertisement distribution of signage system 100 according to embodiment 1. Note that, in Fig. 6, for ease of understanding, an example in which content A is distributed by digital signage SN1 will be described as in the explanation of Fig. 4, but it goes without saying that the present invention is not limited to this.

[0082] The processor 11 of the advertisement distribution server S1 generates distribution schedule information for distributing content A on each of the digital signages SN1, ..., SNN (St31). The processor 11 transmits the generated distribution schedule information to at least one digital signage SN1 that distributes content A (St32).

[0083] The processor 11 generates mark information corresponding to the content A based on the distribution schedule information of the content A (St33). The processor 11 associates the generated mark information ("mark A1", "mark A2") with the mark schedule information in which each mark is displayed, records the information in the mark information recording unit 122 (St34), and transmits the information to the digital signage SN1 (St35).

[0084] The mark information recording unit 122 records the mark information and mark schedule information corresponding to the content A in association with the content information of the content A (St36).

[0085] The digital signage SN1 generates a control command requesting transmission of the data of the content A to the digital signage SN1, and transmits the control command to the advertisement distribution server S1 (St37).

[0086] The processor 11 of the advertisement distribution server S1 requests the video recording unit 121 to transmit data of the content A based on the control command transmitted from the digital signage SN1 (St38). The video recording unit 121 extracts data of the content A (advertising video data, advertising image data, etc.) (St39), outputs it to the communication unit 10, and transmits it to the digital signage SN1 (St40).

[0087] The processor 11 generates a feature extraction command requesting extraction of features of the content A, and transmits the command to the server S2 (St41).

[0088] The server S2 acquires the feature extraction command sent from the advertisement distribution server S1 (St42), and based on this feature extraction command, generates a control command requesting the advertisement distribution server S1 to send data of content A (advertising video data, advertising image data, etc.), and sends it to the advertisement distribution server S1 (St43).

[0089] The video recording unit 121 of the advertisement delivery server S1 extracts the data of the content A based on the control command transmitted from the server S2 (St44), outputs the data to the communication unit 10, and causes it to be transmitted to the server S2 (St45).

[0090] The server S2 extracts the video feature information from the content A and records it in the video feature recording unit 421 (St46).

[0091] The mark information recording unit 122 of the advertisement distribution server S1 extracts the mark information and the mark schedule information corresponding to the content A transmitted to the server S2, and transmits them to the server S2 (St47).

[0092] The server S2 associates the mark information corresponding to the content A transmitted from the advertisement distribution server S1 with the mark schedule information, and records the information in the mark information recording unit 422 (St48).

[0093] The digital signage SN1 starts distributing content based on the distribution schedule information (St49). For example, the digital signage SN1 superimposes mark A1 on content A and distributes it based on the distribution schedule information, and then superimposes mark A2 having at least one different mark characteristic from mark A1 and distributes it (St49). Note that the mark superimposition process may be executed in advance by the advertisement distribution server S1.

[0094] As described above, before content distribution, signage system 100 transmits distribution schedule information for content A, mark information, mark schedule information, and content A to the corresponding digital signages SN1, ..., SNN, respectively, thereby enabling the content to be distributed.

[0095] Furthermore, signage system 100 transmits mark information, mark schedule information, and content A to server S2 before content distribution and executes extraction of video feature information corresponding to content A in advance, thereby making it possible to identify from which digital signage the captured images of content A transmitted from each of multiple user terminals P1, ..., PM were captured. Note that, although not shown in the sequences shown in Figures 4 and 7, server S2 may obtain and record distribution schedule information of each digital signage SN1, ..., SNN from advertisement distribution server S1.

[0096] Next, an example of an operation procedure after content distribution of signage system 100 will be described with reference to Fig. 7. Fig. 7 is a sequence diagram illustrating an example of an operation procedure after content distribution of signage system 100 according to embodiment 1 starts. Note that, for ease of understanding, Fig. 7 describes an example of providing service information to user terminal P1, but it goes without saying that the present invention is not limited to this.

[0097] The processor 31 of the user terminal P1 instructs the application 311 to perform imaging processing based on a user operation (St50). The application 311 activates the camera 33 and causes it to capture an image of content being distributed by any of the digital signages SN1, ..., SNN (St51).

[0098] The application 311 acquires an image captured by the camera 33 (St52), and performs data amount reduction processing on the captured image (St53). Note that the processing of step St53 is not essential and may be omitted.

[0099] The data volume reduction process referred to here may be an image cutout process that cuts out a necessary area from the captured image (for example, an area that includes something other than content A, such as the background), a resolution reduction process that reduces the resolution of the captured image, a high compression rate encoding process, a feature extraction process that extracts features from the captured image, or any other process.

[0100] The user terminal P1 generates a timestamp indicating the image capturing time information when the captured image was captured, and transmits the user information, the captured image after the data amount reduction process, and the timestamp in association with each other to the server S2 (St54). Note that the user information here is information that can specify and identify the user who owns the user terminal P1, and may be, for example, the user's user ID, email address, or terminal ID assigned to the user terminal P1. The user information may also include user attribute information (for example, age, gender, etc.).

[0101] The server S2 acquires the user information, the captured image after the data amount reduction process, and the timestamp transmitted from the user terminal P1 (St55). The server S2 performs image processing on the acquired captured image, and acquires a plurality of pieces of video feature information and mark information from the captured image (St56). Note that if the digital signage identification process is performed using only the mark information, the server S2 may omit the process of acquiring the video feature information.

[0102] The server S2 refers to the timestamp corresponding to the captured image and narrows down the video feature information of each of the multiple contents recorded in the video feature recording unit 421 to video feature information that may correspond (St57). Note that the server S2 may compare the timestamp corresponding to the captured image with the mark schedule information to narrow down the mark information that may correspond, and may further narrow down the video feature information to be compared based on the narrowed down mark information.

[0103] Furthermore, the potentially corresponding video feature information and mark information referred to here refers to, for example, video feature information and mark information extracted from content that was distributed at an imaging time that was a predetermined time (e.g., 1 minute, 3 minutes, etc.) before the imaging time indicated by the timestamp.

[0104] In addition, if the server S2 has pre-recorded the distribution schedule information for each of the digital signages SN1, ..., SNN, it may further narrow down the video feature information to be compared based on the imaging time indicated by the timestamp and the distribution schedule information.

[0105] The server S2 compares the plurality of pieces of video feature information after the narrowing process, the mark information corresponding to these pieces of video feature information, and the captured image, and identifies the digital signage to which the content shown in the captured image was distributed (St58). Note that, if the server S2 determines that the digital signage cannot be identified, it may generate a notification that the digital signage cannot be identified and send it to the user terminal P1.

[0106] Furthermore, when the content is video, the server S2 acquires different captured images depending on the timing at which the user acquires (captures) the captured image, even if the content is the same. In such cases, the server S2 identifies the content using the video feature information. This allows the server S2 to more appropriately identify the digital signage from which the content shown in the captured image was distributed, even when the content is video.

[0107] Furthermore, the video feature recording unit 421 may store multiple matching images Img1, Img2, multiple pieces of metadata Dt1, or multiple feature parameters for one piece of content. By storing different matching images, metadata, or feature parameters corresponding to scenes with different video features within one piece of content, the server S2 can use the video feature information to more appropriately identify the digital signage to which the content was distributed, even when the content is video.

[0108] The server S2 associates the user information, digital signage information indicating the identified digital signage, and image capture time information of the captured image based on the timestamp, and transmits them to the service information management device S3 as the user's viewing result (St59).

[0109] The service information management device S3 acquires service information to be granted to the user in accordance with the user's viewing results (user information, digital signage information, image capture time information, etc.) transmitted from the server S2 (St60). The service information management device S3 associates the user information, digital signage information, and image capture time information transmitted from the server S2 as the user's viewing results, and records them for each user in the viewing result recording unit 522. The service information management device S3 transmits service information to be granted to the user to the server S2 based on the user's viewing results (St61).

[0110] The service information here refers to information indicating the content of the service, such as coupons, points, etc., that are given to the user in accordance with the viewing results. In addition, if the service information is given only when a predetermined condition is met, the service information management device S3 may generate information on the current user's viewing results (history) for the predetermined condition instead of the service information, and transmit this information to the user terminal P1.

[0111] The server S2 generates result information based on the service information (St62). For example, if the service information includes any service information (e.g., coupon, points, etc.), the server S2 generates result information indicating the content of the service information and transmits it to the user terminal P1 (St63).

[0112] Based on the result information transmitted from the server S2, the user terminal P1 generates a result notification screen (not shown) that notifies the user of the result information, and outputs and displays it on the monitor 34 (St64).

[0113] As a result, the signage system 100 can identify the digital signage that delivered the content shown in the image captured by the user terminal P1, and can provide (provide) the user with service information corresponding to the user's viewing results based on the identified digital signage. This allows the signage system 100 to obtain more accurate user viewing results and more accurate advertising effectiveness of the content. Furthermore, the signage system 100 can support advertisers in more detailed analysis of advertising effectiveness and demand analysis of content content, based on the user's personal information (e.g., age, gender, etc.) included in or associated with the user information.

[0114] (Modification of the first embodiment) In the first embodiment, an example is shown in which service information is assigned to each of the user terminals P1, ..., PM by the server S2. In the modified example of the first embodiment, an example is described in which service information is assigned to each of the user terminals P1, ..., PM when the server S2 and the service information management device S3 are managed by different businesses and the server S2 does not have the authority to assign service information.

[0115] Note that signage system 100A according to the modified example of embodiment 1 has substantially the same configuration as signage system 100 according to embodiment 1. In the following description of the modified example of embodiment 1, configurations and functions that differ from those of signage system 100 according to embodiment 1 will be described.

[0116] Referring to FIG. 8, a diagram showing an example of the overall configuration of a signage system 100A according to a modification of the first embodiment is shown.

[0117] Signage system 100A, as an example of a signage authentication system, includes an advertisement distribution server S1, one or more digital signages SN1, ..., SNN, one or more user terminals P1, ..., PM, a server S2A, a service information management device S3A, and one or more networks NW1, NW2. Note that, in Fig. 8, networks NW1, NW2 are illustrated as separate entities to facilitate understanding of signage system 100A, but this is not limiting.

[0118] The server S2A detects marks superimposed on the content from each of the captured images PIC1, ..., PICM transmitted from each of the user terminals P1, ..., PM. The server S2 identifies the digital signage from which the detected mark was distributed, based on information about the content distributed by each of the digital signages SN1, ..., SNN (e.g., content data, distribution schedule information, etc.) and information about the mark (e.g., mark data, mark information, mark schedule information, etc.), which has been recorded in advance.

[0119] The server S2A transmits information about the identified digital signage, user information corresponding to the user terminals P1, ..., PM, and the capture time when the captured image was captured (a timestamp generated by the application 111, or server time information assigned by the server S2A, etc.) to the service information management device S3A.

[0120] The service information management device S3A is connected to each of the multiple user terminals P1, ..., PM and the server S2A via the network NW2 so that data communication can be performed between them. The service information management device S3A manages service information corresponding to each content. The service information management device S3 records the identified digital signage information transmitted from the server S2A, the user information corresponding to the user terminals P1, ..., PM, and the capture time when the captured image was captured, and also acquires service information granted to the users who own the user terminals P1, ..., PM based on the user viewing result information transmitted from the user terminals P1, ..., PM, and transmits the service information to the user terminals P1, ..., PM.

[0121] Next, a modified example of the operational procedure example after content distribution of signage system 100A will be described with reference to Fig. 9 and Fig. 10. Fig. 9 is a sequence diagram illustrating a modified example of the operational procedure example after content distribution of signage system 100A according to embodiment 1 starts. Fig. 10 is a flowchart illustrating a modified example of the operational procedure example after content distribution of user terminal P1 according to embodiment 1 starts. Note that, for ease of understanding, Figs. 9 and 10 describe an example in which service information is assigned to user terminal P1, as in Fig. 7, but it goes without saying that the present invention is not limited to this.

[0122] The processor 11 of the user terminal P1 instructs the application 111 to perform imaging processing based on a user operation (St50). The application 111 activates the camera 13 and causes it to capture an image of content being distributed by any of the digital signages SN1, ..., SNN (St51).

[0123] The application 111 acquires a captured image captured by the camera 13 (St52), and performs data amount reduction processing on the captured image (St53). Note that the processing of step St53 is not essential and may be omitted.

[0124] The user terminal P1 generates a timestamp indicating information about the time when the captured image was captured, associates the user information with the captured image after the data amount reduction process, and transmits the timestamp to the server S2A (St54A).

[0125] The server S2A acquires (receives) the user information transmitted from the user terminal P1 and the captured image after the data amount reduction process (St55A). The server S2A acquires the time information in the server S2A at the timing of this acquisition (reception) (hereinafter referred to as "server time information") as the capture time information of the captured image (St55A). The server S2A performs image processing on the acquired captured image and acquires a plurality of pieces of video feature information and mark information from the captured image (St56).

[0126] The server S2A refers to the server time information corresponding to the captured image, and narrows down the video feature information that may correspond from among the video feature information of each of the multiple contents recorded in the video feature recording unit 421 (St57A). Note that the server S2A may also compare the server time information corresponding to the captured image with the mark schedule information to narrow down the mark information that may correspond, and narrow down the video feature information based on the narrowed down mark information.

[0127] Furthermore, the potentially corresponding video feature information and mark information referred to here refers to, for example, video feature information and mark information extracted from content that was distributed at an imaging time that was a predetermined time (e.g., 3 minutes, 5 minutes, etc.) before the imaging time indicated by the server time information.

[0128] In addition, if the server S2A has pre-recorded distribution schedule information for each of the digital signages SN1, ..., SNN, the server S2A may narrow down the video feature information based on the imaging time indicated by the server time information and the distribution schedule information.

[0129] The server S2A compares the multiple pieces of video feature information obtained after the narrowing process with the mark information corresponding to these pieces of video feature information and the captured image, and identifies the digital signage from which the content shown in the captured image was distributed (St58).

[0130] The server S2A associates the user information, the identified digital signage information, and the image capture time information of the captured image based on the timestamp, and transmits them to the service information management device S3A (St59).The server S2A also generates viewing result information based on the digital signage identification result, and transmits it to the user terminal P1 (St65).

[0131] The user terminal P1 acquires the viewing result information transmitted from the server S2A (St65A), and determines whether the acquired viewing result information is successful (i.e., whether the digital signage has been identified by the server S2A) (St65B). The user terminal P1 further transmits the acquired viewing result information to the service information management device S3A (St66).

[0132] The service information management device S3A associates the user information, digital signage information, and image capture time information transmitted from the server S2A and records them in the viewing result recording unit 522. Based on the viewing result information transmitted from the user terminal P1, the service information management device S3A acquires service information to be provided to the user that corresponds to the user's viewing result (St67). The service information management device S3A transmits the service information to be provided to the user to the server S2A (St68).

[0133] The user terminal P1 acquires the service information transmitted from the service information management device S3A (St69), generates a result notification screen (not shown) based on the judgment result of the processing in step St65B, and outputs and displays it on the monitor 34 (St69A, St69B).

[0134] As described above, signage system 100A can individually add service information to each user terminal P1, ..., PM that has confirmed viewing of the corresponding content, based on user information collected from each of multiple user terminals P1, ..., PM, digital signage information, and server time information (i.e., image capture time information). This allows signage system 100A to add service information to users even if the operator of server S2A and the business that adds the service information are different parties.

[0135] The above-described signage systems 100 and 100A have been described mainly as an example of use in which corresponding service information is assigned (provided) based on the identification of digital signage displayed in captured images transmitted from each of the user terminals P1, ..., PM (i.e., the user's content viewing results), but it goes without saying that the use is not limited to this. Other uses will be described below.

[0136] Signage systems 100 and 100A may provide service information based on the user's viewing results associated with the identification of digital signage, or may provide service information based on whether or not a condition other than the identification of digital signage is satisfied.

[0137] For example, signage system 100, 100A may accumulate user viewing results and provide service information corresponding to a condition when it is determined that the user has viewed content a predetermined number of times or more, when it is determined that the user has viewed content a predetermined number of times or more within a predetermined period (for example, in a points format), or when it is determined that all digital signage that distributes the same content has been viewed (for example, in a stamp rally format).Signage system 100, 100A may also provide different service information depending on the degree to which the condition has been met.

[0138] As described above, signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment are signage systems configured with one or more computers that display content (an example of an image) on a first digital signage and a second digital signage. The computers display a first image, in which a first mark is superimposed on the content, on the first digital signage, and display a second image, in which a second mark different from the first mark is superimposed on the content, on the second digital signage.

[0139] The computer referred to here is a device equipped with a so-called communication unit, a processor, and a memory, and is configured to include, for example, the advertisement distribution server S1.

[0140] As a result, signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment can collect viewing information about content displayed on each of a plurality of digital signages, based on marks that appear in captured images.

[0141] Furthermore, the computers in signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment associate information about the first mark with information about the first digital signage, and associate information about the second mark with information about the second digital signage, and record the associated information. This allows signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment to collect information about the digital signage viewed by the user based on the marks shown in the captured image.

[0142] Furthermore, the computers in signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment further record information about a third mark displayed on the first digital signage and different from the first mark, and information about a fourth mark displayed on the second digital signage and different from the second mark, and after displaying the first content, display the third content in which the third mark is superimposed on the content on the first digital signage, and after displaying the second content, display the fourth content in which the fourth mark is superimposed on the content on the second digital signage. As a result, signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment can more accurately collect viewing information about content viewed by users, even if the content distributed by the same digital signage has been viewed multiple times by the users.

[0143] Furthermore, the computers in signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment record, on the first digital signage, a first time slot during which the first content is displayed and a third time slot during which the third content is displayed, and record, on the second digital signage, a second time slot during which the second content is displayed and a fourth time slot during which the fourth content is displayed. This allows signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment to collect information about the digital signage viewed by the user and information about the time slots during which this content was displayed (time slots viewed by the user) based on marks displayed in the captured image.

[0144] As described above, signage systems 100 and 100A (examples of signage authentication systems) according to the first embodiment and the modification of the first embodiment are configured with one or more computers that authenticate digital signage based on captured images of content (examples of images) displayed by the digital signage. The computer records information about multiple digital signages in association with information about multiple different marks superimposed on the content displayed on each digital signage, acquires the captured images, extracts the marks that appear in the acquired captured images, and authenticates the digital signage corresponding to the content that appears in the captured images based on a comparison between the extracted marks and the recorded information about the multiple different marks.

[0145] The computer here is a device equipped with a so-called communication unit, a processor, and a memory, and is configured to include, for example, the server S2.

[0146] As a result, the signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment can identify which of the multiple digital signages has been viewed by the user based on the mark displayed in the captured image. Therefore, the signage systems 100 and 100A can collect viewing information about the content for each digital signage.

[0147] Furthermore, the computer in signage systems 100 and 100A according to the first embodiment and the modification thereof stores information about a plurality of digital signages, information about a plurality of contents displayed on the plurality of digital signages (e.g., content data, distribution schedule information, etc.), and information about a plurality of different marks superimposed on the contents (e.g., mark data, mark information, mark schedule information, etc.), in association with each other, extracts information about content similar to the content displayed in the captured image from the information about the plurality of contents based on the information about the plurality of contents and the content displayed in the captured image (i.e., video feature information), and authenticates the digital signage based on the mark displayed in the captured image and information about the mark associated with the extracted information about the content. As a result, signage systems 100 and 100A according to the first embodiment and the modification thereof can identify the content and the digital signage to which the content is distributed based on the mark displayed in the captured image. Furthermore, signage systems 100 and 100A can extract video feature information (an example of information related to content) similar to the content shown in the captured image, that is, narrow down the video feature information used (matched) in the authentication process of digital signage, thereby reducing the processing load and shortening the processing time required for the authentication process of digital signage. Therefore, signage systems 100 and 100A can more efficiently collect content viewing information for each digital signage.

[0148] Furthermore, the information about the marks in the signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment includes multiple different marks superimposed on the content and information about the time period during which the marks are superimposed on the content. The computer authenticates the time period during which the captured image was captured and the digital signage based on the marks appearing in the captured image and the information about the marks associated with the extracted information about the content. As a result, the signage systems 100 and 100A according to the first embodiment and the modification of the first embodiment can identify the digital signage viewed by the user and the time period during which this content was displayed (the time period during which the user viewed it) based on the marks appearing in the captured image. Therefore, the signage systems 100 and 100A can collect content viewing information more accurately even if the user views content distributed by the same digital signage multiple times.

[0149] Furthermore, the information about the mark in signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment includes any one of the mark features, such as the mark shape, the mark pattern, the mark color, or the mark arrangement. This allows signage systems 100 and 100A according to the first embodiment and the modified example of the first embodiment to identify the digital signage viewed by the user based on the mark features.

[0150] Furthermore, information related to content in signage systems 100 and 100A according to the first embodiment and the modification thereof includes partial content cut out from any area of ​​the entire content, feature quantities of the content, or metadata of the content. As a result, signage systems 100 and 100A according to the first embodiment and the modification thereof can reduce the load of the matching process and shorten the time required for the matching process in the content matching process.

[0151] As described above, a signage authentication program is provided for realizing the steps of capturing an image of content (an example of an image) displayed on a digital signage on a user terminal P1, ..., PM (an example of a terminal device), which is a computer communicatively connected between the signage system 100, 100A and the signage system 100, 100A according to embodiment 1 and a variant of embodiment 1, transmitting the captured image to the signage system, extracting a mark appearing in the captured image, comparing the extracted mark with information about a plurality of marks recorded in advance, and obtaining an authentication result authenticating the digital signage corresponding to the content appearing in the captured image based on information about the digital signage associated with the information about the compared mark, and outputting the obtained authentication result.

[0152] As a result, the user terminals P1, ..., PM in the first embodiment and the modification of the first embodiment can capture an image that identifies the digital signage to which the content viewed by the user is distributed. Therefore, the signage systems 100, 100A can collect viewing information about the content for each digital signage.

[0153] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention. [Industrial Applicability]

[0154] The present disclosure is useful as a signage system for collecting viewing information of advertisements displayed on digital signage, a signage distribution method, a signage authentication system, a signage authentication method, and a signage authentication program. [Explanation of symbols]

[0155] 10, 20, 30, 40, 50 Communications Department 11,21,31,41,51 processors 12, 22, 32, 42, 52 memory 23,34 monitor 33 Camera 100,100A Signage System 121 Video Recording Department 122,422 Mark information recording section 311 Application 421 Video Characteristics Recording Unit 521 Service Information Recording Unit 522 Viewing result recording unit Mk1, Mk2, Mk3, MkM marks NW1,NW2 network P1, PM user terminal PIC1,PIC2,PIC3,PICM Captured images S1 Ad distribution server S2, S2A servers S3, S3A Service information management device SN1,SNN Digital Signage

Claims

1. A signage authentication system including one or more computers that authenticates a digital signage based on a captured image of an image displayed by the digital signage, The computer Recording information about the plurality of digital signages in association with information about a plurality of different marks superimposed on the images displayed on the respective digital signages; Acquire the captured image; extracting a mark that appears in the acquired captured image; authenticating the digital signage corresponding to the image shown in the captured image based on a comparison between the extracted mark and the recorded information relating to the different plurality of marks; Signage authentication system.

2. The computer information on the plurality of digital signages, information on the plurality of images displayed on the plurality of digital signages, and information on the plurality of different marks superimposed on the images are recorded in association with each other; extracting information about an image similar to the image shown in the captured image from the information about the plurality of images based on the information about the plurality of images and the image shown in the captured image; authenticating the digital signage based on a mark appearing in the captured image and information about the mark associated with information about the extracted image; The signage authentication system according to claim 1 .

3. the information about the marks includes the different marks to be superimposed on the image and information about a time period during which the marks are to be superimposed on the image; The computer authenticating the time period when the captured image was captured and the digital signage based on the mark appearing in the captured image and information related to the mark associated with the extracted information about the image; The signage authentication system according to claim 2 .

4. The information about the mark is The mark includes any one of the features of the mark, the shape of the mark, the pattern of the mark, the color of the mark, or the arrangement of the mark. The signage authentication system according to claim 1 .

5. The information about the similar images includes: a partial image obtained by cutting out any region of the entire image, a feature amount of the image, or metadata of the image; The signage authentication system according to claim 2 .

6. A signage authentication method performed by a system configured with one or more computers, which authenticates a digital signage based on a captured image of an image displayed on the digital signage, Recording information about the plurality of digital signages in association with information about a plurality of different marks superimposed on the images displayed on the respective digital signages; Acquire the captured image; extracting a mark that appears in the acquired captured image; authenticating the digital signage corresponding to the image shown in the captured image based on a comparison between the extracted mark and the recorded information relating to the different plurality of marks; Signage authentication method.

7. Signage system and A terminal device that is a computer connected to the signage system so as to be able to communicate with the signage system, capturing an image displayed on the digital signage; transmitting the captured image to the signage system; extracting a mark appearing in the captured image, comparing the extracted mark with information about a plurality of pre-recorded marks, and acquiring an authentication result of authenticating the digital signage corresponding to the image appearing in the captured image based on information about the digital signage associated with the information about the compared mark; outputting the obtained authentication result; Signage Certification Program.

Images