Information processing device, display system, and display control method

Abstract

The present invention comprises: a display control unit (51) for providing at least a main area and a candidate area on a display screen of a display device, so that when playback of the content displayed in the main area is finished, the content displayed in the candidate area is displayed in the main area; and a detection unit (52) for detecting a person from a captured image obtained by at least capturing a location where the display screen can be visually confirmed, and the display control unit (51) changes the content currently displayed in the candidate area according to the person during playback of the content displayed in the main area.

Description

Technical Field

[0001] The invention relates to an information processing device, a display system and a display control method.

[0002] This application claims priority based on PCT / JP2020 / 011705 filed on March 17, 2020, the contents of which are incorporated herein by reference. Background Art

[0003] The following method is disclosed: in order to provide appropriate advertising content to the target audience in an electronic billboard such as a digital signage, a plurality of contents are first displayed on a screen divided into equal sizes, and the most viewed content is enlarged and displayed (for example, refer to Patent Document 1).

[0004] However, in the above-mentioned technology, since the content to be subsequently enlarged and displayed is not clearly indicated, the target person remains within the effective range of the content display device and the attraction effect of arousing his / her desire to buy becomes weak.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2012-134836 Summary of the invention

[0008] Problems to be solved by the invention

[0009] The problem to be solved is that it is impossible to provide content that has a high attraction effect on a target within the effective range.

[0010] Means for solving problems

[0011] One embodiment of the present invention is an information processing device, wherein the information processing device comprises: a display control unit, which sets at least a main area and a candidate area on a display screen of the display device, so that when the playback of the content displayed in the main area ends, the content displayed in the candidate area is displayed in the main area; and a detection unit, which detects a person from a captured image obtained by at least capturing a place where the display screen can be visually confirmed, and the display control unit changes the content currently displayed in the candidate area according to the person during the playback of the content displayed in the main area.

[0012] In addition, one embodiment of the present invention is a display system comprising a display device and an information processing device, wherein the display device displays content for advertising, wherein the information processing device comprises: a display control unit, which sets at least a main area and a candidate area on a display screen of the display device, so that when playback of the content displayed in the main area ends, the content displayed in the candidate area is displayed in the main area; and a detection unit, which detects a person from a captured image obtained by at least capturing a place where the display screen can be visually confirmed, and the display control unit changes the content currently displayed in the candidate area according to the person during playback of the content displayed in the main area.

[0013] In addition, one embodiment of the present invention is a display control method, wherein a display control unit sets at least a main area and a candidate area on a display screen of a display device, so that when playback of content displayed in the main area ends, content displayed in the candidate area is displayed in the main area, a detection unit detects a person from a captured image obtained by at least capturing a place where the display screen can be visually confirmed, and the display control unit changes the content currently displayed in the candidate area according to the person during playback of content displayed in the main area.

[0014] In addition, one embodiment of the present invention is an information processing device, wherein the information processing device comprises: a display control unit, which sets at least a main area and a candidate area on a display screen of the display device, so that when the playback of the content displayed in the main area ends, the content displayed in the candidate area is displayed in the main area; and a detection unit, which detects a person from a captured image obtained by at least capturing a place where the display screen can be visually confirmed, and the display control unit determines the priority of the content according to the person during the playback of the content displayed in the main area, and displays the content in the candidate area according to the determined priority.

[0015] Effects of the Invention

[0016] According to the present invention, it is possible to provide content that has a higher attraction effect on a target within an effective range. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 This is a schematic block diagram illustrating a configuration of a display system to which an information processing device according to an embodiment of the present invention is applied.

[0018] Figure 2A It is a schematic diagram showing a display example of the content display device.

[0019] Figure 2B It is a schematic diagram showing a display example of the content display device.

[0020] Figure 2C It is a schematic diagram showing a display example of the content display device.

[0021] Figure 2D It is a schematic diagram showing a display example of the content display device.

[0022] Figure 2E It is a schematic diagram showing a display example of the content display device.

[0023] Figure 2F It is a schematic diagram showing a display example of the content display device.

[0024] Figure 3 It is a schematic block diagram showing the functional structure of the display system.

[0025] Figure 4 This is a schematic diagram showing the data structure and data example of the advertisement ID table stored in the information processing device.

[0026] Figure 5 This is a schematic diagram showing the data structure and data example of the advertisement attribute table stored in the information processing device.

[0027] Figure 6 This is a flowchart for explaining the operation of the display control process executed by the information processing device.

[0028] Figure 7 This is a flowchart for explaining the operation of the display control process executed by the information processing device.

[0029] Figure 8 This is a flowchart for explaining the operation of the display control process executed by the content output device.

[0030] Fig. 9 It is a diagram showing a basic structure of the information processing device of the present invention.

[0031] Fig.10 It is a functional block diagram showing the structure of the information processing device 50 in another embodiment.

[0032] Fig.11 It is a functional block diagram showing the structure of the information processing device 60 in another embodiment.

[0033] Fig.12 It is a flowchart explaining the operation of the information processing device 60 . DETAILED DESCRIPTION

[0034] Hereinafter, one embodiment of the present invention will be described.

[0035] Figure 11 is a schematic block diagram for explaining the structure of a display system to which an information processing device in an embodiment of the present invention is applied. In this embodiment, the display system 100 is a system for controlling the display of content displayed on an electronic signage such as a digital signage. The content is advertising content, and may be a still image or a moving image, and may or may not have voice.

[0036] In the figure, a display system 100 includes a camera device 1 , a content display device 2 , a content output device 3 , and an information processing device 4 .

[0037] The camera device 1, the content output device 3, and the information processing device 4 are connected to each other by a wired or wireless LAN (Local Area Network). In addition, the content display device 2 and the content output device 3 are connected via a video cable for transmitting video signals.

[0038] The camera device 1 is installed near the content display device 2 and captures images of people who are within an effective range where they can view the display screen of the content display device 2 .

[0039] The content display device 2 displays advertising content on its display screen.

[0040] The content output device 3 outputs a video signal of the content to the content display device 2 , so that the content is displayed on the content display device 2 .

[0041] The information processing device 4 is a computer that performs display control of content displayed on the content display device 2 .

[0042] Figure 2A to Figure 2F : is a schematic diagram showing a display example of a content display device. The content display device 2 is capable of displaying different or the same advertisement contents in the main area, which is the largest display area in its display screen, and in a standby area whose display area is smaller than the main area. The contents of the advertisement displayed in the main area and the contents of the advertisement displayed in the standby area may be the same or different. Hereinafter, the contents of the advertisement displayed in the main area are referred to as the main advertisement, and the contents of the advertisement displayed in the standby area are referred to as thumbnail advertisements. Thumbnail advertisements may be text information, dynamic images, still images, or advertisements composed of any combination thereof. In addition, they may or may not have voice, and may be the same as the main advertisement of the advertisement, or may be a thumbnail image (dynamic image or still image) of the main advertisement. In addition, as long as the thumbnail advertisement is content related to the content displayed as the main advertisement, a part of the main advertisement may be used as the thumbnail advertisement.

[0043] The thumbnail advertisement displayed in the candidate area is an advertisement that is a candidate for display in the main area next. That is, when the content display device 2 is about to display the next main advertisement after the playback of the main advertisement currently being displayed is completed, it displays any thumbnail advertisement among the thumbnail advertisements currently displayed in the candidate area as the main advertisement in the main area. In addition, a priority is associated with each candidate area, and the content display device 2 arranges the thumbnail advertisement in the candidate area corresponding to its priority and displays it.

[0044] exist Figure 2A In the example shown, the content display device 2 divides its display screen into a main area MA, a non-display area HA, and a candidate area SA, and displays different or the same advertisement contents in the main area MA and the candidate area SA. The non-display area HA shown in black is an area where nothing is displayed, such as advertisement contents. The non-display area HA may also not display advertisement contents, but may display an image painted with a certain color such as black in the area.

[0045] exist Figure 2B In the example shown, the content display device 2 divides its display screen into a main area MB and two candidate areas SB1 and SB2, and displays different or the same advertisement content in each area. In the candidate area SB1 shown with the diagonal line, the thumbnail advertisement is grayed out. Thus, the thumbnail advertisement displayed in the candidate area SB1 is in a grayed-out state, so although the thumbnail advertisement can be visually confirmed, it is displayed in gray rather than in color. In the candidate area SB2 shown in white, the thumbnail advertisement can also be displayed in color. Thus, for example, the priority of the candidate area SB2 that is easy to visually confirm can be made the highest, and the priority of the candidate area SB1 that is displayed in gray can be made the second. In this case, the content display device 2 displays the thumbnail advertisement with the highest priority in the candidate area SB2, and displays the thumbnail advertisement with the second highest priority in the candidate area SB1.

[0046] exist Figure 2C In the example shown, the content display device 2 divides its display screen into a main area MC, a selling point area PP, and a candidate area SC, and displays different or the same advertisement contents in the main area MC and the candidate area SC. The selling point area PP displays related information corresponding to the thumbnail advertisement displayed in the candidate area SC located below it. As the related information, there is, for example, a description text related to the thumbnail advertisement.

[0047] exist Figure 2D In the example shown, the content display device 2 divides its display screen into a main area MD and a candidate area SD, and displays different or the same advertisement contents in each area.

[0048] exist Figure 2EIn the example shown, the content display device 2 divides its display screen into a main area ME and four candidate areas SE1, SE2, SE3, and SE4, and displays different advertisement contents in each area. However, it is also possible that the content of the advertisement displayed in the main area ME is the same as the content of the advertisement displayed in any candidate area. Candidate area SE1 to candidate area SE4 are arranged in a vertical row on the left side of the main area ME when the display screen is viewed from the front. For example, the priority can be arranged from high to low in the order of candidate area SE1, candidate area SE2, candidate area SE3, and candidate area SE4. For example, it is possible to allocate the thumbnail advertisement in such a way that the higher the priority of the thumbnail advertisement, the closer the area displayed on the display screen is to the upper side of the display screen. In this case, the content display device 2 displays the thumbnail advertisement with the highest priority in the candidate area SE1, the thumbnail advertisement with the second highest priority in the candidate area SE2, the thumbnail advertisement with the third highest priority in the candidate area SE3, and the thumbnail advertisement with the fourth highest priority in the candidate area SE4. In addition, in the Figure 2E In the example of FIG. 1 , each candidate area (SE1, SE2, SE3, SE4) may be arranged on the right side of the main area ME when the display screen is viewed from the front.

[0049] exist Figure 2F In the example shown, the content display device 2 divides its display screen into the main area MF and four candidate areas SF1, SF2, SF3, and SF4, and displays different advertisement contents in each area. However, it is also possible that the content of the advertisement displayed in the main area MF is the same as the content of the advertisement displayed in any candidate area. The candidate areas SF1 to SF4 are arranged in a horizontal row on the lower side of the main area MF when the display screen is viewed from the front. For example, the priority can be arranged from high to low in the order of candidate area SF1, candidate area SF2, candidate area SF3, and candidate area SF4. For example, it can be allocated in a manner that the higher the priority of the thumbnail advertisement, the closer the area displayed on the display screen is to the left side of the display screen. In this case, the content display device 2 displays the thumbnail advertisement with the highest priority in the candidate area SF1, displays the thumbnail advertisement with the second highest priority in the candidate area SF2, displays the thumbnail advertisement with the third highest priority in the candidate area SF3, and displays the thumbnail advertisement with the fourth highest priority in the candidate area SF4. It should be noted that it is also possible not to set a priority for each candidate area SF1 to candidate area SF4. In this case, each thumbnail advertisement is displayed in any one of the four candidate areas SF1 to candidate area SF4 regardless of the priority of the thumbnail advertisement. Figure 2F In the example of FIG. 1 , each candidate area (SF1, SF2, SF3, SF4) may be arranged on the upper side of the main area MF when the display screen is viewed from the front.

[0050] It should be noted that in the present embodiment, the display screen of the content display device 2 is described by taking a horizontally long rectangular screen whose horizontal length is longer than the vertical length when the content display device 2 is set as an example, but it is not limited to this, and can also be implemented with any shape, resolution, etc. such as a vertically long screen. In addition, the division mode of the display screen of the content display device 2 is not limited to the above-mentioned mode, and can be implemented with any position, ratio, and number of divisions.

[0051] Figure 3 It is a schematic block diagram showing the functional structure of the display system.

[0052] The camera device 1 includes an imaging unit 101 and a transmitting unit 102 .

[0053] The imaging unit 101 captures a person within an effective range where the person can view the display screen of the content display device 2 at an arbitrary frame rate, and generates a captured image of the person.

[0054] The transmitting unit 102 transmits the captured image generated by the imaging unit 101 to the information processing device 4 .

[0055] Information processing device 4 includes candidate advertisement display quantity setting unit 401, candidate advertisement switching time setting unit 402, storage unit 403, advertisement ID assigning unit 404, advertisement sending unit 405, captured image acquiring unit 406, attribute estimating unit 407, viewed advertisement determining unit 408, and display control unit 409. Information processing device 4 may also be a computer.

[0056] The candidate advertisement display quantity setting unit 401, the candidate advertisement switching time setting unit 402, the advertisement ID assigning unit 404, the advertisement sending unit 405, the captured image acquisition unit 406, the attribute inference unit 407, the viewed advertisement determination unit 408 and the display control unit 409 may also be composed of a processing device such as a CPU (central processing unit) or a dedicated electronic circuit.

[0057] The storage unit 403 is composed of a storage medium such as a HDD (Hard Disk Drive), a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a RAM (Random Access read / write Memory), a ROM (Read Only Memory), or any combination of these storage media. The storage unit 403 can use a nonvolatile memory, for example.

[0058] The candidate advertisement display number setting unit 401 sets the number of thumbnail advertisements to be displayed on the content display device 2 (hereinafter referred to as "the thumbnail advertisement display number"). That is, the candidate advertisement display number setting unit 401 sets the number of candidate areas by indicating the number of candidate areas to the display control unit 409. For example, the candidate advertisement display number setting unit 401 receives input of the thumbnail advertisement display number based on an operation input from a user via an input device. The input device may be, for example, a keyboard, a mouse, etc., which may be connected to the information processing device 4 by wire or wirelessly.

[0059] The candidate advertisement switching time setting unit 402 sets the time for switching the thumbnail advertisements displayed in the candidate area (hereinafter referred to as "thumbnail advertisement switching time"). For example, the candidate advertisement switching time setting unit 402 receives input of the thumbnail advertisement switching time based on an operation input from a user via an input device. In addition, the candidate advertisement switching time setting unit 402 indicates the input thumbnail advertisement switching time to the display control unit 409.

[0060] The storage unit 403 stores various information. For example, the storage unit 403 stores the content of each advertisement (main advertisement and thumbnail advertisement). In addition, the storage unit 403 stores an advertisement ID table indicating an advertisement ID for identifying the content of each advertisement and an advertisement attribute table indicating the attributes of the person who is the target of each advertisement.

[0061] The thumbnail advertisement can be any content as long as it is associated with the main advertisement. For example, the thumbnail advertisement can be content generated based on at least a portion of the multiple frames constituting the main advertisement. For example, when the main advertisement is animation data, a selected portion of the multiple frames constituting the animation data can be used as the thumbnail advertisement. For example, when the selected portion of frames is one frame, the frame can be used as the so-called still image content displayed during the playback period. In addition, when the selected portion of frames is multiple frames, it can also be content obtained by cutting a portion corresponding to a portion of the playback time of the main advertisement. In this case, the thumbnail advertisement is animation data that is a portion of the playback interval in the animation data of the main advertisement. The thumbnail advertisement can also be generated in advance and stored in the storage unit 403. In addition, the information processing device 4 can also be equipped with a content editing unit, which generates thumbnail advertisements based on the main advertisement, i.e., the content stored in the storage unit 403, and stores them in the storage unit 403.

[0062] Advertisement ID assigning unit 404 assigns a main advertisement ID and a thumbnail advertisement ID to each advertisement. The main advertisement ID is an advertisement ID for identifying the main advertisement. The thumbnail advertisement ID is an advertisement ID for identifying the thumbnail advertisement. Advertisement ID assigning unit 404 may also issue a main advertisement ID and a thumbnail advertisement ID, assign the issued main advertisement ID to the main advertisement, and assign the thumbnail advertisement ID to the thumbnail advertisement. Advertisement ID assigning unit 404 writes the main advertisement ID and the thumbnail advertisement ID assigned to each advertisement into the advertisement ID table stored in storage unit 403.

[0063] Advertisement sending unit 405 associates the content of each advertisement (main advertisement and thumbnail advertisement) with its main advertisement ID and thumbnail advertisement ID, and sends the result to content output device 3 .

[0064] The captured image acquisition unit 406 acquires the captured image by receiving the captured image from the camera device 1 .

[0065] The attribute estimation unit 407 can detect each person in the effective range based on the captured image and estimate the attributes of the detected person. In addition, the attribute estimation unit 407 detects a person from a captured image captured in a manner including a place where the display screen of the display device can be visually confirmed, and estimates the attributes of the detected person. The effective range can be any range as long as it includes an area where the content can be viewed.

[0066] The advertisement viewing determination unit 408 estimates the direction of the sight line of each person in the effective range based on the captured image, and determines the advertisement that each person is viewing based on the estimated direction of the sight line. For example, the advertisement viewing determination unit 408 estimates which area of ​​the display area of ​​the display screen of the content display device 2 the sight line is facing based on the estimated direction of the sight line. When the area of ​​the destination of the sight line is any candidate area, the advertisement viewing determination unit 408 determines which candidate area it is. The advertisement viewing determination unit 408 determines that the thumbnail advertisement displayed in the determined candidate area is the advertisement that the person is viewing.

[0067] Furthermore, when the area of ​​the destination of the line of sight is the main area, the viewed advertisement identification unit 408 can also identify the main advertisement being displayed in the main area to identify the advertisement that the person is viewing.

[0068] When a plurality of persons are included in the effective range of the captured image, the viewed advertisement determination unit 408 performs such an advertisement for each of the persons.

[0069] The display control unit 409 performs display control of the content displayed on the content display device 2. The display area of ​​the display screen is divided into a plurality of areas, and the display control unit 409 plays back the content (main advertisement) in the main area among the plurality of areas and ends the playback of the content (thumbnail advertisement) played back in the candidate areas among the plurality of areas until the playback of the content ends, and plays back the content corresponding to the estimated attribute.

[0070] Specifically, the display control unit 409 displays the contents of different advertisements in the main area, which is the largest display area among the areas divided into a plurality of areas in the display screen of the content display device 2, and in the candidate area which is smaller than the main area. In addition, the display control unit 409 switches the advertisements displayed in the candidate area by displaying the thumbnail advertisement currently being displayed and displaying the thumbnail advertisement to be displayed next, based on the attributes of the person in the effective range of the display screen of the content display device 2 that can be viewed. In addition, when switching the advertisement being displayed in the main area, the display control unit 409 displays the most viewed advertisement among the advertisements being displayed in the candidate area in the main area. In the case of determining the most viewed content, the display control unit 409 can determine the candidate area to which the direction of the line of sight is directed for each line of sight, and determine the content displayed in the candidate area with the largest number of lines of sight directed to the candidate area as the most viewed content. In addition, the time when the line of sight is directed to the candidate area can be measured, and the candidate area with the longest time of direction can be determined as the most viewed content. Furthermore, when there are multiple people's sight lines, the total value of the time of each sight line may be calculated for each candidate area, and the content of the candidate area with the highest total value may be determined as the most viewed content.

[0071] Here, when switching the advertisements displayed in the candidate area, the display control unit 409 displays the most viewed advertisement in the candidate area again. In addition, the display control unit 409 assigns priorities to the advertisements displayed in the candidate area based on the attributes of the characters, and displays each advertisement in the candidate area corresponding to the priorities. For example, the display control unit 409 assigns priorities to each of the plurality of contents based on the estimated attributes, and displays the contents with the priorities corresponding to the priorities assigned to the candidate area for the candidate area.

[0072] In addition, when switching the advertisements displayed in the candidate area, the display control unit 409 gives the highest priority to the advertisement that is most viewed. In addition, when switching the advertisements displayed in the candidate area, the display control unit 409 gives priority based on the number of views when the advertisements selected based on the attributes of the person and the advertisements currently displayed in the candidate area are all the same. In addition, when switching the advertisements displayed in the candidate area, the display control unit 409 switches to an advertisement other than the advertisement currently displayed in the main area.

[0073] Furthermore, the display control unit 409 can also select the content to be displayed in the candidate area based on the priority corresponding to the attribute estimated based on the person detected from the captured image and the priority given to the content based on the specified result.

[0074] Furthermore, the display control unit 409 may change the content currently displayed in the candidate area to other content corresponding to the character.

[0075] Furthermore, the display control unit 409 may re-arrange the content currently displayed in the candidate area according to the characters.

[0076] When a person is not detected by the detection unit during playback of the content displayed in the main area, the display control unit 409 displays content that does not depend on the person in the candidate area.

[0077] Display control unit 409 includes thumbnail advertisement selecting unit 4091 , priority determining unit 4092 , advertisement ID transmitting unit 4093 , and main advertisement selecting unit 4094 .

[0078] Thumbnail advertisement selection unit 4091 selects a thumbnail advertisement to be displayed on content display device 2 based on the attributes of the person in the effective range and the thumbnail advertisement being viewed.

[0079] Priority determination unit 4092 determines the priority of each thumbnail advertisement selected by thumbnail advertisement selection unit 4091 based on the attributes of the person in the effective range and the thumbnail advertisement being viewed.

[0080] Ad ID transmitting unit 4093 transmits the thumbnail advertisement ID of each thumbnail advertisement selected by thumbnail advertisement selecting unit 4091 together with its priority to content output device 3. Ad ID transmitting unit 4093 also transmits the main advertisement ID of the main advertisement selected by main advertisement selecting unit 4094 to content output device 3.

[0081] Main advertisement selection unit 4094 selects a main advertisement to be displayed on content display device 2 based on the thumbnail advertisement being viewed.

[0082] Content output device 3 includes advertisement receiving unit 301, advertisement storage unit 302, advertisement ID receiving unit 303, advertisement reading unit 304, screen dividing unit 305, advertisement placement unit 306, and output unit 307. Content output device 3 may be a computer.

[0083] Advertisement receiving unit 301, advertisement ID receiving unit 303, advertisement reading unit 304, screen dividing unit 305, advertisement placing unit 306, and output unit 307 may be constituted by a processing device such as a CPU (central processing unit) or a dedicated electronic circuit, for example.

[0084] Advertisement storage unit 302 is composed of a storage medium such as HDD, flash memory, EEPROM, RAM, ROM, or any combination of these storage media. Storage unit 403 may be, for example, a nonvolatile memory.

[0085] The advertisement receiving unit 301 receives the content of each advertisement (main advertisement and thumbnail advertisement) together with its main advertisement ID and thumbnail advertisement ID from the information processing device 4, establishes a correspondence between the received content of each advertisement (main advertisement and thumbnail advertisement) and its main advertisement ID and thumbnail advertisement ID, and writes them to the advertisement storage unit 302.

[0086] Advertisement storage unit 302 stores the content of each advertisement (main advertisement and thumbnail advertisement) in association with its main advertisement ID and thumbnail advertisement ID.

[0087] The advertisement ID receiving unit 303 receives the advertisement ID of the content displayed on the content display device 2 from the information processing device 4 .

[0088] The advertisement reading unit 304 reads the content of the advertisement corresponding to the advertisement ID received from the information processing device 4 from the advertisement storage unit 302 .

[0089] The screen division unit 305 divides the display area of ​​the display screen of the content display device 2 into a main area and a candidate area. In addition, when the number of thumbnail advertisement IDs received from the information processing device 4 (the number of thumbnail advertisements to be displayed) is plural, the screen division unit 305 divides the candidate area in a manner such that the number of divisions is consistent with the number of thumbnail advertisement IDs received. At this time, the screen division unit 305 assigns priority to each of the divided candidate areas. For example, the larger the display area of ​​the candidate area, the higher the priority assigned by the screen division unit 305. In addition, for example, the screen division unit 305 assigns priority to each of the candidate areas according to the configuration status of the candidate areas. For example, in the case of Figure 2E When candidate areas are arranged vertically as shown in FIG. 1 , candidate areas that are closer to the upper side of the screen are given higher priorities. Figure 2F When candidate areas are arranged in the horizontal direction as shown, higher priority is given to areas closer to the left or right end of the screen.

[0090] The advertisement placement unit 306 generates an image signal in which the contents of the advertisement read from the advertisement storage unit 302 are placed in each divided area of ​​the display screen of the content display device 2. Specifically, the advertisement placement unit 306 resizes the main advertisement and places it in the main area. In addition, the advertisement placement unit 306 reorders the thumbnail advertisements displayed in the plurality of candidate areas according to their priorities. Furthermore, the advertisement placement unit 306 resizes the thumbnail advertisements and places them in each candidate area corresponding to its priority.

[0091] The output unit 307 outputs the video signal generated by the advertisement placement unit 306 to the content display device 2 .

[0092] The content display device 2 includes an input unit 201 and a display unit 202. The content display device 2 is, for example, a liquid crystal display device. Alternatively, the content display device 2 may be a projector instead of a liquid crystal display device.

[0093] The input unit 201 inputs a video signal from the content output device 3 .

[0094] The display unit 202 has a display screen and displays the input video signal on the display screen. When the content display device 2 is a projector, the display unit 202 may project the video signal onto a projection surface.

[0095] Figure 4 This is a schematic diagram showing the data structure and data example of the advertisement ID table stored in the information processing device.

[0096] As shown in the figure, the advertisement ID table establishes correspondence and stores each item of the advertisement, main advertisement ID and thumbnail advertisement ID. The main advertisement ID is an advertisement ID that identifies the main advertisement. The thumbnail advertisement ID is an advertisement ID that identifies the thumbnail advertisement. It should be noted that the main advertisement ID and the thumbnail advertisement ID have corresponding advertisement IDs. For example, the main advertisement ID of advertisement A is "1a" and the thumbnail advertisement ID is "2a". In this example, the "a" shared by the main advertisement ID and the thumbnail advertisement ID of advertisement A indicates that it is advertisement "A", the "1" of the main advertisement ID indicates that it is the main advertisement ID, and the "2" of the thumbnail advertisement ID indicates that it is the thumbnail advertisement ID. Similarly, the main advertisement ID of advertisement B is "1b" and the thumbnail advertisement ID is "2b".

[0097] Figure 5 This is a schematic diagram showing the data structure and data example of the advertisement attribute table stored in the information processing device.

[0098] As shown in the figure, the advertisement ID table stores the attributes of advertisements and the person who is the target of the advertisement. In the example shown in the figure, the attributes of the person include gender and age. For example, the gender of the person who is the target of advertisement A is "female" and the age is "teens to 20s". In addition, the gender of the person who is the target of advertisement B is "male" and the age is "all ages".

[0099] Next, the operation of the display system 100 will be described.

[0100] Figure 6 and Figure 7 This is a flowchart for explaining the operation of the display control process executed by the information processing device. When the information processing device 4 is to display content on the content display device 2, the process shown in this figure is executed.

[0101] First, advertisement ID assigning unit 404 assigns main advertisement IDs to all main advertisements stored in storage unit 403 (step S101), and writes them to the advertisement ID table stored in storage unit 403. Next, advertisement ID assigning unit 404 assigns thumbnail advertisement IDs corresponding to the main advertisement IDs to all thumbnail advertisements (step S102), and writes them to the advertisement ID table stored in storage unit 403. Then, advertisement sending unit 405 sends the main advertisements and thumbnail advertisements of all advertisements together with the main advertisement IDs and thumbnail advertisement IDs to content output device 3 (step S103).

[0102] Next, candidate advertisement display number setting unit 401 sets the thumbnail advertisement display number (step S104). Candidate advertisement display number setting unit 401 transmits the set thumbnail advertisement display number to content output device 3 via advertisement transmission unit 405. Next, candidate advertisement switching time setting unit 402 sets the thumbnail advertisement switching time (step S105).

[0103] Next, the captured image acquisition unit 406 acquires the captured image from the camera device 1 and determines whether a person is detected from the captured frame of the acquired captured image (step S106). If a person is not detected from the captured frame (step S106; No), the display control unit 409 outputs the main advertisement ID of a preset default advertisement (hereinafter referred to as "default advertisement") to the content output device 3 (step S107). Next, the display control unit 409 randomly selects a thumbnail advertisement ID according to the number of thumbnail advertisements to be displayed (step S108). Then, the display control unit 409 sends the selected thumbnail advertisement ID to the content output device 3 (step S109). Next, the display control unit 409 determines whether the thumbnail advertisement switching time has arrived (the thumbnail advertisement switching time has passed since the thumbnail advertisement was displayed) (step S110). If the thumbnail advertisement switching time has not arrived (step S110; No), the process of step S110 is repeated. On the other hand, when the thumbnail advertisement switching time has arrived (step S110 ; Yes), the process proceeds to step S117 .

[0104] That is, when the display control unit 409 is about to display the content on the content display device 2 for the first time, if there is no person in the effective range of the content display device 2, the default advertisement content is displayed in the main area and the randomly selected thumbnail advertisement is displayed in the candidate area.

[0105] On the other hand, when a person is detected from the captured frame (step S106; yes), the attribute estimation unit 407 estimates the attributes of all the persons detected from the captured frame (step S111). Next, the display control unit 409 determines the priority of each advertisement based on the estimated attributes (step S112). For example, the display control unit 409 gives a high priority to an advertisement with a large number of people matching the attribute. Then, the display control unit 409 assigns the determined priority to the corresponding advertisement (step S113). Next, the display control unit 409 selects the thumbnail advertisement IDs of advertisements with a priority of second or later in order of priority from high to low by the number of thumbnail advertisements to be displayed (step S114). Next, the display control unit 409 sends the main advertisement ID of the advertisement with the highest priority to the content output device 3 (step S115). Next, the display control unit 409 sends the thumbnail advertisement ID of the selected thumbnail advertisement display number to the content output device 3 together with its priority (step S116).

[0106] That is, when the display control unit 409 is initially about to display content on the content display device 2, if there are people in the effective range of the content display device 2, it selects advertisements based on the attributes of all the people in the effective range, displays the advertisements with the highest priority based on the attributes in the main area, and displays the advertisements with the second priority and above in the candidate area in the order of their priorities.

[0107] Next, the captured image acquisition unit 406 acquires the captured image from the camera device 1 and determines whether a person is detected from the captured frame of the acquired captured image (step S117). If a person is not detected from the captured frame (step S117; No), the process returns to step S110. That is, if a person is not detected from the captured frame, the display control unit 409 does not change the main advertisement and thumbnail advertisement being displayed (being distributed).

[0108] On the other hand, when a person is detected from the captured frame (step S117; Yes), the viewed advertisement determination unit 408 estimates the sight lines of all the persons detected from the captured frame, and the attribute estimation unit 407 estimates the attributes of all the persons detected from the captured frame (step S118). Next, the display control unit 409 determines whether the thumbnail advertisement switching time has arrived (step S119). When the thumbnail advertisement switching time has not arrived (step S119; No), the process returns to step S118.

[0109] On the other hand, when the thumbnail advertisement switching time has arrived (step S119; yes), display control unit 409 selects a thumbnail advertisement ID based on sight and a thumbnail advertisement ID based on attribute according to the estimation result (step S120). For example, display control unit 409 selects a thumbnail advertisement ID of a thumbnail advertisement currently displayed in the candidate area (being published) as a thumbnail advertisement ID based on sight. In addition, display control unit 409 selects a thumbnail advertisement ID of an advertisement that matches the estimated attribute as a thumbnail advertisement ID based on attribute.

[0110] Next, the display control unit 409 gives priority to the attribute-based thumbnail advertisement ID (step S121). Next, the display control unit 409 gives priority to the line-of-sight-based thumbnail advertisement ID (step S122). For example, the display control unit 409 gives a high priority to the thumbnail advertisement that is being watched by a large number of people. Next, the display control unit 409 selects the thumbnail advertisement ID in descending order of priority according to the number of thumbnail advertisements to be displayed for each of the attribute-based thumbnail advertisement ID and the line-of-sight-based thumbnail advertisement ID (step S123).

[0111] Next, display control unit 409 determines whether the selected attribute-based thumbnail advertisement IDs include an ID that matches the thumbnail advertisement ID corresponding to the main advertisement currently being displayed (being published) in the main area (step S124). If a matching ID is included (step S124; yes), display control unit 409 excludes the thumbnail advertisement ID of the main advertisement being published in the main area from the selected attribute-based thumbnail advertisement IDs (step S125). As a result, the thumbnail advertisement corresponding to the main advertisement being published in the main area is not published in the candidate area, and the same main advertisement can be prevented from being published twice in succession.

[0112] On the other hand, when the selected attribute-based thumbnail advertisement ID does not include the thumbnail advertisement ID of the main advertisement being posted in the main area (step S124; No), display control unit 409 determines whether the selected attribute-based thumbnail advertisement ID is consistent with the thumbnail advertisement ID of the thumbnail advertisement being posted in the candidate area (step S126). If all are consistent (step S126; Yes), display control unit 409 sends the line-of-sight-based thumbnail advertisement ID together with its priority to content output device 3 (step S127).

[0113] That is, when the thumbnail advertisement IDs based on the attributes are all identical to the thumbnail advertisements being published, the display control unit 409 does not replace the thumbnail advertisements displayed in the candidate area, but changes the placement of the thumbnail advertisements based on the number of views. For example, the display control unit 409 can place thumbnail advertisements with a greater number of views in a candidate area that is easier to view.

[0114] On the other hand, if the selected attribute-based thumbnail advertisement ID is inconsistent with the thumbnail advertisement ID of the thumbnail advertisement being published in the candidate area at least partially (step S126; No), the display control unit 409 gives the thumbnail advertisement ID of the most viewed thumbnail advertisement among the thumbnail advertisements being published the highest priority, and sends the thumbnail advertisement ID together with its highest priority to the content output device 3 (step S128). Next, the display control unit 409 removes the thumbnail advertisement ID of the most viewed thumbnail advertisement from the attribute-based thumbnail advertisement IDs and selects the thumbnail advertisement IDs in order of priority from high to low by the thumbnail advertisement display number - 1 (the number obtained by subtracting 1 from the thumbnail advertisement display number) (step S129). Next, the display control unit 409 re-assigns the second and subsequent priorities to the selected thumbnail advertisement IDs in order of their priorities from high to low, and sends the selected thumbnail advertisement ID together with the re-assigned priority to the content output device 3 (step S130). In order to avoid duplication, the thumbnail advertisement ID sent at this time does not include the thumbnail advertisement ID that is viewed the most.

[0115] That is, when the thumbnail advertisement ID based on the attribute is different from the thumbnail advertisement being published, the display control unit 409 keeps the thumbnail advertisement that is most viewed and replaces the other thumbnail advertisements. In this case, the display control unit 409 can arrange the thumbnail advertisement that is most viewed in the candidate area that is easiest to view by giving the thumbnail advertisement that is most viewed the highest priority.

[0116] Next, the display control unit 409 determines whether the time to determine the next main advertisement has arrived (step S131). The time to determine the main advertisement is, for example, a predetermined time before the end of the main advertisement being published. If the time to determine the next main advertisement has not arrived (step S131; No), the process returns to step S118.

[0117] On the other hand, when the time to determine the next main advertisement has arrived (step S131; yes), the viewed advertisement determination unit 408 estimates the sight lines of each person detected from the captured frame and determines the advertisement that each person is viewing (step S132). Next, the display control unit 409 selects the thumbnail advertisement ID of the thumbnail advertisement that is most viewed (step S133). Next, the display control unit 409 reads the main advertisement ID corresponding to the selected thumbnail advertisement ID from the advertisement ID table (step S134). The display control unit 409 sends the read main advertisement ID to the content output device 3 (step S135).

[0118] That is, when switching the main advertisement currently displayed in the main area, the display control unit 409 causes the main advertisement of the thumbnail advertisement that is most viewed to be displayed in the main area.

[0119] Next, the information processing device 4 determines whether the power is off (step S136). If the power is not off (step S136; No), the process returns to step S118. On the other hand, if the power is off (step S136; Yes), the process ends.

[0120] Figure 8 This is a flowchart for explaining the operation of the display control process executed by the content output device. When the power is turned on, the content output device 3 executes the process shown in this figure.

[0121] First, the advertisement receiving unit 301 determines whether all the main advertisements and thumbnail advertisements of the advertisements have been received from the information processing device 4 (step S201). At this time, the advertisement receiving unit 301 receives the main advertisement ID and thumbnail advertisement ID and the number of thumbnail advertisements displayed together with the main advertisement and thumbnail advertisements. In the case where all the main advertisements and thumbnail advertisements of the advertisements have not been received (step S201; no), the process of step S201 is performed again. On the other hand, in the case where all the main advertisements and thumbnail advertisements of the advertisements have been received (step S201; yes), the screen division unit 305 divides the image signal into the number of thumbnail advertisements displayed received and sends it from the output unit 307 to the content display device 2, thereby dividing the display screen of the content display device 2 into the main area and the candidate area of ​​the number of thumbnail advertisements displayed (step S202). That is, the screen division unit 305 lays out the frames of the main area and each candidate area on the display screen, and allocates the main area and each candidate area to the display screen.

[0122] Next, the advertisement ID receiving unit 303 determines whether the main advertisement ID is received from the information processing device 4 (step S203). If the main advertisement ID is not received (step S203; No), the process of step S203 is repeated. On the other hand, if the main advertisement ID is received (step S203; Yes), it is determined whether the main advertisement ID of the default advertisement is included in the received main advertisement ID (step S204). If the main advertisement ID of the default advertisement is included (step S204; Yes), the advertisement configuration unit 306 configures the default advertisement in the main area and outputs its image signal to the content display device 2 (step S205). As a result, the content display device 2 displays the default advertisement in the main area.

[0123] On the other hand, if the received advertisement IDs do not include the main advertisement ID of the default advertisement (step S204; No), advertisement placement unit 306 places the main advertisement of the main advertisement ID with the highest priority among the received main advertisement IDs in the main area and outputs its video signal to content display device 2 (step S206). As a result, content display device 2 displays the main advertisement in the main area.

[0124] Next, the advertisement ID receiving unit 303 determines whether a thumbnail advertisement ID is received from the information processing device 4 (step S207). If a thumbnail advertisement ID is not received (step S207; No), the process of step S207 is repeated. On the other hand, if a thumbnail advertisement ID is received (step S207; Yes), the advertisement placement unit 306 places the thumbnail advertisement of the received thumbnail advertisement ID in the candidate area corresponding to its priority and outputs its image signal to the content display device 2 (step S208). As a result, the content display device 2 displays one or more thumbnail advertisements in the candidate areas corresponding to their priorities.

[0125] Here, in the above description, the case where the information processing device 4 returns to step S118 after step S136 is described, but it is also possible that before executing step S118, a new photo is taken using the camera device 1. If a person different from the person detected last time is detected based on the result of the photo detection, the display control unit 409 switches the content being played back in the candidate area to content with attributes corresponding to the different person.

[0126] It should be noted that when content output device 3 switches the thumbnail advertisements displayed in the candidate area, it can switch the thumbnail advertisements by sliding the entire display area, or by swapping the thumbnail advertisements up and down or left and right, or it can be achieved through any animation.

[0127] Next, the content output device 3 determines whether the power is off (step S209). If the power is not off (step S209; No), the process returns to step S203. On the other hand, if the power is off (step S209; Yes), the process ends.

[0128] In a display system that displays only one content without providing a candidate area on the display screen, even if the attribute of a person within the effective range of the content display device 2 is estimated, there will be a time difference between the estimation and the release of the content of the target advertisement targeting the person with the attribute. Therefore, when the content of the target advertisement is released, the person who is the target may leave the effective range of the content display device 2, and there is a problem that the original effect of the target advertisement is weakened.

[0129] In order to solve such a problem, the display control unit 409 of the information processing device 4 of the present embodiment displays the contents of different advertisements in the main area, which is the largest display area in the display screen of the content display device 2, and in the candidate area, which is smaller than the main area, and switches the advertisement displayed in the candidate area based on the attributes of the person in the effective range. When switching the advertisement currently displayed in the main area, the advertisement currently displayed in the candidate area is displayed in the main area. That is, the display control unit 409 explicitly indicates in the candidate area the advertisement that is the candidate to be displayed in the main area in enlargement, and switches the thumbnail advertisement displayed in the candidate area based on the attributes of the person in the effective range. As a result, the following effects are achieved: the interest of the person in the effective range is aroused, and the target person remains in the effective range of the content display device 2 until the next main advertisement is displayed.

[0130] Furthermore, since the display control unit 409 sets a plurality of candidate areas and displays different thumbnail advertisements in each candidate area, it is possible to provide information suitable for a plurality of people within the effective range of the content display device 2. Furthermore, in the case of an advertisement with voice, for example, an effect (e.g., a cocktail party effect) can be expected for a target who is within the effective range of the content display device 2 but is not viewing the display screen.

[0131] In addition, the display control unit 409 switches the thumbnail advertisements displayed in the candidate area based on the attributes of the person in the effective range, and when switching the advertisement currently displayed in the main area, the most viewed advertisement among the advertisements currently displayed in the candidate area is displayed in the main area. Therefore, the content with the highest attraction effect that causes the target person to demand a purchase can be displayed in the main area, and appropriate information for the target can be provided.

[0132] In addition, when switching the thumbnail advertisements displayed in the candidate area, the display control unit 409 displays the most viewed thumbnail advertisement in the candidate area again. Therefore, the thumbnail advertisement currently being viewed most by viewers can be kept in the candidate area, and the viewer's interest can be prevented from being lost.

[0133] In addition, the display control unit 409 assigns priorities to the thumbnail advertisements displayed in the candidate areas based on the attributes of the people in the effective range of the content display device 2, and displays each thumbnail advertisement in the candidate area corresponding to the priority. Thus, thumbnail advertisements with high priorities based on the attributes can be arranged in the candidate area that is easier to view (for example, the candidate area with a large display area, etc.), thereby attracting the attention of the viewer.

[0134] In addition, when switching advertisements displayed in the candidate area, the display control unit 409 gives the highest priority to the advertisement that is most viewed. Thus, the thumbnail advertisement that is currently most viewed by the viewer can be placed in the candidate area that is easiest to view.

[0135] In addition, when switching the advertisements displayed in the candidate area, the display control unit 409 gives priority based on the number of views when the advertisements selected based on the attributes of the person and the advertisements currently displayed in the candidate area are all the same. That is, when the thumbnail advertisements selected based on the attributes and the thumbnail advertisements currently being published are all the same, the display control unit 409 does not replace the thumbnail advertisements displayed in the candidate area, but changes the placement position of the thumbnail advertisements based on the number of views. In this way, the thumbnail advertisements with more views can be placed in the candidate area that is easier to view.

[0136] In addition, when switching the advertisement displayed in the candidate area, the display control unit 409 switches to an advertisement other than the advertisement currently displayed in the main area. Thus, the thumbnail advertisement corresponding to the main advertisement being posted in the main area is not displayed in the candidate area, and the same main advertisement can be prevented from being posted twice in succession.

[0137] In addition, the information processing device 4 includes a candidate advertisement display number setting unit 401 for setting the number of candidate areas. Thus, the number of thumbnail advertisements displayed in the candidate areas can be set to an arbitrary number, so that even if the number of advertisement contents stored in the storage unit 403 is increased, the divided screens (candidate areas) of the display screen of the content display device 2 will not be too fragmented, and the optimal content display can be achieved without losing visual confirmation, and information can be provided more effectively.

[0138] In addition, the information processing device 4 includes a candidate advertisement switching time setting unit 402 for setting the time to switch the advertisement displayed in the candidate area. Thus, the time to switch the thumbnail advertisement displayed in the candidate area can be set to an arbitrary time, so, for example, by setting it to a time shorter than the time to switch the main advertisement, it is possible to reduce the time difference until the thumbnail advertisement corresponding to the attribute of the person in the effective range is displayed.

[0139] In the above-mentioned embodiment, the operation is described in the case where the main area and the candidate area are allocated in the display screen of the content display device 2. However, in the display screen, the content output device 3 may also allocate the main area and the candidate area. Figure 2C As shown in FIG. 1 , the display control unit 409 allocates the related information display area for displaying the selling point, etc. In addition, the display control unit 409 may also display the related information associated with the content displayed in the candidate area in the related information display area. Regarding the related information, the advertisement storage unit 302 may store related content that is pre-associated with the content. In addition, the display control unit 409 may also display the related information in the related information display area by specifying the ID of the related content stored in the advertisement storage unit 302.

[0140] In the above embodiment, at least part of the functions of the information processing device 4 may be provided in the content output device 3, and at least part of the functions of the content output device 3 may be provided in the information processing device 4. In addition, the information processing device 4 and the content output device 3 may be configured as one device.

[0141] In addition, in the above-mentioned embodiment, if the time for determining the next main advertisement has not been reached in step S131, the process moves to step S119, and if the thumbnail advertisement replacement time has been reached, the thumbnail advertisement is reselected. Thus, the display control unit 409 can switch the content displayed in the candidate area to different content in a period shorter than the playback period of the content played back in the main area. Thus, the cycle of replacing the content displayed in the candidate area can be updated with a cycle shorter than the cycle of replacing the content displayed in the main area. Thus, even if the person in the area being photographed by the camera device 1 is replaced in the middle of the main advertisement being played back, the content displayed in the candidate area can be switched in sequence according to the attributes of the replaced person. Thus, the content corresponding to the replacement status of the person can be displayed in the candidate area. In addition, the employment that can be updated to display the content corresponding to the replacement status of the person in the candidate area can be selected from the content updated according to the replacement, and the probability that the person can watch the content can be increased.

[0142] In the above-mentioned embodiment, when the time to determine the next main advertisement is reached in step S131, the advertisement content is newly selected. For example, the display control unit 409 may set the time to determine the next main advertisement according to the timing when the playback time of the main advertisement ends, and when the timing arrives, the display control unit 409 newly selects the advertisement content. Thus, when the playback of the content currently being played back in the main area ends, the display control unit 409 can play back the content selected from the content currently being displayed in the candidate area in a manner of being displayed in the main area.

[0143] Fig. 9 It is a diagram showing a basic structure of the information processing device of the present invention.

[0144] The basic configuration of the information processing device 40 of the present invention includes a display control unit 41 and an attribute estimation unit 42 as the basic configuration.

[0145] Regarding the display control unit 41, the display area of ​​the display screen is divided into a plurality of zones, and content is played back in a main zone among the plurality of zones. During the period until the playback of the content is finished, the playback of the content played back in a candidate zone among the plurality of zones is finished, and the playback of the content corresponding to the inferred attribute is performed.

[0146] The attribute estimation unit 42 detects a person from a captured image captured so as to include a location where the display screen of the display device can be visually recognized, and estimates the attributes of the detected person.

[0147] Fig.10 It is a functional block diagram showing the structure of the information processing device 50 in another embodiment.

[0148] The information processing device 50 includes a detection unit 51 and a display control unit 52 .

[0149] The detection unit 51 detects a person from a captured image obtained by capturing at least a location where the display screen can be visually recognized.

[0150] The display control unit 52 sets at least a main area and a candidate area on the display screen of the display device, and displays the content displayed in the candidate area in the main area when the playback of the content displayed in the main area ends.

[0151] Furthermore, the display control unit 52 causes the candidate area to display content corresponding to the result of the process of detecting a person during playback of the content displayed in the main area.

[0152] When a person is detected from the captured image as a result of performing the process of detecting a person, the display control unit 52 causes the content based on at least one of the attributes and actions of the detected person to be displayed in the candidate area. When a person is not detected from the captured image as a result of performing the process of detecting a person, the display control unit 52 causes the content based on a determined rule to be displayed in the candidate area. The determined rule may be a rule for displaying predetermined content (e.g., default content) or a rule for selecting an arbitrary content from a plurality of contents and displaying it.

[0153] Furthermore, when the detection unit 61 does not detect a person during playback of the content displayed in the main area, the display control unit 52 may display content that does not depend on a person in the candidate area.

[0154] Fig.11 It is a functional block diagram showing the structure of the information processing device 60 in another embodiment.

[0155] The information processing device 60 includes a detection unit 61 and a display control unit 62 .

[0156] The detection unit 61 detects a person from a captured image obtained by capturing at least a location where the display screen can be visually recognized.

[0157] The display control unit 62 provides at least a main area and a candidate area on the display screen of the display device, and displays the content displayed in the candidate area in the main area when the playback of the content displayed in the main area ends.

[0158] During playback of the content displayed in the main area, the display control unit 62 determines the priority of the content according to the character, and displays the content in the candidate area according to the determined priority.

[0159] Furthermore, when the detection unit 61 does not detect a person during playback of the content displayed in the main area, the display control unit 62 displays content that does not depend on the person in the candidate area.

[0160] The display control unit 62 may display, in the candidate area, content that is different from the content displayed in the main area and that is in accordance with the determined priority.

[0161] Fig.12 It is a flowchart explaining the operation of the information processing device 60 .

[0162] Display control unit 62 determines whether the timing for updating the display of the thumbnail advertisement has arrived (step S301 ). If the timing for updating has not arrived (step S301 —No), the process proceeds to step S301 after a certain waiting time has passed.

[0163] When the update timing is reached (step S301-yes), the display control unit 62 determines whether a person is detected from the captured image based on the result of the person detection processing obtained from the detection unit 61 (step S302). If a person is detected (step S302-yes), the priority corresponding to the detected person is determined, and the content is arranged according to the determined priority (step S303).

[0164] The display control unit 62 may also perform the process of arranging the contents by assigning the order of the contents to the contents. In this case, since it is not a process of changing the arrangement order of the contents displayed in the candidate area at that time, the arrangement order of the contents displayed in the candidate area at that time is not changed. For example, the process of arranging the contents can be performed as a background process.

[0165] Regarding the priority corresponding to the person, for example, the person's attribute can be estimated and the priority corresponding to the estimated attribute can be set, or the person's action can be detected and the priority corresponding to the detected action can be set. Regarding the person's action, for example, the person's line of sight can be detected, and when the line of sight is directed toward the content displayed in the candidate area, the priority of the content is determined to be high. In addition, the priority corresponding to the person can also be both the attribute and the action.

[0166] When arranging the contents, the display control section 62 arranges the contents in descending order of priority.

[0167] The display control unit 62 displays the contents other than the contents displayed in the main area in the order of priority in the candidate area among the contents arranged in descending order of priority (step S304). Here, if there is one candidate area, the display control unit 62 displays the contents with the highest priority among the contents other than the contents displayed in the main area in the candidate area. If there are multiple candidate areas, the display control unit 62 displays the contents other than the contents displayed in the main area in order of priority in each candidate area.

[0168] The content displayed in the candidate area by executing step S304 may be different from that before the execution or the same as that before the execution. In the case where the person detected in the captured image is different from that before (a different person is detected, a combination of multiple detected persons is different from that before, etc.), different content may be displayed. In the case where the person detected in the captured image is the same as that before (the same person is in the same position, etc.), the same content may be displayed.

[0169] In the process based on the above flowchart, before step S301, a process of displaying the content corresponding to the person in the candidate area may be performed, and a process of displaying the default content in the candidate area may be performed.

[0170] The display control unit 62 determines whether the time to determine the next content to be displayed in the main area has arrived (step S305 ). If the time to determine the next content to be displayed in the main area has not arrived (step S305 —No), the process proceeds to step S301 .

[0171] On the other hand, when the time to determine the next content to be displayed in the main area has arrived, the display control unit 62 displays the highest priority content displayed in the candidate area in the main area (step S306 ).

[0172] If an instruction to turn off the power is input, the display control unit 62 ends the process (step S307 —Yes), and if an instruction to turn off the power is not input, the display control unit 62 moves the process to step S301 .

[0173] On the other hand, if a person is not detected in step S302 (step S302 —No), the display control unit 62 displays default content in the candidate area (step S308 ).

[0174] It should be noted that in the above process, the display control unit 62 may also execute the process of step S308 when a predetermined condition is satisfied. For example, the display control unit 62 may execute the process when a certain time has passed without detecting a person from the captured image.

[0175] In addition, it can also be used to implement Figure 3 The programs for the functions of the camera device, content display device, content output device, and information processing device are recorded in a recording medium that can be read by a computer, and the position detection is performed by causing the computer system to read the program recorded in the recording medium and execute the program. It should be noted that the "computer system" mentioned here includes hardware such as OS and peripheral devices.

[0176] In addition, when the WWW system is used, the "computer system" also includes the homepage providing environment (or display environment).

[0177] In addition, "computer-readable recording medium" refers to removable media such as floppy disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording media" include media that retain programs for a certain period of time, such as volatile memories inside computer systems that serve as servers or clients. In addition, the above-mentioned program may also be a program for realizing a part of the aforementioned functions, or a program that can realize the aforementioned functions by combining with programs already recorded in the computer system. In addition, the above-mentioned program may also be stored in a specified server, and the program may be released (downloaded, etc.) via a communication circuit in response to a request from other devices.

[0178] As mentioned above, although the embodiment of the present invention has been described in detail with reference to the drawings, the specific structure is not limited to the embodiment, and also includes designs and the like within the scope not departing from the gist of the present invention.

[0179] Description of symbols

[0180] 100 Display System

[0181] 1 Camera Equipment

[0182] 101 Filming Department

[0183] 102 Sending Department

[0184] 2 Content display device

[0185] 201 Input

[0186] 202 Display unit

[0187] 3 Content output device

[0188] 301 Advertisement Receiving Department

[0189] 302 Advertising Storage Department

[0190] 303 Advertising ID receiving unit

[0191] 304 Advertisement Reading Unit

[0192] 305 Screen division

[0193] 306 Advertising Configuration Department

[0194] 307 Output

[0195] 4.40 Information processing device

[0196] 401 Alternative Ad Display Quantity Setting Unit

[0197] 402 Alternative Ad Switching Time Setting Unit

[0198] 403 Storage

[0199] 404 Advertising ID assignment

[0200] 405 Advertising Department

[0201] 406 Photographed image acquisition unit

[0202] 407, 42 Attribute estimation unit

[0203] 408 Advertisement Viewing Confirmation Department

[0204] 409, 41 display control unit

[0205] 4091 Thumbnail Ad Selection Department

[0206] 4092 Priority Determination Department

[0207] 4093 Advertising ID sending unit

[0208] 4094 Main Advertisement Selection Department

Claims

1. An information processing device, wherein: The information processing device comprises: A display control unit is configured to provide at least a main area and a candidate area on a display screen of a display device, so that when playback of content displayed in the main area is completed, content displayed in the candidate area is displayed in the main area; and a detection unit that detects a person from a captured image obtained by capturing at least a location where the display screen can be visually recognized, The display control unit changes the content currently displayed in the candidate area according to the character during playback of the content displayed in the main area, determines the priority of the content according to the character, and displays the content in the candidate area according to the determined priority. The display control unit switches the content displayed in the candidate area to different content during a period shorter than a playback period of the content played back in the main area, The display control unit causes the content with the highest priority displayed in the candidate area to be displayed in the main area when a time to determine the next content to be displayed in the main area has arrived.

2. The information processing device according to claim 1, wherein: The display control unit changes the content currently displayed in the candidate area to other content corresponding to the character.

3. The information processing device according to claim 1 or 2, wherein: The display control unit rearranges the content currently displayed in the candidate area according to the person.

4. The information processing device according to claim 1 or 2, wherein: The information processing device includes an attribute estimating unit that estimates the attribute of the person detected by the detecting unit. When displaying content in the candidate area, the display control unit displays content corresponding to the estimated attribute instead of content currently displayed in the candidate area.

5. The information processing device according to claim 1, wherein: When the display control unit is to display content in the candidate area, the display control unit displays content corresponding to the detected person's action instead of content currently displayed in the candidate area.

6. The information processing device according to claim 4, wherein: The display control unit assigns a priority to each of the plurality of contents based on the estimated attribute, displays the content with the highest priority in the candidate area, and displays at least the content with the second highest priority in another area of ​​the display screen.

7. The information processing device according to claim 6, wherein: The information processing device includes an advertisement viewing determination unit that determines at least a line of sight toward the content displayed in the candidate area and the other area. The display control unit further changes the priority based on the line of sight so that the content with the highest priority after the change is displayed in the candidate area.

8. The information processing device according to claim 4, wherein: When a different person is detected from the captured image captured after the person is detected, the display control unit switches the content being reproduced in the candidate area to content corresponding to the attribute of the different person.

9. The information processing device according to claim 1 or 2, wherein: The content displayed in the candidate area is content generated based on at least a part of a plurality of frames constituting the content displayed in the main area.

10. The information processing device according to claim 1 or 2, wherein: The display control unit displays related information associated with the content displayed in the candidate area on a partial area of ​​the display screen.

11. The information processing device according to claim 1 or 2, wherein: When no person is detected from the captured image, the display control unit causes content based on a predetermined rule to be displayed in the candidate area.

12. The information processing device according to claim 1 or 2, wherein: When the detection unit does not detect a person during playback of the content displayed in the main area, the display control unit displays content that is not dependent on the person in the candidate area.

13. The information processing device according to claim 1, wherein: The display control unit causes content different from content displayed in the main area and in accordance with the determined priority to be displayed in the candidate area.

14. A display system comprising a display device and an information processing device, wherein the display device displays content for advertising, wherein: The information processing device comprises: A display control unit is configured to provide at least a main area and a candidate area on a display screen of a display device, so that when playback of content displayed in the main area is completed, content displayed in the candidate area is displayed in the main area; and a detection unit that detects a person from a captured image obtained by capturing at least a location where the display screen can be visually recognized, The display control unit changes the content currently displayed in the candidate area according to the character during playback of the content displayed in the main area, determines the priority of the content according to the character, and displays the content in the candidate area according to the determined priority. The display control unit switches the content displayed in the candidate area to different content during a period shorter than a playback period of the content played back in the main area, The display control unit causes the content with the highest priority displayed in the candidate area to be displayed in the main area when a time to determine the next content to be displayed in the main area has arrived.

15. A display control method, wherein: The display control unit sets at least a main area and a candidate area on the display screen of the display device, so that when the playback of the content displayed in the main area is completed, the content displayed in the candidate area is displayed in the main area, The detection unit detects a person from a captured image obtained by capturing at least a location where the display screen can be visually recognized. The display control unit changes the content currently displayed in the candidate area according to the character during playback of the content displayed in the main area, determines the priority of the content according to the character, and displays the content in the candidate area according to the determined priority. The display control unit switches the content displayed in the candidate area to different content during a period shorter than a playback period of the content played back in the main area, The display control unit causes the content with the highest priority displayed in the candidate area to be displayed in the main area when a time to determine the next content to be displayed in the main area has arrived.

Images