Customized advertisement device based on user recognition

Abstract

The customized advertisement device based on user recognition comprises: a display unit that displays an advertisement image; a camera supported by the display unit and photographing a pedestrian in front of the display unit; and a control unit that stores a plurality of group features and a plurality of advertisement images corresponding to each of a plurality of preset classification groups, analyzes an image captured by the camera to extract features of the pedestrian in front of the display unit, determines which classification group, among the plurality of preset classification groups, the pedestrian in front of the display unit belongs to, on the basis of the extracted features of the pedestrian in front of the display unit, and controls the display unit to display any one advertisement image among the plurality of advertisement images corresponding to the corresponding classification group, as a result of the determination.

Description

User recognition-based personalized advertising device

[0001] The present invention relates to a user recognition-based customized advertising device, and more specifically, to a user recognition-based customized advertising device that photographs a pedestrian, analyzes the pedestrian, and provides customized advertising.

[0002] Displays and billboards, which display advertisements both indoors and outdoors, typically receive advertising information from outside sources and display the advertisements. Display and billboard managers plan and schedule the advertisement display times to meet the advertising contract's exposure time, then simply control the display of the advertisements at the designated times.

[0003] However, because these simple advertisements often have minimal effectiveness, advertisers may become dissatisfied with their advertising effectiveness. If they determine that effective advertising is unlikely, they may withdraw their ads from display and billboard displays. This can lead to unsatisfactory results for both advertisers and display and billboard operators.

[0004] Accordingly, the purpose of the present invention is to provide a user recognition-based customized advertising device that can extract the characteristics of a pedestrian, accurately determine the pedestrian, and then display an advertising video related to the pedestrian.

[0005] In order to achieve the above object, a user recognition-based customized advertising device according to the present invention includes a display unit for displaying an advertising image; a camera supported on the display unit and capturing a pedestrian in front of the display unit; and a control unit storing a plurality of group characteristics and a plurality of advertising images corresponding to each of a plurality of preset classification groups, analyzing the image captured by the camera to extract characteristics of the pedestrian in front of the display unit, determining which of the plurality of preset classification groups the pedestrian in front of the display unit belongs to based on the extracted characteristics of the pedestrian in front of the display unit, and controlling the display unit to display any one of the plurality of advertising images corresponding to the corresponding classification group as a result of the determination. By accurately identifying a pedestrian in front of the display unit who can see the display unit and displaying a related advertising image that may be of interest to the pedestrian, the advertising effect can be increased by making the pedestrian watch the advertisement with interest, thereby improving the satisfaction of both the advertiser and the operator of the display unit and the electronic signage.

[0006] Here, the control unit counts advertisement views that are determined to be advertisement images displayed on the display unit when it is determined that a passerby in front of the display unit views the display unit for at least a preset period of time, so that the correlation with the advertisement effect can be determined using the number of counted advertisement views, which is thus advantageous for advertising marketing.

[0007] And, the control unit sets the view ranking of the plurality of advertising videos according to the number of advertisement views of each of the plurality of advertising videos, and determines the frequency of displaying the plurality of advertising videos on the display unit according to the set view ranking of the plurality of advertising videos, so that the more the number of advertisement views, the more advertisements are displayed, so that the advertising effect can be enhanced by displaying popular advertisements, which is preferable.

[0008] Here, the camera may be configured as a plurality of cameras supported in a plurality of areas of the display unit, and the control unit may determine the number of movable cameras that photograph pedestrians in front of the display unit among the plurality of cameras based on the number of pedestrians in front of the display unit, so that a plurality of pedestrians can simultaneously view the advertising image, and thus, a plurality of cameras can simultaneously detect the advertising view, which is preferable.

[0009] And, the control unit sets a shooting area for each of the plurality of movable cameras for the front area of ​​the display unit as a result of the decision, and if the set shooting area has an adjacent overlapping area, it is preferable to shoot without exception the entire front area of ​​the display unit so as to identify pedestrians.

[0010] Here, an external situation detection sensor for detecting a situation including an external temperature is further included, and the control unit stores a temperature display frequency ranking of a plurality of advertising images corresponding to a plurality of external temperatures and a situation display frequency ranking of a plurality of advertising images corresponding to an external weather condition, and controls an advertising image of a higher rank according to the temperature display frequency ranking and the situation display frequency ranking to be displayed more times than an advertising image of a lower rank based on the external temperature and the external condition detected by the external situation detection sensor, so that an advertisement with a good advertising effect can be stored according to the external temperature and an advertising image can be displayed by applying it according to the temperature.

[0011] And it further includes a communication unit that communicates with an external device, and the control unit stores a weather forecast display frequency ranking of a plurality of advertisements related to a plurality of weather forecast information, receives weather forecast information through the communication unit, and controls an advertisement image related to the received weather forecast information to be displayed on one area of ​​the display unit based on the received weather forecast information and the weather forecast display frequency ranking, so that the advertisement image can be displayed in advance according to the prediction of an external weather situation, thereby further enhancing the advertising effect, which is preferable.

[0012] Here, if the control unit determines that a pedestrian in front of the display unit views the display unit for at least a preset period of time, it is preferable to calculate the advertisement viewing time for which the pedestrian in front of the display unit views the advertisement video displayed on the display unit, so that not only the advertisement view but also the time for which pedestrians view the advertisement can be determined, thereby determining the popularity of the advertisement video.

[0013] And, the control unit sets the view time ranking of the plurality of advertisement videos according to the calculated advertisement view time, and determines the display time of the plurality of advertisement videos on the display unit according to the set view time ranking of the plurality of advertisement videos, so that the longer the view time, the more advertisements are displayed, so that the advertising effect can be enhanced by displaying popular advertisements, which is preferable.

[0014] Here, the control unit sets a popularity time ranking and a popular advertisement video ranking for displaying advertisement videos based on the advertisement view and the advertisement view time, and controls the display so that an advertisement video with a higher popularity advertisement video ranking in the set popularity time ranking is displayed more times and for a longer time than an advertisement video with a lower ranking, so that the display of popular advertisements can be increased by identifying the popularity time and popularity ranking of the advertisement videos, which is preferable.

[0015] According to the present invention, by accurately identifying a pedestrian in front who can see the display unit and then displaying a relevant advertising video that may interest the pedestrian, the pedestrian is encouraged to view the advertisement with interest, thereby increasing the advertising effect, thereby improving the satisfaction of both the advertiser and the operator of the display unit and the electronic billboard.

[0016] Additionally, the number of counted ad views can be used to determine the correlation with the advertising effect, which can be helpful for advertising marketing, and the more ad views there are, the more ads are displayed, which can have the effect of increasing the advertising effect by displaying popular ads.

[0017] In addition, multiple pedestrians can view the advertising video simultaneously, and thus multiple cameras can simultaneously capture the advertising view, and there is an effect of capturing the entire front area of ​​the display unit without exception to identify pedestrians.

[0018] In addition, it is possible to store advertisements with good advertising effects depending on the external temperature and display the advertisement video by applying it according to the temperature, and it is possible to further increase the advertising effect by displaying the advertisement video in advance according to the prediction of the external weather conditions.

[0019] In addition, it is possible to determine the popularity of an advertisement by determining not only the number of advertisement views but also the time that pedestrians view the advertisement. The longer the viewing time, the more advertisements are displayed, so there is an effect that can increase the effectiveness of advertisements by displaying popular advertisements.

[0020] Additionally, it has the effect of increasing the display of popular advertisements by identifying the popularity time and popularity ranking of advertisement videos.

[0021] Figures 1 and 2 are exemplary operation diagrams of a user recognition-based customized advertising device according to the present invention.

[0022] Figure 3 is an example of counting advertisement views in a user recognition-based customized advertisement device.

[0023] Figure 4 is an example diagram in which the number of movable cameras that are operated is set according to the number of pedestrians.

[0024] Figure 5 is an example diagram showing advertising videos displayed according to weather forecast information and weather forecast display frequency ranking.

[0025] Figure 6 is an example of detecting the time when pedestrians view advertisements.

[0026] Figure 7 is a control block diagram of a user recognition-based customized advertising device.

[0027] Hereinafter, a user recognition-based customized advertising device (1) according to a preferred embodiment of the present invention will be described in detail with reference to the attached drawings.

[0028] FIG. 1 and FIG. 2 are exemplary operation diagrams of a user recognition-based customized advertising device (1) according to the present invention, FIG. 3 is an exemplary diagram of counting advertisement views in a user recognition-based customized advertising device (1), FIG. 4 is an exemplary diagram of setting the number of operating cameras according to the number of pedestrians, FIG. 5 is an exemplary diagram of displaying advertisement videos according to weather forecast information and weather forecast display frequency ranking, FIG. 6 is an exemplary diagram of detecting the time at which pedestrians view advertisements, and FIG. 7 is a control block diagram of a user recognition-based customized advertising device (1).

[0029] The configuration of a user recognition-based customized advertising device (1) is described with reference to FIGS. 1 to 7.

[0030] A user recognition-based customized advertising device (1) includes a display unit (10), a camera (20), an external situation detection sensor (30), a communication unit (40), a user input unit (50), and a control unit (60).

[0031] The display unit (10) displays an advertising image. The display unit (10) displays an image based on an image signal processed by image processing. The implementation method of the display unit (10) is not limited, and may be implemented in various display methods such as, for example, a liquid crystal, a plasma, a light-emitting diode, an organic light-emitting diode, a surface conduction electron-emitter, a carbon nano-tube, a nano-crystal, etc.

[0032] The display unit (10) may additionally include additional components depending on its implementation method. For example, when the display unit (10) is a liquid crystal display, the display unit (10) includes a liquid crystal display panel (not shown), a backlight unit (not shown) for supplying light thereto, and a panel driving board (not shown) for driving the panel (not shown). The display unit (10) may display a voice recognition result as information on the recognized voice. Here, the voice recognition result may be displayed in various forms such as text, graphics, and icons, and the text may include letters and numbers. The display unit (10) may further display candidate commands and application information according to the voice recognition result. The user may check whether the voice has been recognized correctly by the voice recognition result displayed on the display unit (10), and may select a command corresponding to the voice spoken by the user from among the displayed candidate commands by operating the user input unit (50) provided on the remote control, or select and check information related to the voice recognition result.

[0033] The camera (20) is supported on the display unit (10) and photographs pedestrians in front of the display unit (10). The camera (20) may be configured in multiple locations on the display unit (10). The camera (20) can photograph the exterior and front, including the user.

[0034] The external situation detection sensor (30) can detect situations including external temperature. The external situation detection sensor (30) includes an external temperature sensor (31) and a light sensor (32).

[0035] The external temperature sensor (31) is supported on the display unit (10) and can detect the external temperature.

[0036] The light sensor (32) is supported on the display unit (10) and can detect external light.

[0037] The communication unit (40) can communicate with an external device. The communication unit (40) can perform wireless communication, and the wireless communication includes at least one of infrared communication, RF, Zigbee, and Bluetooth. The communication unit (40) receives a video signal and transmits it to the control unit (60) described later, and can be implemented in various ways corresponding to the standard of the video signal to be received and the implementation form of the user terminal. For example, the communication unit (40) can wirelessly receive an RF (radio frequency) signal transmitted from a broadcasting station (not shown), or can wiredly receive a video signal according to the composite video, component video, super video, SCART, HDMI (high definition multimedia interface) standard, etc. When the video signal is a broadcast signal, the communication unit (40) can include a tuner that tunes the broadcast signal by channel.

[0038] The user input unit (50) may be formed by an input means through which a user can input a user command. The user input unit (50) may receive a user's touch input or a user's remote input using a remote controller and transmit the received input to the corresponding control unit (60). In addition, the user input unit (50) may receive a voice input spoken by the user and transmit the voice signal to the control unit (60). In this case, the user input unit (50) may be implemented by, for example, a microphone. The user input unit (50) may also independently perform signal processing on the received voice signal. However, the form of the user input that the user input unit (50) can receive is not limited thereto, and for example, user input through motion recognition, etc. may also be received.

[0039] The control unit (60) stores a plurality of group features and a plurality of advertising images corresponding to each of a plurality of preset classification groups, analyzes an image captured by a camera (20) to extract features of a pedestrian in front of the display unit (10), determines which of the plurality of preset classification groups the pedestrian in front of the display unit (10) belongs to based on the extracted features of the pedestrian in front of the display unit (10), and controls the display unit (10) so that one of the plurality of advertising images corresponding to the classification group is displayed as a result of the determination.

[0040] The control unit (60) can count advertisement views, which determine that a pedestrian in front of the display unit (10) has viewed the display unit (10) for at least a preset period of time, and thus has viewed the advertisement video displayed on the display unit (10).

[0041] The control unit (60) sets the view ranking of the plurality of advertising videos according to the number of advertisement views of each of the plurality of advertising videos, and can determine the frequency at which the plurality of advertising videos are displayed on the display unit (10) according to the set view ranking of the plurality of advertising videos.

[0042] The control unit (60) can determine the number of movable cameras among the plurality of cameras (20) that capture pedestrians in front of the display unit (10) based on the number of pedestrians in front of the display unit (10).

[0043] The control unit (60) sets the shooting area of ​​each of the plurality of movable cameras for the front area of ​​the decision result display unit (10), and the set shooting area may have an adjacent overlapping area.

[0044] The control unit (60) stores the temperature display frequency ranking of a plurality of advertising images corresponding to a plurality of external temperatures and the situation display frequency ranking of a plurality of advertising images corresponding to external weather conditions, and can control the display of a higher-ranked advertising image according to the temperature display frequency ranking and the situation display frequency ranking based on the external temperature and external conditions detected by the external situation detection sensor (30) to be displayed more times than an advertising image of a lower rank.

[0045] The control unit (60) stores the weather forecast display frequency ranking of a plurality of advertisements related to a plurality of weather forecast information, receives weather forecast information through the communication unit (40), and can control an advertisement image related to the received weather forecast information to be displayed based on the received weather forecast information and the weather forecast display frequency ranking in one area of ​​the display unit (10).

[0046] If the control unit (60) determines that a passerby in front of the display unit (10) views the display unit (10) for at least a preset period of time, the control unit (60) can calculate the advertisement view time for which the passerby in front of the display unit (10) viewed the advertisement image displayed on the display unit (10).

[0047] The control unit (60) sets the view time ranking of a plurality of advertising videos according to the calculated advertisement view time, and can determine the time at which the plurality of advertising videos are displayed on the display unit (10) according to the set view time ranking of the plurality of advertising videos.

[0048] The control unit (60) sets the popularity time ranking and the popular advertisement video ranking for displaying advertisement videos based on advertisement views and advertisement view times, and can control advertisement videos with a higher popularity advertisement video ranking in the set popularity time ranking to be displayed more times and for a longer time than advertisement videos with a lower ranking.

[0049] Figures 1 and 2 are exemplary operation diagrams of a user recognition-based customized advertising device (1) according to the present invention.

[0050] As shown in Fig. 1, two high school girls are passing in front of the display unit (10). The camera (20) captures this, and the control unit (60) analyzes the captured images to determine whether the two passersby are high school girls.

[0051] As shown in Fig. 2, the control unit (60) can display a cosmetic advertisement video stored as a favorite of high school girls.

[0052] Figure 3 is an example of counting advertisement views in a user recognition-based customized advertisement device (1).

[0053] This is an example of counting advertisement views by judging that pedestrians passing in front of the display unit (10) are watching the advertisement video and passing by.

[0054] Here, the control unit (60) can determine whether the pedestrian is viewing an advertising video by enlarging the eye area of ​​the pedestrian in the captured video.

[0055] Figure 4 is an example diagram in which the number of movable cameras that are operated is set according to the number of pedestrians.

[0056] There may be a significant number of pedestrians passing in front of the display unit (10). In such cases, it may be difficult to determine whether or not the pedestrians have seen the advertisement video from the captured footage. This may be due to resolution issues. Low resolution can make it difficult to determine where the pedestrians are looking. Therefore, multiple cameras can be used to capture and analyze the captured area.

[0057] As the number of cameras increases, each camera can capture a narrow area, and the resolution increases, making it easier to determine whether a pedestrian's eyes are looking at the advertisement video or not.

[0058] Figure 5 is an example diagram showing advertising videos displayed according to weather forecast information and weather forecast display frequency ranking.

[0059] This is an example diagram showing that weather forecast information is received, and an advertising video related to the received weather forecast information is displayed based on the received weather forecast information and the weather forecast display frequency ranking in one area of ​​the display unit (10).

[0060] Figure 6 is an example of detecting the time when pedestrians view advertisements.

[0061] Since the time at which pedestrians passing in front of the display unit (10) view the advertisement video varies, this is an example diagram for determining the advertisement viewing time for the advertisement video displayed on the display unit (10) by the pedestrians passing in front of the display unit (10). The advertisement viewing time can be calculated by adding up the times at which each pedestrian in front of the display unit (10) views the advertisement video.

[0062] Describes embodiments that can be modified other than the above embodiments.

[0063] The control unit can determine how much interest pedestrians or people in front of the display are showing in the advertisement while it's being displayed. By recording behaviors such as gesturing, staring intently, or asking someone next to them to watch the advertisement, the control unit determines interest if a person in front of the display unit exhibits similar behavior. This counting can be used to calculate the number of people interested in the advertisement.

[0064] In addition, the level of interest in the advertisement can be calculated by determining the size and level of activity of the person in front of the display unit, such as gesturing while watching the advertisement, staring intently, or telling the person next to them to watch the advertisement.

[0065] The control unit sets the interest ranking and interest ranking of multiple advertising videos based on the number of advertisements and interest levels produced, and can determine the number of times and time for which multiple advertising videos are displayed on the display unit based on the interest ranking and interest levels of the set multiple advertising videos.

[0066] The display unit may further include a plurality of microphones capable of collecting voices generated in front of the display unit. The control unit may receive the voices generated in front of the display unit and determine whether the voices are related to the popularity of the advertisement video. The control unit may set a popularity ranking based on the volume of the voices related to the popularity of the advertisement video. If the voices generated in front of the display unit are related to the popularity of the advertisement video, the control unit may set the voice popularity ranking based on the volume of the voices. The control unit may determine the number of times and the time for which the plurality of advertisement videos are displayed on the display unit based on the voice popularity rankings of the plurality of advertisement videos.

[0067] By using the above user recognition-based customized advertising device (1), the pedestrians in front who can see the display unit are accurately identified, and then a relevant advertising video that may be of interest to the pedestrians is displayed so that the pedestrians view the advertisements with interest, thereby increasing the advertising effect, and thus the satisfaction of both the advertiser and the operator of the display unit and electronic billboard can be improved.

[0068] Additionally, the number of counted ad views can be used to determine the correlation with the advertising effect, which can be helpful for advertising marketing, and the more ad views there are, the more ads are displayed, which can increase the advertising effect by displaying popular ads.

[0069] In addition, multiple pedestrians can view the advertising video simultaneously, and thus multiple cameras can simultaneously capture the advertising view, and the entire front area of ​​the display unit can be captured without exception to capture pedestrians.

[0070] In addition, advertisements with good advertising effects can be stored according to the external temperature and the advertising video can be displayed by applying it according to the temperature, and the advertising effect can be further enhanced by displaying the advertising video in advance according to the predicted external weather conditions.

[0071] In addition, the popularity of an advertisement can be determined by determining not only the number of advertisement views but also the time that pedestrians spend viewing the advertisement. The longer the viewing time, the more advertisements are displayed, so the advertising effect can be increased by displaying popular advertisements.

[0072] Additionally, by identifying the popularity time and popularity ranking of advertisement videos, the display of popular advertisements can be increased.

Claims

1. In a user recognition-based customized advertising device, A display section that displays an advertisement video; A camera supported on the display unit and photographing a pedestrian in front of the display unit; and A user recognition-based customized advertising device characterized by comprising a control unit that stores a plurality of group features and a plurality of advertising images corresponding to each of a plurality of preset classification groups, analyzes an image captured by the camera to extract features of a pedestrian in front of the display unit, determines which of the plurality of preset classification groups the pedestrian in front of the display unit belongs to based on the extracted features of the pedestrian in front of the display unit, and controls the display unit so that one of the plurality of advertising images corresponding to the classification group is displayed as a result of the determination.

2. In paragraph 1, The above control unit, A user recognition-based customized advertising device characterized in that it counts advertisement views, which determines that an advertisement video displayed on the display unit has been viewed when it is determined that a passerby in front of the display unit has viewed the display unit for at least a preset period of time.

3. In paragraph 2, The above control unit, A user recognition-based customized advertising device characterized in that the view ranking of the plurality of advertising videos is set according to the number of advertisement views of each of the plurality of advertising videos, and the frequency of display of the plurality of advertising videos on the display unit is determined according to the set view ranking of the plurality of advertising videos.

4. In paragraph 3, The above camera may be formed in multiple units supported in multiple areas of the above display unit, The above control unit, A user recognition-based customized advertising device characterized in that the number of movable cameras that photograph pedestrians in front of the display unit among the plurality of cameras is determined based on the number of pedestrians in front of the display unit.

5. In paragraph 4, The above control unit, A user recognition-based customized advertising device characterized in that, as a result of a decision, a shooting area of ​​each of the plurality of movable cameras in the front area of ​​the display unit is set, and the set shooting area has an adjacent overlapping area.

6. In paragraph 1, It further includes an external situation detection sensor that detects a situation including the external temperature, The above control unit, A user recognition-based customized advertising device characterized in that it stores the temperature display frequency ranking of the plurality of advertising images corresponding to a plurality of external temperatures and the situation display frequency ranking of the plurality of advertising images corresponding to external weather conditions, and controls the display of a higher-ranked advertising image according to the temperature display frequency ranking and the situation display frequency ranking based on the external temperature and external conditions detected by the external situation detection sensor to be displayed more times than an advertising image of a lower rank.

7. In paragraph 6, It further includes a communication unit that communicates with an external device, The above control unit, Stores the weather forecast display frequency ranking of the above multiple advertisements related to multiple weather forecast information, A user recognition-based customized advertising device characterized in that it receives weather forecast information through the above communication unit and controls an advertising video related to the received weather forecast information to be displayed on one area of ​​the display unit based on the received weather forecast information and the weather forecast display frequency ranking.

8. In paragraph 2, The above control unit, A user recognition-based customized advertising device characterized in that, when it is determined that a passerby in front of the display unit views the display unit for at least a preset period of time, the advertisement viewing time for which the passerby in front of the display unit viewed the advertisement video displayed on the display unit is calculated.

9. In paragraph 8, The above control unit, A user recognition-based customized advertising device characterized in that the viewing time ranking of the plurality of advertising videos is set according to the calculated viewing time of the advertising videos, and the display time of the plurality of advertising videos on the display unit is determined according to the set viewing time ranking of the plurality of advertising videos.

10. In paragraph 1, The above control unit, A user recognition-based customized advertising device characterized in that it sets a popularity time ranking and a popular advertising video ranking for displaying advertising videos based on the advertisement views and the advertisement view time, and controls an advertising video with a higher popularity advertising video ranking in the set popularity time ranking to be displayed more times and for a longer time than an advertising video with a lower ranking.

Images