Information display device and information display method

Abstract

To provide an information display device and an information display method that display two-dimensional codes without reducing a display space for content such as advertisements.SOLUTION: An information display device 200 includes a display unit 220 having a screen, an imaging unit 210 that acquires image data by capturing images of surroundings, a detection unit 231 that detects, based on the image data acquired by the imaging unit 210, that a person 30 has made an action of holding a mobile terminal 40 toward the display unit 220, and a display control unit 232 that controls the display unit 220 to display a QR code 60 on the screen when the detection unit 231 detects that the person 30 has made the action of holding the mobile terminal 40 toward the display unit 220.SELECTED DRAWING: Figure 7B

Description

Technical Field

[0001] The present disclosure relates to an information display device and an information display method for displaying content, and particularly to an information display device and an information display method for displaying a two-dimensional code together with content such as an advertisement.

Background Art

[0002] Patent Document 1 describes a product / store information providing system composed of a display device, a mobile phone, and a management computer. This display device is installed near a product sales area or inside a store, and has a liquid crystal display that displays a barcode in which link information to a website related to the product or store is recorded together with a video for advertising the product or store.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, when displaying a two-dimensional code such as a QR code (registered trademark; annotations are omitted elsewhere) together with content such as an advertisement on digital signage, in order to make it easy to read from a smartphone or the like, it is necessary to display it in a certain size (area). For that amount, it must be allocated for the QR code from the original advertisement display space. Also, there are cases where the design property of the content is impaired by displaying the two-dimensional code.

[0005] An object of the present disclosure is to provide an information display device and an information display method for displaying a two-dimensional code without reducing the display space for content such as an advertisement.

Means for Solving the Problems

[0006] The information display device of this disclosure comprises a display unit having a screen, an imaging unit capturing images of the surroundings and acquiring image data, a detection unit detecting, based on the image data acquired by the imaging unit, that a person has held a mobile terminal towards the display unit, and a display control unit that controls the display unit to display an information code on the screen when the detection unit detects that a person has held the mobile terminal towards the display unit.

[0007] The information display method disclosed herein includes an imaging step of capturing images of the surroundings and acquiring image data; a detection step of detecting, based on the image data acquired in the imaging step, that a person has held a mobile device towards the display unit; and a display control step of controlling the display unit to display an information code on the screen when the detection step detects that the person has held the mobile device towards the display unit. [Effects of the Invention]

[0008] According to this disclosure, it will be possible to display QR codes without reducing the display space for content such as advertisements, and the design quality of the content will not be compromised. [Brief explanation of the drawing]

[0009] [Figure 1] This is an explanatory diagram of an information display system 100 comprising a digital signage 200 and a content distribution server 300 according to one embodiment of the present disclosure. [Figure 2] This is a block diagram showing the electrical configuration of the information display system 100. [Figure 3] This is an explanatory diagram illustrating the action of a person 30, which is detected by the digital signage 200, holding a smartphone 40 towards the display 220. [Figure 4] This is a flowchart of the basic operation controlled by the CPU 230 of the Digital Signage 200. [Figure 5] This is an explanatory diagram illustrating the display under normal conditions. [Figure 6A] This is an explanatory diagram illustrating a method of displaying a QR code 60 overlaid on top of previously displayed content. [Figure 6B] This is an explanatory diagram illustrating a configuration in which the previously displayed content is temporarily hidden and only the QR code 60 is displayed. [Figure 7A] This is an explanatory diagram illustrating an example of how the display position of the QR code 60 is changed according to the location of the detected person 30 or smartphone 40. [Figure 7B] This is an explanatory diagram illustrating an example of how the display position of the QR code 60 is changed in accordance with changes in the position of the detected person 30 or smartphone 40. [Figure 7C] This is an explanatory diagram illustrating an example of how the display size of the QR code 60 is changed according to the distance to the detected person 30 or smartphone 40. [Figure 8] This is an explanatory diagram illustrating an example of how the display shape of the QR code 60 is corrected according to the position (direction) of the detected person 30 or smartphone 40. [Figure 9] This is an explanatory diagram illustrating an example of how the content of a QR code 60 is changed according to the attributes of the detected person 30. [Figure 10A] This is an explanatory diagram illustrating an example of how the fact that the digital signage 200 has the functions described herein is displayed on a pop-up display 51 placed on top of the digital signage 200. [Figure 10B] This is an explanatory diagram illustrating an example of how the digital signage 200 has the functions described herein, as indicated by the caption 52 on the display 220. [Modes for carrying out the invention]

[0010] Embodiments of this disclosure will be described with reference to the drawings. In the drawings, the same or corresponding parts will be denoted by the same reference numerals and will not be repeated in the description.

[0011] (1) Outline configuration of Digital Signage 200 FIG. 1 is an explanatory diagram of an information display system 100 composed of a digital signage 200 and a content distribution server 300 according to an embodiment of the present disclosure. FIG. 2 is a block diagram showing the electrical configuration of this information display system 100. Note that the digital signage 200 is an example of the "information display device" of the present disclosure.

[0012] As shown in FIGS. 1 and 2, the digital signage 200 includes a camera 210, a display 220, a CPU 230, a volatile main memory unit 240, a non-volatile auxiliary storage unit 250, a communication unit 260, a USB terminal 270, and a data bus 280 that interconnects these components. However, for high-speed access, the CPU (Central Processing Unit) 230 and the main memory unit 240 are directly connected.

[0013] The camera 210 (corresponding to the "imaging unit" of the present disclosure) is disposed at a position suitable for imaging the surroundings of the digital signage 200, for example, at the upper end of the digital signage 200.

[0014] The display 220 (corresponding to the "display unit" of the present disclosure) displays contents such as advertisements and guide maps (such as tourist guides and floor guides), and two-dimensional codes such as QR codes (corresponding to the "information code" of the present disclosure) related thereto.

[0015] Examples of the display 220 include, but are not limited to, liquid crystal and organic EL (organic electro-luminescence).

[0016] The CPU 230 controls each part of the digital signage 200, and includes a detection unit 231 and a display control unit 232 to realize the content of the present disclosure. The detection unit 231 and the display control unit 232 are realized by the CPU 230 executing software of corresponding functions. The detection unit 231 detects an operation in which a person 30 (see FIG. 3) holds a smartphone 40 (see FIG. 3) in front of the display 220. The display control unit 232 controls the display content of the display 220 according to the detection result by the detection unit 231.

[0017] As shown in Figure 1, integrating the CPU230 into the digital signage 200 via an internal SoC (System-on-a-chip) improves usability. However, it is also possible to connect an external PC and use the CPU built into that PC.

[0018] The main memory unit 240 could be, for example, DRAM (Dynamic Random Access Memory), but is not limited to this.

[0019] Examples of auxiliary storage units 250 include, but are not limited to, ROM (Read Only Memory), flash memory, and hard disks. This auxiliary storage unit 250 stores software with multiple functions, such as firmware and applications, along with the OS (Operating System), and also stores content such as advertisements.

[0020] The communication unit 260 has hardware such as a communication interface and software such as various communication protocols in order to communicate with the content distribution server 300 via the Internet 10. The communication interface is not limited to a wired connection using a cable 11 to connect to the Internet 10, but may also be a wireless connection.

[0021] A USB memory stick 20 containing various content can be inserted into the USB port 270, allowing this content to be read by the digital signage 200.

[0022] (2) Outline configuration of the content distribution server 300 As shown in Figures 1 and 2, the content distribution server 300 comprises a CPU 310, a storage unit 320, a communication unit 330, and a data bus 340 that intervenes in data exchange between these units. The storage unit 320 may be divided into a main memory unit and an auxiliary memory unit, similar to the digital signage 200, and the main memory unit may be directly connected to the CPU 310. The configuration of the content distribution server 300 itself is the same as that of a general computer, so further detailed explanation is omitted.

[0023] The content distribution server 300 stores various content to be displayed on the digital signage 200, along with a list of content distribution targets and a distribution schedule, in the storage unit 320. Then, according to the stored distribution schedule, it distributes the content to the digital signage 200 included in the distribution target list. As a result, the digital signage 200 can not only display a single piece of content, but also display multiple pieces of content sequentially or switch between content at predetermined times.

[0024] (3) Basic operation of Digital Signage 200 Figure 3 is an explanatory diagram illustrating the action of a person 30, which is the target of detection by the digital signage 200, holding a smartphone 40 towards the display 220. Figure 4 is a flowchart of the basic operation controlled by the CPU 230 of the digital signage 200. Figure 5 is an explanatory diagram illustrating the display under normal conditions. Figure 6A is an explanatory diagram illustrating a mode in which a QR code 60 is displayed overlaid on the content that was previously displayed. Figure 6B is an explanatory diagram illustrating a mode in which the previously displayed content is temporarily hidden and only the QR code 60 is displayed.

[0025] As shown in Figure 4, when the digital signage 200 is powered on, in step S41, content such as advertisements stored in the auxiliary storage unit 250 is first displayed on the display 220. For example, as shown in Figure 5, an advertisement video for clothing is displayed. Then, the process proceeds to the next step S42.

[0026] In step S42, it is detected whether the person 30 is holding up a smartphone 40 (corresponding to the “mobile terminal” in this disclosure) (pointing it towards the display 220) within the field of view of the camera 210. If the detection result is Yes, the process proceeds to the next step S43; otherwise, it proceeds to step S44. For this detection, image data of the area around the digital signage 200 is captured by the camera 210. Therefore, this step S42 corresponds to the “imaging step” and “detection step” in this disclosure.

[0027] In step S43, the QR code 60 associated with the content that was previously displayed on the display 220 is displayed on the display 220, and the process proceeds to the next step S44. In this case, for example, as shown in Figure 6A, the QR code 60 may be displayed overlaid on the content, or as shown in Figure 6B, the content may be temporarily hidden and only the QR code 60 may be displayed. However, the display is not limited to these methods. Note that this step S43 corresponds to the "display control step" in this disclosure.

[0028] Examples of linking content with QR Code 60 include the combinations shown in the following table, but these are not the only examples.

[0029] [Table 1]

[0030] In step S44, it is determined whether or not to turn off the power to the digital signage 200. If the result is Yes, the power is turned off; otherwise, the process returns to step S41.

[0031] This basic operation allows the QR code 60 to be displayed only when necessary, without reducing the display space for advertisements or other content during normal operation. In other words, the QR code 60 can be displayed only when there is a high probability that a person 30 is paying attention to the advertisement or other content displayed on the display 220. In this case, readability can be improved, for example, by displaying the QR code 60 in a larger size. Since the QR code 60 will not be displayed if there is no person 30 paying attention to the content, the design quality of the content can also be avoided.

[0032] (4) Detection of the movements of person 30 and corresponding display control The detection unit 231 of the digital signage 200 detects the action of a person 30 holding a smartphone 40 towards the display 220, as shown in Figure 3. Therefore, the detection unit 231 detects the smartphone 40 itself, the shape of the person 30's hand 32, and the action of raising that hand 32 within the camera 210's field of view. The shape characteristics for detecting the person 30 include having a head 33 on top of a torso 34 and arms 31 on both the left and right sides.

[0033] For example, the detection unit 231 first searches for the presence of a person 30 in the surrounding image data continuously acquired by the camera 210. If it determines that a person 30 is present, it detects whether the person has raised one arm 31 forward. If such a movement is detected, it then sequentially detects whether a small object resembling a smartphone 40 is being held in the hand 32 at the end of that arm 31, and whether the built-in camera 41 located near the upper end of that object is pointed towards the display 220. However, the detection method is not limited to this.

[0034] Furthermore, if the detection unit 231 detects that person 30 holds the smartphone 40 towards the display 220, it continues to detect the person 30's behavior and is configured to detect when the person stops holding the smartphone 40 towards the display 220. Then, it erases the QR code 60 that was displayed on the display 220 and returns to displaying the original content. For example, it returns from a display like the one shown in Figure 6A or Figure 6B to a display like the one shown in Figure 5. This allows the display of the QR code 60 to be stopped after it is presumed that the reading of the QR code 60 has been completed, thus minimizing the time during which the tactile quality of the content is compromised.

[0035] (5) Example of detecting the position of person 30 and the distance to that position, and corresponding display control. In addition to detecting the movements of person 30 and corresponding display control as described above, it is also conceivable to detect the position, distance, attributes, etc., of person 30 and perform corresponding display control.

[0036] Figure 7A is an explanatory diagram illustrating an example of changing the display position of the QR code 60 according to the position of the detected person 30 or smartphone 40. Figure 7B is an explanatory diagram illustrating an example of changing the display position of the QR code 60 in accordance with changes in the position of the detected person 30 or smartphone 40. Figure 7C is an explanatory diagram illustrating an example of changing the display size of the QR code 60 according to the distance to the detected person 30 or smartphone 40. Figure 8 is an explanatory diagram illustrating an example of correcting the display shape of the QR code 60 according to the position (direction) of the detected person 30 or smartphone 40.

[0037] The detection unit 231 also detects the position where the person 30 held up the smartphone 40 and the distance to that position, based on the image data acquired by the camera 210. Here, "position" means, for example, which side (e.g., right or left) or direction (e.g., directly in front, slightly to the left or right) relative to the front of the digital signage 200.

[0038] For example, if person 30 is to the right of the digital signage 200 (towards the left within the camera 210's field of view), the QR code 60 is displayed to the right of the display 220, as shown in Figure 7A. This ensures that the QR code 60 is displayed near person 30 who is to the right of the digital signage 200, making it easier for person 30 to read with the smartphone 40's built-in camera 41.

[0039] It is preferable to detect the position of person 30 not just once, but continuously or intermittently thereafter. The display control content should also be changed as necessary based on the detection results. For example, if person 30 is to the right of the digital signage 200 and the display control is as shown in Figure 7A, when it is detected that person 30 has moved toward the front of the digital signage 200, the display should be changed to as shown in Figure 7B. That is, the QR code 60 is displayed at the bottom center of the display 220. This ensures that the QR code 60 is always displayed in an easily readable position, even if person 30 moves.

[0040] The distance to person 30 can be calculated using the principle of trigonometry if camera 210 is a stereo camera (two-lens type). Even if camera 210 is a monocular type, it can be estimated from its field of view and the size of person 30 in the image data.

[0041] For example, if the distance to person 30 is small (person 30 is close to the digital signage 200), the QR code 60 is displayed small on the display 220, as shown on the left side of Figure 7C. Conversely, if the distance to person 30 is large (person 30 is far from the digital signage 200), the QR code 60 is displayed large on the display 220, as shown on the right side of Figure 7C. This makes it easier for the built-in camera 41 of the smartphone 40 to read the QR code 60, regardless of the distance to person 30.

[0042] Furthermore, it is preferable to detect the distance to the position of person 30 not just once, but continuously or intermittently thereafter.

[0043] Furthermore, if the person 30 is not facing the digital signage 200, the QR code 60, which is displayed as a square on the display 220, will appear distorted from the person 30's position. Therefore, as shown in Figure 8, the QR code 60 may be pre-deformed (shaped to correct its form) so that it returns to a square when viewed from the person 30's position, and then displayed on the display 220. This minimizes the possibility of the QR code 60 not being read correctly, even if the person 30 is not facing the digital signage 200.

[0044] (6) Example of detecting the attributes of person 30 and corresponding display control It is also conceivable to detect the attributes of person 30 and perform corresponding display control. Figure 9 is an explanatory diagram illustrating an example of changing the content of the QR code 60 according to the detected attributes of person 30.

[0045] The detection unit 231 further detects the attributes of the person 30, such as gender and age, based on the image data acquired by the camera 210. Examples of linking content with QR code 60 in such cases include, but are not limited to, the combinations shown in the following table.

[0046] [Table 2]

[0047] For example, if person 30 is male (M), a male-oriented QR code 60M will be displayed, and if person 30 is female (F), a female-oriented QR code 60F will be displayed.

[0048] For example, if the content previously displayed was an advertisement for clothing item A, and the detected person 30 is male, then QR code 60M, which is a URL for men's clothing, will be displayed. If the person is female, then QR code 60F, which is a URL for women's clothing, will be displayed.

[0049] For example, if the content previously displayed was an advertisement for cosmetic product B, and the detected person 30 is young, a QR code for a URL listing cosmetics aimed at young people will be displayed; if the person is elderly, a QR code for a URL listing cosmetics aimed at elderly people will be displayed.

[0050] In this way, the appropriate QR code is displayed according to the 30 attributes of the person, thereby further enhancing the advertising and promotional effect of the digital signage 200.

[0051] (7) Publicizing functions such as those disclosed herein Even if the digital signage 200 is installed, users will not know how to use it unless they are aware that it has functions like those disclosed here. Furthermore, users may become confused if the content displayed on the display 220 suddenly changes and a QR code is displayed. Therefore, it is preferable to devise ways to inform users about functions like those disclosed here, for example, by the following methods.

[0052] Figure 10A is an explanatory diagram illustrating an example of how the digital signage 200 has the functions described herein, as indicated by a pop-up display 51 placed on top of the digital signage 200. In other words, users can be informed with such a simple method. However, the method of notification is not limited to pop-up displays.

[0053] Figure 10B is an explanatory diagram illustrating an example of how the digital signage 200 displays, via a caption 52 on the display 220, that it has the functions described in this disclosure. In this case, the content of the caption (corresponding to the "message" in this disclosure) is easily seen by users viewing the content, thus increasing the likelihood that the existence of the functions described in this disclosure will be recognized. However, the method of notification is not limited to captions. [Industrial applicability]

[0054] This disclosure can be used in the field of information display devices that display content such as advertisements, such as digital signage. [Explanation of Symbols]

[0055] 10 Internet 11 Cables 12 Cables 20 USB flash drives 30 people 40. Smartphone (mobile device) 41. Built-in camera 51 Pop 52 Text overlays (messages) 60 QR codes 100 Information Display System 200 Digital signage (information display devices) 210 Camera (imaging unit) 220 Display (Display Unit) 230 CPU 231 Detection unit 232 Display Control Unit 240 Main memory 250 Auxiliary storage section 260 Communications Department 270 USB ports 280 data bus 300 Content Delivery Servers 310 CPU 320 Storage section 330 Communications Department 340 data bus

Claims

1. A display unit having a screen, An imaging unit that captures images of the surroundings and acquires image data, A detection unit detects, based on the image data acquired by the imaging unit, that a person has performed the action of holding a mobile device towards the display unit, When the detection unit detects that the person has held the mobile terminal towards the display unit, the display control unit controls the display unit to display an information code on the screen. An information display device equipped with the following features.

2. The information display device according to claim 1, wherein the display control unit controls the display unit so as not to display the information code on the screen when the detection unit detects that the person has stopped the action of holding the mobile terminal toward the display unit while the information code is displayed on the screen.

3. The detection unit detects the position in which the person holds the mobile terminal towards the display unit. The information display device according to claim 1 or claim 2, wherein the display control unit changes the display position of the information code on the screen according to the position detected by the detection unit.

4. The information display device according to claim 3, wherein the display control unit corrects the display shape of the information code on the screen according to the position detected by the detection unit.

5. The detection unit detects the distance to the person, The information display device according to claim 1 or claim 2, wherein the display control unit changes the display size of the information code on the screen according to the distance detected by the detection unit.

6. The detection unit detects the attributes of the person, The information display device according to claim 1 or 2, wherein the display control unit changes the content of the information code on the screen according to the attribute detected by the detection unit.

7. The information display device according to claim 1 or claim 2, wherein the display control unit controls the display unit to display a message on the screen prompting the user to hold the mobile terminal towards the display unit.

8. The information display device according to claim 1 or claim 2, wherein the information code includes a QR code.

9. The imaging step involves capturing images of the surroundings to obtain image data, A detection step that detects, based on the image data acquired in the aforementioned imaging step, that a person has performed an action of holding the mobile device towards the display unit, In the detection step, if it is detected that the person has raised the mobile terminal toward the display unit, a display control step is performed to control the display unit to display an information code on the screen. Information display methods, including those mentioned above.

Images