Image Display System

Abstract

To provide an in-cabin image display system capable of utilizing a technique for displaying an image in a window of a vehicle as a new communication tool.SOLUTION: An image display system comprises: a display device 40 that is provided in a display vehicle 20 on which a user A gets on, and that displays an image in a window 21 of the display vehicle 20; and a server 50 in which each user registers an image owned by himself / herself and that can communicate with each user. The server 50 includes: an image information storage section 54 in which an image is stored; a display permission list storage section 58 in which a display permission list indicating that each user may freely display the image owned by himself / herself is stored; a display permission section 59 that, in response to a request from a user A for the other user to use an image, refers to the permission list and determines whether the user permits the other user to display the image; and an image information transmission section 60 that transmits the other user's image permitted to display to the user A.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a system for displaying images on a vehicle window. [Background technology]

[0002] A head-up display is known as a technology for displaying an image on a vehicle window. For example, Patent Document 1 discloses a technology for displaying road guide information on a vehicle window. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6627214 Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is desirable that the technology for displaying images on vehicle windows be used for other purposes as well as for vehicle driving assistance as disclosed in Patent Document 1. For example, the technology may be used as a new communication tool.

[0005] SUMMARY OF THE PRESENT EMBODIMENTS An object of the present invention is to provide an in-vehicle image display system that can utilize the technology of displaying images on vehicle windows as a new communication tool. [Means for solving the problem]

[0006] The image display system of the present invention includes a display device that is installed in a vehicle in which a user rides and displays images on the vehicle's window, and a server in which each user registers their own images and is capable of communicating with each user, and the server is characterized in having an image storage unit in which images are stored, a display permission list storage unit in which a display permission list is stored indicating that each user may freely display their own images, a display permission unit that, in response to a request from a user to use an image of another user, refers to the display permission list and determines whether the user is allowed to display images of other users, and a transmission unit that transmits images of other users that have been permitted to be displayed to the user.

[0007] In the image display system according to the present invention, the image preferably includes an advertisement.

[0008] In the image display system of the present invention, the system further includes an information terminal capable of communicating with the display device and the server and operable by the user, the server having a proximity detection unit that receives from the information terminal that a vehicle in which another user is riding is within a predetermined distance of the vehicle by the information terminal receiving radio waves emitted by the vehicle in which the other user is riding, the transmission unit of the server detects that a vehicle in which another user is riding is within a predetermined distance of the vehicle by the proximity detection unit, and when the display permission unit determines that the user is allowed to display images of other users, transmits images of the other users that are permitted to be displayed to the information terminal, the information terminal transmits the images transmitted from the transmission unit of the server to the display device, and the display device preferably displays the images so that they appear to overlap a predetermined location of the vehicle in which the other user is riding, as seen through the vehicle window. Effect of the Invention

[0009] According to the image display system of the present invention, the technology of displaying an image on a vehicle window can be used as a new communication tool between users who are in the vehicle. More specifically, a user who has registered an image in a server and a user who has displayed the image on a display device can start interacting with each other or feel a sense of closeness to each other as a result of the image being displayed on the display device. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram illustrating an image display system according to an embodiment. [Diagram 2] FIG. 2 is another schematic diagram showing an image display system according to an embodiment; [Diagram 3] FIG. 2 is another schematic diagram showing an image display system according to an embodiment; [Figure 4] 1 is a block diagram showing a configuration of an image display system according to an embodiment; [Diagram 5] 11 is a flowchart illustrating a flow of operations performed during advance registration in an image display system according to an embodiment. [Figure 6] 11 is another flowchart showing the flow of operations during image display of the image display system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An example of an embodiment of the present invention will be described in detail below. In the following description, specific shapes, materials, directions, values, etc. are merely examples for the purpose of easily understanding the present invention, and can be appropriately changed according to the application, purpose, specifications, etc.

[0012] "Image display system" An image display system 10 as one example of the embodiment will be described with reference to FIGS.

[0013] 1, the image display system 10 includes a display device 40 that is provided in a display vehicle 20 in which a user A rides and displays an image in a window 21 of the display vehicle 20, and a server 50 in which each user registers his / her own images and which can communicate with each user. The server 50 stores images and transmits to user A images of other users that user A has permission to display.

[0014] According to the image display system 10, the technology for displaying an image on the window 21 of the display vehicle 20 can be used as a new communication tool, as will be described in detail later.

[0015] In addition, in the image display system 10, when the server 50 detects that a virtual decorated vehicle 30 in which user B, as another user, is riding is within a predetermined distance of the displayed vehicle 20, the display device 40 displays an image so that it appears to overlap the marking M of the virtual decorated vehicle 30 in which user B is riding, as seen through the window 21 of the displayed vehicle 20.

[0016] According to the image display system 10, when the display vehicle 20 in which user A is riding and the virtual decorated vehicle 30 in which user B is riding are close to each other, an image owned by user B that has been given permission to be displayed by user B is displayed so as to appear to overlap with the marking M of the virtual decorated vehicle 30 visible through the window 21 of the display vehicle 20, thereby allowing user A and user B to connect. Here, connecting means that users start interacting with each other using the image display system 10, or feel a sense of closeness to each other.

[0017] As shown in Figure 2, in the following, users of the image display system 10 will be described as user A who rides in the display vehicle 20 and displays an image using the display device 40, and user B who stores an image in the server 50 and rides in the virtual decorated vehicle 30. However, user A may store an image in the server 50, and user B may ride in the display vehicle 20.

[0018] In the image display system 10, a display device 40 mounted on a display vehicle 20 in which the above-mentioned user A is riding, an information terminal 70 carried by user A, an information terminal 80 carried by user B riding in the above-mentioned virtual decorated vehicle 30, and a server 50 provided in a management center 90 are connected by a wireless communication line 15.

[0019] The image display system 10 as an example of the embodiment will be described in further detail with reference to FIGS. "Display vehicle" As shown in FIG. 3, the display vehicle 20 has a display device 40 that displays an image on a window 21, a camera 22 that captures the view through the window 21, and an information terminal 70 that a user A owns.

[0020] "Display device" As described above, the display device 40 virtually decorates the virtual decorative vehicle 30 with an image by displaying the image so as to appear to overlap the marking M of the virtual decorative vehicle 30 visible through the window 21. A head-up display, for example, is preferably used as the display device 40. Note that the display device 40 may simply display the image on the window 21 regardless of the presence of the virtual decorative vehicle 30.

[0021] The display device 40 has a light source unit 41 that displays an image by emitting light that constitutes the image, a communication unit 42 that can communicate with an information terminal 70 owned by a user A riding in the display vehicle 20, and a display control unit 43 that detects marking M of the virtual decorated vehicle 30 from an image captured by the camera 22 and displays an image using the light source unit 41 so that it appears to overlap with the marking M.

[0022] The light source unit 41 may be provided, for example, in a dashboard, and may be configured to emit image display light that forms an image display toward a concave mirror provided in the dashboard.

[0023] The display control unit 43 is a computer having a processor 44 having a CPU therein for performing information processing, and a memory 45 for storing software, programs, or data executed by the processor 44.

[0024] As shown in Figure 4, the display control unit 43 has, as its control blocks, an image information acquisition unit 46 that acquires an image transmitted from the server 50 via the information terminal 70, a marking detection unit 47 that detects the marking M of the virtual decorated vehicle 30 from the image captured by the camera 22, and an image display unit 48 that displays an image using the light source unit 41 so that it appears to overlap the marking M reflected in the window 21.

[0025] The image information acquisition unit 46 , the marking detection unit 47 and the image display unit 48 are realized by the processor 44 executing the programs stored in the memory 45 .

[0026] The marking detection unit 47 may obtain three-dimensional information from the captured image, analyze the three-dimensional information, detect the virtual decorated vehicle 30 from the captured image, and further extract the marking M from the detected virtual decorated vehicle 30. The marking detection unit 47 may also recognize the marking M by deep learning and detect the marking M from the captured image.

[0027] The image display unit 48 may display an image so as to follow the movement of the marking M reflected on the window 21 by adjusting a concave mirror that reflects the light of the light source unit 41 .

[0028] "Information terminal" 3, the information terminal 70 is a smartphone owned by a user A. The information terminal 70 is a computer having a processor 71 having a CPU for performing information processing therein, a memory 72 for storing software, programs, or data executed by the processor 71, an operation unit 73 into which information can be input by operation, and a communication unit 74 connectable to a wireless communication line 15.

[0029] As shown in Figure 4, the information terminal 70 has, as its control blocks, a user information acquisition unit 75 that acquires user information of user A inputted by the operation unit 73, a user information transmission unit 76 that transmits the user information acquired by the user information acquisition unit 75 to the server 50, a transmitter detection unit 77 that detects the transmitter 31 of the virtual decorative vehicle 30 described later within a predetermined distance, a proximity information transmission unit 78 that detects that the display vehicle 20 and the virtual decorative vehicle 30 have come into close proximity and transmits the information to the server 50, and an image information transmission unit 79 that transmits image information transmitted from the server 50 (including images, advertisements, and advertising frequency, as will be described in detail later) to the display control unit 43.

[0030] The user information acquisition unit 75 , the user information transmission unit 76 , the transmitter detection unit 77 , the proximity information transmission unit 78 and the image information transmission unit 79 are realized by the processor 71 executing the programs stored in the memory 72 .

[0031] The user information includes user A's account number, the account numbers of other users who have images that user A is willing to display, the account numbers of users who have images that user A does not want to display, and keywords related to the images that user A is willing to display.

[0032] When the transmitter detection unit 77 detects the transmitter 31 of the virtual decorative vehicle 30 within a predetermined distance, the predetermined distance is preferably a distance at which the virtual decorative vehicle 30 can be seen from the window 21 (for example, 20 m).

[0033] When the transmitter detection unit 77 detects the transmitter 31 of the virtual decorative vehicle 30 within a specified distance, the proximity information transmission unit 78 determines that the display vehicle 20 and the virtual decorative vehicle 30 are in close proximity and transmits user A's account number and the identification number of the detected transmitter 31 to the server 50.

[0034] When there are multiple images in the image information transmitted from the server 50, the image information transmission unit 79 may transmit the multiple images sequentially to the display control unit 43. Alternatively, the image information transmission unit 79 may transmit one of the multiple images at random to the display control unit 43.

[0035] "Virtual decorated vehicle" As described above, the virtual decorated vehicle 30 is virtually decorated by an image displayed on the display device 40 through the window 21 in the display vehicle 20 (see FIG. 1). As shown in FIG. 3, the virtual decorated vehicle 30 has a transmitter 31 that is identified by an identification number and transmits a communication signal unique to the identification number, a marking M marked on a part of the vehicle body (for example, the side or rear of the vehicle body), and an information terminal 80 owned by user B.

[0036] "Information terminal" The information terminal 80 is a smartphone owned by the user B. The information terminal 80 is a computer having a processor 81 having a CPU for performing information processing therein, a memory 82 for storing software, programs, or data executed by the processor 81, an operation unit 83 that can input information by operation, and a communication unit 84 that can be connected to the wireless communication line 15.

[0037] As shown in FIG. 4, the information terminal 80 has, as its control blocks, an image information acquisition unit 85 that acquires image information related to an image held by user B and inputted by an operation unit 83, an image information transmission unit 86 that transmits the image information acquired by the image information acquisition unit 85 to the server 50, a user information acquisition unit 87 that acquires user information of user B inputted by the operation unit 83, and a user information transmission unit 88 that transmits the user information acquired by the user information acquisition unit 87 to the server 50.

[0038] The image information acquisition unit 85 , the image information transmission unit 86 , the user information acquisition unit 87 and the user information transmission unit 88 are realized by the processor 81 executing the programs stored in the memory 82 .

[0039] The image information includes the user's account number, image data held by the user, image data of advertisements related to the image, and the time at which the advertisements are displayed relative to the time at which the image is displayed (hereinafter referred to as the advertisement frequency).

[0040] The user information includes the account number of user B, the account numbers of other users who may display images owned by user B, the account numbers of other users who do not want to display images owned by user B, keywords related to the images owned by user B, and the identification number of transmitter 31.

[0041] "Management Center" As shown in FIG. 3, the management center 90 has a communication device 95 connected to a wireless communication line 15, and a server 50 that determines whether or not to display an image in the window 21 of the display vehicle 20 and, if it is determined that an image should be displayed, determines the image to be displayed.

[0042] "server" The server 50 is a computer having a processor 51 having an internal CPU for performing information processing, and a memory 52 for storing software, programs, or data executed by the processor 51.

[0043] As shown in Figure 4, the server 50 has as its control blocks, an image information acquisition unit 53, an image information storage unit 54, a user information acquisition unit 55, a display permission list storage unit 56, a proximity information acquisition unit 57, a display request acquisition unit 58, a display permission unit 59, an image information transmission unit 60 that transmits image information to the display device 40 via the information terminal 70, an SNS usage confirmation unit 61, a reward transmission unit 62, and an image display information transmission unit 63, each of which will be described in detail below.

[0044] The image information storage unit 54 and the display permission list storage unit 56 are realized by the processor 51 executing the programs stored in the memory 52. ​​In addition, the image information acquisition unit 53, the user information acquisition unit 55, the proximity information acquisition unit 57, the display request acquisition unit 58, the display permission unit 59, the image information transmission unit 60, the SNS usage confirmation unit 61, the reward transmission unit 62, and the image display information transmission unit 63 are realized by storing data of a predetermined structure in the memory 52.

[0045] The image information acquisition unit 53 acquires the image information when the user B registers the image information using the information terminal 80.

[0046] The image information storage unit 54 stores, as image information, the user's account number, image data owned by the user, image data of advertisements related to the image, and advertisement frequency in association with each other.

[0047] The user information acquiring unit 55 acquires user information when the user A registers the user information through the information terminal 70. The user information acquiring unit 55 also acquires user information when the user B registers the user information through the information terminal 80.

[0048] The display permission list storage unit 56 stores a display permission list consisting of a combination of the user's account number and the account numbers of other users who may freely display images owned by the user (hereinafter, account numbers of other users who may be displayed).

[0049] Here, as a combination of display permission lists, for example, if user A registers user B's account number as an account number of other users that may be displayed, and user B registers user A's account number as an account number of other users that may be displayed, the account number of user A and the account number of user B that may be displayed are determined as a combination.

[0050] In addition, as a combination of the display permission list, for example, when a keyword related to an image that user A may display and a keyword related to an image owned by user B are located, the account number of user A and the account number of user B that may be displayed are determined as the combination.

[0051] Furthermore, as a combination of display permission lists, for example, if user A has not registered user B's account number as an account number of other users that he or she may display but does not want to display, and user B has registered user A's account number as an account number of other users that he or she may display, the account number of user A and the account number of user B that he or she may display are determined to be the combination.

[0052] Furthermore, as a combination of the display permission list, for example, if user A has registered user B's account number as an account number of other users that user A may display, and user B has not registered user A's account number as either an account number of other users that user B may display, or an account number of a user that user B does not want to display, the account number of user A and the account number of user B that may be displayed are determined as a combination.

[0053] When a virtual decorative vehicle 30 is traveling within a predetermined distance from the displayed vehicle 20 and the transmitter 31 of the virtual decorative vehicle 30 is detected by an information terminal 70 owned by user A riding in the displayed vehicle 20, the proximity information acquisition unit 57 acquires user A's account number and the identification number of the transmitter 31 from the proximity information transmission unit 78 of the information terminal 80.

[0054] When the proximity information acquisition unit 57 detects that the display vehicle 20 in which user A is riding and the virtual decorative vehicle 30 in which user B is riding are approaching within a predetermined distance, the display request acquisition unit 58 assumes that user A has requested whether an image of user B may be displayed and acquires this request. Note that the display request acquisition unit 58 may receive a request directly from the information terminal 70 of user A regardless of the proximity between the display vehicle 20 and the virtual decorative vehicle 30.

[0055] The display permission unit 59 acquires a request from user A to display an image owned by user B via the display request acquisition unit 58, and determines to display the image if a combination of user A and user B is present in the display permission list stored in the display permission list storage unit 56. Note that the display permission unit 59 may be configured to make the determination by learning using artificial intelligence.

[0056] When the display permission unit 59 determines that display is permitted, the image information transmission unit 60 transmits image information to the display control unit 43 via the information terminal 70 of the user A. The image information includes the image data, the image data of the advertisement, and the advertisement frequency, as described above.

[0057] After displaying the image, the SNS usage confirmation unit 61 confirms on the information terminal 70 of the user A whether the user A wants to connect with the user B through an SNS (Social Networking Service). As a result, for example, when a keyword related to an image that the user A wants to display matches a keyword related to an image that the user B wants to display, the user A and the user B can connect with each other by displaying the image. More specifically, the user B who has registered an image in the server 50 and the user A who has displayed the image on the display device 40 can start interacting with each other or feel a sense of closeness to each other by displaying the image on the display device 40.

[0058] After displaying the image, the reward sending unit 62 transmits a reward to User B for displaying the advertisement. The reward may be paid to the server 50 by the sponsor who requested the advertisement. The reward may include electronic money, points that can be used at a specified shopping site, points that can be converted into cash, etc. This allows User B to receive a reward just by displaying the image and advertisement.

[0059] The image display information transmission unit 63 transmits the account number of the user A who is riding in the display vehicle 20 displaying the image registered by the user B, and the GPS (Global Positioning System) location information of the display vehicle 20 displaying the image registered by the user B, to the information terminal 80 of the user B. This allows the user B to know the location and frequency at which the registered image is being displayed.

[0060] "Flow of operations during initial registration of the image display system" The flow of operations during initial registration of the image display system 10 will be described with reference to FIG.

[0061] 5(A), in step S11, user A registers the above-mentioned user information in information terminal 70. The user information includes user A's account number, account numbers of other users who have images that user A is willing to display, account numbers of users who have images that user A does not want to display, and keywords related to images that user A is willing to display. This user information is transmitted to server 50.

[0062] 5(B), in step S21, user B registers the above-mentioned image information in information terminal 80. The image information includes the user's account number, image data owned by the user, image data of advertisements related to the image, and advertisement frequency. The image information is transmitted to server 50.

[0063] In step S22, user B registers the above-mentioned user information in information terminal 80. The user information includes user B's account number, account numbers of other users who may display images owned by user B, account numbers of other users who do not want to display images owned by user B, keywords related to images owned by user B, and the identification number of transmitter 31. This user information is transmitted to server 50.

[0064] "Flow of operations when displaying images on the image display system" The flow of operations performed by the image display system 10 when displaying an image will be described with reference to FIG.

[0065] 6, in step S31, the transmitter detection unit 77 of the information terminal 70 owned by user A who is riding in the displayed vehicle 20 detects the identification number of the transmitter 31 of the virtual decorative vehicle 30 traveling within a predetermined distance. In step S32, the proximity information transmission unit 78 of user A's information terminal 70 transmits the identification number of the detected transmitter 31 and user A's account number to the server 50, causing the server 50 to recognize that the virtual decorative vehicle 30 is traveling near the displayed vehicle 20.

[0066] In step S33, the display request acquisition unit 58 of the server 50 acquires the fact that the virtual decorative vehicle 30 is traveling near the display vehicle 20 as a request from user A as to whether the image held by user B may be displayed. In step S34, the display permission unit 59 of the server 50 determines whether to display the image based on the display permission list. If it is determined that the image is to be displayed, the process proceeds to step S35. In step S35, the image information transmission unit 60 of the server 50 transmits image information to the display control unit 43 via the information terminal 70 of user A.

[0067] In step S36, when the virtual decorative vehicle 30 is visible through the window 21 of the display vehicle 20, the display device 40 displays an image and advertisement so as to appear to overlap the marking M of the virtual decorative vehicle 30.

[0068] In step S37, the SNS usage confirmation unit 61 of the server 50 transmits to the information terminal 70 of user A a confirmation as to whether or not user A wishes to connect with user B via the SNS. If user A wishes to connect, the process proceeds to step S38, and the SNS usage confirmation unit 61 transmits to the information terminal 80 of user B a message indicating that user A wishes to connect with user B via the SNS.

[0069] In step S39, the reward sending unit 62 of the server 50 sends a reward for displaying the advertisement to the user B. In step S40, the image display information sending unit 63 of the server 50 sends to the information terminal 80 of the user B the account number of the user A who is riding in the displayed vehicle 20 displaying the image owned by the user B, and the GPS location information of the displayed vehicle 20 displaying the image owned by the user B.

[0070] It should be noted that the present invention is not limited to the above-described embodiment and its modified examples, and various modifications and improvements are possible within the scope of the matters described in the claims of this application.

[0071] For example, in the image display system 10, even if the display vehicle 20 and the virtual decorated vehicle 30 are not in close proximity and the virtual decorated vehicle 30 is not visible in the window 21 of the display vehicle 20, an image owned by user B may be displayed in the window 21 in response to a request from user A. [Explanation of symbols]

[0072] 10 Image display system, 15 Wireless communication line, 20 Display vehicle, 21 Window, 22 Camera, 30 Virtual decorated vehicle, 31 Transmitter, 40 Display device, 41 Light source unit, 42 Communication unit, 43 Display control unit, 44 Processor, 45 Memory, 46 Image information acquisition unit, 47 Marking detection unit, 48 Image display unit, 50 Server, 51 Processor, 52 Memory, 53 Image information acquisition unit, 54 Image information storage unit, 55 User information acquisition unit, 56 Display permission list storage unit, 57 Proximity information acquisition unit, 58 Display request acquisition unit, 59 Display permission unit, 60 Image information transmission unit, 61 SNS usage confirmation unit, 62 Reward transmission unit, 63 Image display information transmission unit, 70 Information terminal, 71 Processor, 72 Memory, 73 Operation unit, 74 Communication unit, 75 Image information acquisition unit, 76 Image information transmission unit, 77 transmitter detection unit, 78 proximity information transmission unit, 79 image information transmission unit, 80 information terminal, 81 processor, 82 memory, 83 operation unit, 84 communication unit, 85 image information acquisition unit, 86 image information transmission unit, 87 user information acquisition unit, 88 user information transmission unit, 90 management center, 95 communication device, user A user who wants to display an image, user B user who wants to display an image, M marking (predetermined location)

Claims

1. A display device that is provided in a vehicle in which a user rides and displays an image on a window of the vehicle; a server in which each user registers his / her own image and which can communicate with each user; and an information terminal which can communicate with the display device and the server and which can be operated by the user; Including, the server has an image storage unit in which the images are stored, a display permission list storage unit in which a display permission list indicating that each of the users may freely display the images owned by the users, a display permission unit which, in response to a request from the user to use an image of another user, refers to the display permission list and determines whether the user is permitted to display the image of the other user, a transmission unit which transmits to the user the image of the other user that has been permitted to be displayed, and a proximity detection unit which receives from the information terminal information that a vehicle in which the other user is riding is within a predetermined distance of the vehicle by the information terminal receiving radio waves emitted by the vehicle in which the other user is riding, the transmission unit of the server detects, by the proximity detection unit, that a vehicle in which the other user is riding is present within a predetermined distance of the vehicle, and when the display permission unit determines that the user is permitted to display an image of the other user, transmits the image of the other user that is permitted to be displayed to the information terminal; the information terminal transmits the image transmitted from the transmission unit of the server to the display device; the display device displays the image so as to appear to overlap a predetermined location of the vehicle in which the other user is riding, the location being visible through the window of the vehicle; Image display system.

2. 2. The image display system according to claim 1, The image includes an advertisement. Image display system.

Images