Augmented-reality (AR) systems

[0045] See figure 1 , figure 1 It is a schematic diagram showing an augmented reality system 1 according to a specific embodiment of the present invention. Such as figure 1 As shown, the augmented reality system 1 includes a remote server 10, a digital information input device 12, at least one first mobile communication device 14, at least one vehicle 16, at least one image projection device 18, a trigger input unit 11, and a second action The communication device 13, wherein the remote server 10 and the digital information input device 12 are connected to each other, the remote server 10 can communicate with the first mobile communication device 14, and the image projection device 18 is disposed on the carrier 16 and can communicate with the first mobile communication device 14. A mobile communication device 14 communicates with each other, and the trigger input unit 11 is located in the first mobile communication device 14 and can communicate with the second mobile communication device 13.

[0046] The digital information input device 12 is connected to the remote server 10, so a provider of digital information can use the digital information input device 12 to input digital information S to the remote server 10. In practice, the digital information input device 12 can be one of a desktop computer, a tablet computer, and a smart phone, and moreover, can be any electronic device that can be used to input digital information S. In practice, the provider of the above information can be an advertiser or an advertising agency that accepts advertising entrustment. The input digital information S can be advertising information, which can be one of image files, text files, and audiovisual files or combination. In other words, an advertiser or advertising agency can input its advertising information to the remote server 10 through the digital information input device 12.

[0047] In this specific embodiment, the digital information input device 12 can be provided with digital information input software for the digital information provider to input their digital information S. This digital information input software can provide a convenient interface for the digital information provider to input numbers. For the information S, the digital information S can be simply input without complicated operations. In another specific embodiment, the digital information input software can also be built in the remote server 10. The remote server 10 provides an interface to the digital information device through the digital information input software, so that the digital information provider can use the digital information The device operates this interface to input digital information S.

[0048] The first mobile communication device 14 may be various portable electronic devices, such as smart phones, tablet computers with communication functions, or wearables such as smart glasses with communication functions, smart watches with communication functions, or smart helmets with communication functions. Style electronic device. In recent years, the electronics industry has developed rapidly. Various wearable objects can be combined with electronic devices and wireless transmission technology to become smart wearable objects. These smart wearable objects can be used as the first mobile communication device of the present invention. . A first mobile application program can be set in the first mobile communication device 14, and the first mobile application program can process and control various functions performed by the first mobile communication device 14 in the augmented reality system 1. In detail, the first mobile application can control the first mobile communication device 14 to communicate with the remote server 10 to receive digital information S from the remote server 10. Then, the first mobile application can control the first mobile communication device 14 Transmit the received digital information S and a first command. In practice, the first mobile communication device 14 can receive and transmit the digital information S and the first command through various wireless communication technologies.

[0049] The first mobile communication device 14 can communicate with the image projection device 18 provided on the carrier 16. Similarly, the first mobile communication device 14 can be used to transmit digital information S and the first command to the image projection device through various wireless communication technologies. 18. The image projection device 18 can project the digital information S into the image display area according to the received first instruction. In practice, the vehicle 16 can be a car, a motorcycle, a bicycle, a train, a drone, or a wearable object, and the image display area can be the ground, a wall, a ceiling in a house, a ceiling in a car, or a projection screen. , The augmented reality system 1 can project the digital information S on various locations in the city through the vehicle 16 to achieve good advertising effects.

[0050] In this embodiment, the number of the first mobile communication device 14, the carrier 16, and the image projection device 18 is not limited to figure 1 The number in. In practice, the first mobile communication device 14 installed with the above-mentioned first mobile application program can communicate with a certain image projection device 18 on the remote server 10 and the vehicle 16 through the first mobile application program. The digital information S is received and sent to the image projection device 18 so that the image projection device 18 is projected on the vehicle 16 (for example, the roof of a car) or on the image display area near the vehicle 16. For example, a user of any first mobile communication device 14 (such as a mobile phone or a tablet) can download and install the first mobile application, and then the user installs the image projection device 18 on his carrier 16 and makes it Connect with the user's first mobile communication device 14. After the various settings are completed, the user uses the first mobile communication device 14 to receive advertisement information from the remote server 10, and then uses the first mobile communication device 14 to control the vehicle 16 for a specific time period, such as when driving or When parked on the side of the road, the advertising information is projected on the vehicle (for example, the roof of a car) or the image display area near the vehicle to obtain advertising effects, and part of the advertising revenue can be collected by this.

[0051] In this embodiment, the number of image projection devices 18 on the same carrier 16 is not limited, and can be purchased and installed at different positions on the carrier 16 according to user needs to project digital information S to different image displays area. For example, image projection devices can be installed on the front, side, or back of a car, and inside the car to project digital information on the ground or wall of the front, side, or back of the car, or the roof of the car. The image projection devices 18 on the same vehicle 16 or even on different vehicles 16 can also be connected to the same first mobile communication device 14, so that the same first mobile communication device 14 can simultaneously or separately control the projection of each image projection device 18 The digital information S is in different image display areas.

[0052] The second mobile communication device 13 can be various portable electronic devices, such as smart phones, tablet computers with communication functions, or wearables such as smart glasses with communication functions, smart watches with communication functions, or smart helmets with communication functions. Style electronic device. In this embodiment, the trigger input unit 11 is an application program installed in the first mobile communication device 14, which can transmit the second command to the second mobile communication device 13 through the first mobile communication device 14. In another specific embodiment, the trigger input unit 11 may be a signal sending module, which is provided in the first mobile communication device 14. Furthermore, it may be an external signal sending module which can be connected to the first mobile communication device. The device 14 communicates with the second mobile communication device 13 and transmits a second command. In practice, the signal sending module can also be controlled by the first mobile application process to communicate with the second mobile communication device 13. In another specific embodiment, the trigger input unit 11 is the first mobile application program, and the first mobile application program can also control the first mobile communication device 14 to communicate with the second mobile communication device 13, thereby transmitting the second command to The second mobile communication device 13.

[0053] The second mobile communication device 13 includes a display element and is installed with a second mobile application program. The second mobile application program can control the display element to display an augmented reality image according to the received second command. In practice, the second mobile application can be downloaded by the second mobile communication device 13 from the remote server 10 and installed on it. In a specific embodiment, the augmented reality image may be stored in advance in the second mobile communication device 13 in whole or as part of the image. When the second mobile application program wants to control the display element to display the augmented reality image according to the second instruction, the second action The application program can display the augmented reality image previously stored in the second mobile communication device 13 on the display element. Among them, the format of the pre-stored augmented reality image can be not only an image, but also various logic codes that can be converted into an image by a processor. In addition, there can be more than one type of augmented reality image, and the second mobile application can display different augmented reality images on the display element according to the second command, thereby achieving different display effects. Furthermore, the augmented reality image can also be obtained by communicating with the remote server 10, the first mobile communication device 14 or the image projection device 18 through the second mobile communication device 13 through the second mobile application in advance. In another embodiment, the augmented reality image is not previously stored in the second mobile communication device 13. When the second mobile application program wants to control the display element to display the augmented reality image according to the second instruction, the second mobile application program must first The second command communicates with the remote server 10, the first mobile communication device 14 or the image projection device 18 and requests the required augmented reality image, which is displayed on the display element in real time after receiving the required augmented reality image. At this time, the second mobile application program can obtain different augmented reality images according to the different second commands, thereby reducing the storage requirements of the second mobile communication device 13. The display element can be a liquid crystal screen, LED screen, OLED display, projection screen or any device that can present images.

[0054] The second mobile communication device 13 further includes an image capturing element for capturing images around the second mobile communication device 13. In a specific embodiment, the image acquisition component may be a recording component to acquire surrounding images of the second mobile communication device 13. The above-mentioned display element can be directly or indirectly connected to the image acquisition element, thereby playing the image acquired by the image acquisition element. In a specific embodiment, the second mobile application program controls the display element to start displaying augmented reality images on the acquired surrounding images when the image acquisition element acquires the image of the at least one image display area according to the second instruction. In another specific embodiment, when the image acquired by the image acquisition component matches the image of the image display area in the second command, the second application process controls the display component to start displaying the augmented reality image on the acquired surrounding image. The image of the image display area required in the second command can be provided by the remote server 10, the first mobile communication device 14, or the image projection device 18. In a specific embodiment, the image in the required image display area may be an actual environment image, such as a white building or a specific signboard, when the surrounding image acquired by the second mobile communication device 13 has the When the sign is displayed, the display element is triggered to start displaying the augmented reality image on the obtained surrounding image. In another specific embodiment, the image in the required image display area is the projected digital information. When the image acquisition component acquires the required digital information in the surrounding image of the second mobile communication device 13, the display is triggered The component starts to display augmented reality images on the acquired surrounding images. In another specific embodiment, the image may be a composite image of digital information plus actual environment images.

[0055] In each of the foregoing specific embodiments, the method of comparing whether the acquired image matches the image in the image display area in the second command may be to compare whether each pixel between the two images is completely consistent, and each image is divided into two images. Whether the average pixel brightness difference in the same area between images is lower than a critical value, or whether the diagonal pixel difference ratio in an image is the same, etc., in practice, any image processing method that can compare images can be used in the present invention Image comparison.

[0056] In a specific embodiment, the augmented reality image is a plane image. When the second mobile communication device 13 moves or rotates and tilts, the augmented reality image displayed by the display element moves, rotates, or scales accordingly. In a specific embodiment, the augmented reality image is a three-dimensional image. When the second mobile communication device 13 moves or rotates and tilts, the augmented reality image displayed by the display element moves, zooms, or rotates and tilts relatively, thereby displaying Different aspects of augmented reality images.

[0057] In another specific embodiment, the condition for the second instruction to cause the second mobile communication device 13 to control the display element to display the augmented reality image is that when the second mobile communication device 13 is located at the preset location, the display element starts to display the augmented reality image. The preset location may be a physical address. When the second mobile communication device 13 uses a positioning device such as GPS or any physical positioning method to locate the preset physical address (e.g., store address, billboard location), The display element starts to display the augmented reality image on the acquired surrounding image. In another specific embodiment, the preset location is a location where the signal strength of a specific signal can be received is greater than a critical value, for example, the second mobile communication device 13 receives the second mobile communication device 13 held by an advertising merchant or a car owner. When the strength of the Bluetooth or WiFi signal sent by a mobile communication device 14 is greater than a threshold value, it means that the preset location has been reached, and the display element in the second mobile communication device 13 is then prompted to start displaying augmented reality images. In another embodiment, the specific signal may also be sent by the image projection device 18, or any device capable of sending the specific signal, so as to set the preset location more flexibly.

[0058] In another specific embodiment, the condition for the second instruction to make the second mobile communication device 13 control the display element to display the augmented reality image is that the second mobile communication device 13 starts to display the augmented reality image after a certain time. The above-mentioned time may be the time that the second mobile communication device 13 starts to count after receiving the second instruction, for example, 5 minutes after receiving the second instruction, the display element starts to display the augmented reality image. In another specific embodiment, the time may be at a specific time, for example, at 5:50 PM, the display element of the second mobile communication device 13 starts to display the augmented reality image.

[0059] In this embodiment, the vehicle 16 may be an online car-hailing or taxi, and the online car-hailing or taxi driver holds the first mobile communication device 14, and the advertiser transmits the advertisement information to the Internet through the remote server 10. The image projection device 18 on the ride-hailing or taxi, when the online ride-hailing or taxi is carrying passengers, the image projection device 18 projects the advertisement information for the passengers to browse. Passengers holding the second mobile communication device 13 get the second instruction by communicating with the first mobile communication device 14. When the image acquisition element of the second mobile communication device 13 acquires the advertising information projected by the image projection device 18, 2. The display element of the mobile communication device 13 starts to display augmented reality images on the acquired advertisement information, thereby realizing the three of the advertisement owner, online car-hailing or taxi driver (advertisement player) and passengers (advertisement viewer) The interaction between.

[0060] See figure 2 , figure 2 It is a schematic diagram showing an augmented reality system 2 according to another specific embodiment of the present invention. Such as figure 2 As shown, this specific embodiment and figure 1 The specific embodiment shown differs in that the trigger input unit 21 of this specific embodiment is an application installed on the image projection device 28 (or connected to the image projection device 28), and the second mobile communication device 23 can be connected to the image projection device 28. The projection device 28 communicates, thereby obtaining a second instruction from the image projection device 28. According to the received second instruction, the second mobile communication device 23 may first obtain the conditions for triggering the playback of the augmented reality image from the image projection device 28, such as environmental image, location, or time information. In another specific embodiment, the second mobile communication device 23 may also obtain the aforementioned conditions for triggering the playback of the augmented reality image from the first mobile communication device 24 or the remote server 20 according to the received second instruction. Please note that the functions and structures of each unit of the action information playing system 2 of this specific embodiment are substantially the same as the corresponding units of the above specific embodiment, so they will not be repeated here.

[0061] See image 3 , image 3 It is a schematic diagram showing an augmented reality system 3 according to another specific embodiment of the present invention. Such as image 3 As shown, this specific embodiment and figure 1 The specific embodiment shown is different in that the first mobile communication device 34 of this specific embodiment can be set on the carrier 36 and connected to the image projection device 38. Since the first mobile communication device 34 is disposed on the carrier 36, it and the image projection device 38 can communicate with each other in a wired connection. Please note that the functions and structures of each unit of the action information playing system 3 of this specific embodiment are substantially the same as the corresponding units of the above specific embodiment, so they will not be repeated here.

[0062] In this embodiment, the first mobile communication device 34 and the image projection device 38 are disposed on the carrier 36, and the three can form a smart device, such as a smart car, a smart motorcycle, a smart bicycle, or a smart robot. In practice, the first mobile application program on the first mobile communication device 34 can be used to plan the travel route of the smart device and control the image projection device 38 to play the digital signal S along the route.

[0063] In practice, the user can use the first mobile communication device of the above specific embodiments to download a variety of different digital information, and control or make the first mobile application in the first mobile communication device schedule the image projection device. The time and sequence of playing different digital information can produce more diversified advertising effects, and even interact with the audience of the advertisement. For example, the smart device formed by the above-mentioned first mobile communication device installed on the carrier can simultaneously obtain the thermal image of the advertising audience through the infrared thermal imager on the first mobile communication device, and then the first mobile communication device The first mobile application judges the audience’s current response to the digital information, and then requests the remote server to provide the corresponding digital information based on this response (or downloads multiple digital signals from the remote server in advance, and then according to the audience’s The current response selects the corresponding digital information), and the corresponding digital information is sent to the image projection device together with the first command, so that the image projection device can project the digital information corresponding to the viewer’s response, thereby receiving the The effect of audience interaction. Furthermore, the audience can use the second mobile communication device to read the projected digital information, thereby generating an augmented reality image that matches the interactive effect at the time, thereby enhancing the audience's motivation to watch the advertisement.

[0064] See Figure 4 , Figure 4 It is a schematic diagram showing an information playing system 4 according to another specific embodiment of the present invention. Such as Figure 4 As shown, the augmented reality system 4 of this embodiment includes a remote server 40, a digital information input device 42, at least one first mobile communication device 44, at least one image display screen 46, a trigger input unit 41, and a second mobile communication device. Device 43, wherein the remote server 40 and the digital information input device 42 are connected to each other, the remote server 40 can communicate with the first mobile communication device 44, and the image display screen 46 communicates with the first mobile communication device 44 to trigger The input unit 41 is located in the first mobile communication device 44 and can communicate with the second mobile communication device 43.

[0065] Similarly, in this embodiment, the digital information input device 42 can be used to input digital information S to the remote server 40, and at least one first mobile communication device 44 can receive the digital information S from the remote server 40, respectively. The first mobile communication device 44 may be respectively provided with a first mobile application program to control the first mobile communication device 44 to receive the digital information S and transmit the digital information S and a first command. The image display screen 46 can receive the first command and the digital information S sent by the corresponding first mobile communication device 44, and play the digital information S according to the first command. The second mobile communication device 43 is provided with a second mobile application program to control the display unit of the second mobile communication device 43 to display augmented reality images according to the second instruction received by the self-trigger input unit 41. The aforementioned augmented reality images can be obtained by communicating with the first mobile communication device 44, the image display screen 46, or the remote server 40.

[0066] In this specific embodiment, the remote server 40, the digital information input device 42, the first mobile communication device 44, the trigger input unit 44, and the second mobile communication device 43 of the information playback system 4 all correspond to those of the foregoing specific embodiment. The units are basically the same in function and type, so I will not repeat them here. In practice, the image display screen 46 can be an LED sign, an OLED sign, an LCD sign, a mobile phone with a display panel, a computer, or a TV. It can be installed in indoor spaces, outdoor squares, inside or on the surface of cars, motorcycle surfaces, and bicycles. On the surface, the surface of the aircraft or the surface of the wearable object, in order to receive the effect of advertising everywhere.

[0067] In practice, the first mobile communication device 44 can also be connected to the image display screen 46 to form a smart device. For example, the image display screen 46 can be installed on a car, and this car also provides a connection module for the first mobile communication device 44 to be installed on it and connected to the image display screen 46, and the whole form a self-receiving and playback Smart car with digital information or advertising information.

[0068] In another specific embodiment, the above-mentioned information playing system 4 may further include at least one receiving device 48 connected to each image display screen 46 respectively. The receiving device 48 can communicate with the first mobile communication device 44 to obtain the digital information S and the first instruction from the first mobile communication device 44, and transmit the digital information S and the first instruction to the corresponding image display screen 46 for playback. In practice, the receiving device 48 can communicate with the first mobile communication device 44 through any wireless signal transmission technology.

[0069] In another specific embodiment, the trigger input unit 41 may also be located in the image display screen 46 or the receiving device 48, or connected to the above-mentioned device through an external connection, thereby communicating with the second mobile communication device 43 and transmitting the second command For the second mobile communication device 43, the described technology and architecture are substantially the same in function and type as the corresponding unit of the foregoing specific embodiment, so it will not be repeated here.

[0070] See Figure 5 , Figure 5 It is a schematic diagram showing an augmented reality system 5 according to another specific embodiment of the present invention. Such as Figure 5 As shown, the augmented reality system 5 of this embodiment includes a remote server 50, a digital information input device 52, at least one first mobile communication device 54, at least one image display screen 56, a trigger input unit 51, and a second mobile communication device. 装置53。 Device 53. The remote server 50 and the digital information input device 52 are connected to each other, so that a user or an advertisement provider can input digital information S to the remote server 50 through the digital information input device 52. The remote server 50 can communicate with the first mobile communication device 54, the image display screen 56 can communicate with the first mobile communication device 54 and the remote server 50, and the trigger input device 51 is installed on the first mobile communication device 54 Inside, and can communicate with the second mobile communication device 53.

[0071] The difference between this specific embodiment and the previous specific embodiment is that the first mobile communication device 54 in this specific embodiment receives the first information S1 from the remote server, and the first mobile application in the first mobile communication device 54 The program sends a first command to the corresponding image display screen 56 according to the first information S1. Then, the image display screen 56 directly requests and receives the digital information S from the remote server 50 according to the first command, and then according to the first command A command to play the received digital information S. That is, this specific embodiment is different from the above specific embodiment in that the first mobile communication device 54 only sends the first command to the image display screen 56, and the image display screen 56 directly obtains the digital information S from the remote server 50.

[0072] In summary, the augmented reality system of the present invention can input digital information to a remote server through a digital information input device, and the first mobile communication device can receive digital information from the remote server and control the image display screen or load The image projection device on the tool makes its image display on the screen or broadcast digital information near the vehicle. The second mobile communication device can be triggered by the remote server, the first mobile communication device, the image display screen or the image projection device The input unit receives an instruction to trigger the augmented reality image. Therefore, advertisers or advertising agencies can easily enter advertisements, and users of the first mobile communication device can also remotely control the image projection device or image display screen on the vehicle through the first mobile communication device to play advertisements anytime and anywhere , The user of the second mobile communication device can use the settings of the advertiser, advertising agency, or user of the first mobile communication device to watch the advertisement or trigger the augmented reality image at a specific time and place, thereby driving the second The users of mobile communication devices have better driving power to watch advertisement images or go to the business locations that advertisers want to promote or notify them of the sales time, so as to receive good advertising benefits and reduce advertising costs.

[0073] Through the detailed description of the above preferred specific embodiments, it is hoped that the features and concepts of the present invention can be described more clearly, and the scope of the present invention is not limited by the preferred specific embodiments disclosed above. On the contrary, the purpose is to cover various changes and equivalent arrangements within the scope of the claims of the present invention.