Augmented reality interaction information display method and device, equipment and medium

Abstract

The invention discloses an augmented reality interaction information display method and device, equipment and a medium, and relates to the technical field of vehicle-mounted interconnection, and the method comprises the steps: obtaining augmented reality information and vehicle driving information, obtaining an augmented reality delivery point according to the augmented reality information, obtaining the current position of a vehicle according to the vehicle driving information, and displaying the augmented reality delivery point; and performing projection display on the augmented reality information according to the augmented reality projection point and the current position of the vehicle. Dynamic and position-sensitive augmented reality interaction display is realized through the vehicle position, the driving experience is improved, and the user interaction is enhanced.

Description

Technical Field

[0001] The present invention relates to the field of vehicle-mounted interconnection technology, and in particular to an augmented reality interactive information display method, device, equipment and medium. Background Art

[0002] With the rapid development of science and technology, especially the continuous progress of mobile Internet, Internet of Things and augmented reality (AR) technology, the automotive industry is undergoing a technological revolution. Modern cars are not only a means of transportation, but also a highly intelligent and networked mobile terminal. Users' expectations for cars are no longer limited to basic driving functions, but they pursue a richer, more interactive and personalized driving experience. In this context, augmented reality technology, with its unique interactive mode and immersive experience, has become an important means to enhance the user experience of cars.

[0003] At present, there have been some attempts in the automotive industry to apply augmented reality technology to vehicle navigation, maintenance guidance, entertainment interaction, etc. The front camera of the vehicle captures the real road scene, and superimposes navigation information such as turn instructions and road signs on the real scene image to provide an intuitive navigation experience. Use AR technology to provide real-time maintenance guidance for automobile maintenance personnel, and display the internal structure of the car through virtual images to assist maintenance work. Integrate AR games or interactive applications in the vehicle information system to provide users with an entertainment experience.

[0004] Although existing technologies have made some progress, there are still obvious shortcomings. Existing AR applications lack real-time interactivity, and the interaction between users and the system is mostly one-way, lacking immediate feedback and deep participation. Most AR content is preset, lacks personalization and customization, and cannot meet the diverse needs of users. The application form is relatively single, mostly information display or simple interaction, lacks innovation and appeal, and easily makes users feel tired. Therefore, there is an urgent need for a richer, more interactive and personalized interaction method to improve user experience. Summary of the invention

[0005] The main purpose of this application is to provide an augmented reality interactive information display method, device, equipment and medium, aiming to solve the technical problem of how to improve user experience.

[0006] To achieve the above objectives, the present application proposes an augmented reality interactive information display method, the method comprising:

[0007] Obtain augmented reality information and vehicle driving information;

[0008] Obtaining an augmented reality delivery point according to the augmented reality information, wherein the augmented reality delivery point is a location where the augmented reality information is triggered;

[0009] According to the vehicle driving information, the current position of the vehicle is obtained;

[0010] The augmented reality information is projected and displayed according to the augmented reality projection point and the current position of the vehicle.

[0011] In one embodiment, the step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle includes:

[0012] According to the augmented reality information, animation effects, voice responses, video playback and vibration feedback of interactive behaviors are obtained;

[0013] When the current position of the vehicle reaches a preset range of the augmented reality information delivery point, the animation effect, the voice response, the video playback and the vibration feedback are sent to the vehicle-mounted device for projection display;

[0014] The step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle further includes:

[0015] Get marketing and operation information of augmented reality information;

[0016] According to the marketing operation and maintenance information, obtain preferential activities, brand characteristics and user evaluations;

[0017] When the current position of the vehicle reaches a preset range of the augmented reality information delivery point, the preferential activities, the brand characteristics and the user evaluations are sent to the vehicle-mounted device for projection display.

[0018] In one embodiment, the step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle further includes:

[0019] Get vehicle time information;

[0020] When the vehicle time information does not exceed the preset display time period and the vehicle's current position reaches the preset range of the augmented reality information delivery point, the augmented reality information is sent for projection display;

[0021] When the vehicle time information exceeds the preset display time period, the augmented reality information is stopped from being sent to the vehicle-mounted device for projection display.

[0022] In one embodiment, the step of obtaining an augmented reality delivery point according to the augmented reality information includes:

[0023] According to the augmented reality information, the geographical location information of the delivery is obtained;

[0024] By parsing the delivery geographical location information, longitude and latitude data and related geographical markers are obtained;

[0025] An augmented reality delivery point is obtained according to the latitude and longitude data and the relevant geographic markers.

[0026] In one embodiment, after the step of obtaining the augmented reality delivery point according to the augmented reality information, the following steps are included:

[0027] Obtaining real-time traffic status and estimating vehicle arrival time based on the vehicle driving information;

[0028] The augmented reality delivery point is adjusted in real time by optimizing the delivery point optimization algorithm according to the real-time traffic status and the estimated vehicle arrival time.

[0029] In one embodiment, after the step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle, the following steps are included:

[0030] Obtain environmental parameter information and user driving habit parameters;

[0031] Obtaining a delivery distance difference according to the augmented reality delivery point and the current position of the vehicle;

[0032] Calculate according to the delivery distance difference, the environmental parameter information and the user driving habit parameter to obtain a scaling ratio and a viewing angle adjustment parameter;

[0033] The projection image of the augmented reality information is dynamically adjusted according to the zoom ratio and the viewing angle adjustment parameter.

[0034] In one embodiment, before the step of acquiring augmented reality information and vehicle driving information, the following steps are included:

[0035] Obtaining user configuration information, wherein the user configuration information includes a displayed 3D model, interactive animation effects, location, and time;

[0036] The user configuration information is uploaded to the cloud for sorting to obtain ranking information.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes an augmented reality interactive information display device, the augmented reality interactive information display device comprising:

[0038] An acquisition module, used to acquire augmented reality information and vehicle driving information;

[0039] The acquisition module is further used to obtain an augmented reality delivery point according to the augmented reality information, wherein the augmented reality delivery point is a location where the augmented reality information is triggered;

[0040] The acquisition module is further used to obtain the current position of the vehicle according to the vehicle driving information;

[0041] The sending module is used to project and display the augmented reality information according to the augmented reality delivery point and the current position of the vehicle.

[0042] In addition, to achieve the above-mentioned purpose, the present application also proposes a medium, which is a computer-readable medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the augmented reality interactive information display method described above are implemented.

[0043] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the augmented reality interactive information display method as described above.

[0044] This application obtains augmented reality information and vehicle driving information, obtains augmented reality projection points based on the augmented reality information, obtains the current position of the vehicle based on the vehicle driving information, and projects the augmented reality information based on the augmented reality projection points and the current position of the vehicle. The dynamic and position-sensitive augmented reality interactive display is realized through the vehicle position, which improves the driving experience and enhances user interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0046] Figure 1 This is a flowchart of the first embodiment of the method for displaying augmented reality interactive information of the present application;

[0047] Figure 2 This is a flow chart of the second embodiment of the method for displaying augmented reality interactive information of the present application;

[0048] Figure 3 This is a schematic diagram of the module structure of the augmented reality interactive information display device according to an embodiment of the present application;

[0049] Figure 4 A schematic diagram of the device structure of the hardware operating environment involved in the method for displaying interactive information in augmented reality in an embodiment of the present application;

[0050] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0052] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0053] The main solution of the embodiment of the present application is: obtain coordinate information of multiple sensors, obtain multiple time frame information based on the multiple coordinate information, perform calculations based on the multiple time frame information to obtain multiple Hausdorff distances, perform outlier judgment based on the multiple Hausdorff distances, and obtain target fusion results.

[0054] Based on this, the present application embodiment provides an augmented reality interactive information display method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the augmented reality interactive information display method of the present application.

[0055] In this embodiment, the augmented reality interactive information display method includes steps S10 to S40:

[0056] Step S10, acquiring augmented reality information and vehicle driving information.

[0057] It should be noted that the acquisition of augmented reality information and vehicle driving information is the key to realizing the technical solution of the present invention. When the marketing and operation team puts marketing, discounts, points, activities, entertainment and other augmented reality information in a specific geographical location, the system needs to control the display timing of this information through accurate latitude and longitude information and time period information.

[0058] The system first obtains the vehicle's driving information through integrated sensors and external data sources, including but not limited to speed, direction, location (through positioning systems such as GPS) and surrounding environment information. At the same time, the system will also obtain preset augmented reality information, which may include marketing content, navigation prompts, entertainment elements or other data related to the vehicle's location. Through advanced data processing and analysis technology, the system can integrate this information to achieve dynamic expansion and personalized customization of content. When the vehicle travels to a specific geographical location or meets certain conditions, the system will automatically trigger the display of related content according to the preset augmented reality information delivery strategy. For example, when the vehicle approaches a commercial area, the system may display relevant promotional information or coupons on the vehicle's head-up display (HUD) or central control screen.

[0059] Furthermore, the system intelligently adjusts the content and method of display according to the driving status of the vehicle and the user's historical behavior to provide a richer and more personalized user experience. Before the display, the user configuration information is obtained, which includes the displayed 3D model, interactive animation effects, location, and time; the user configuration information is uploaded to the cloud for sorting to obtain ranking information.

[0060] Furthermore, the system provides a user interface that allows users to customize and configure augmented reality (AR) experiences, including selecting 3D models to be displayed, designing interactive animation effects, setting specific locations for information display, and scheduling display times. Users can easily select 3D models from the model library or upload custom models through intuitive configuration tools. At the same time, users can use the built-in animation editor to create or select preset animation effects to enhance the dynamics and interactivity of the AR experience. The location and time information set by the user makes the display of AR content more personalized and scenario-based. For example, users can set specific AR content to be displayed in specific geographic locations, such as near home or in a coffee shop they often visit. Time settings allow users to choose to display AR content at a specific time of day or on a specific date, which provides flexibility for marketing campaigns or personal reminders.

[0061] Once the user completes the configuration, the system will upload this information to the cloud server. In the cloud, the system will sort the user's configured information according to a certain algorithm, which may be based on the user's interaction frequency, the popularity of the content, or other user-defined criteria. After sorting, the system generates ranking information, which not only provides a competition mechanism for users to motivate them to create more attractive AR experiences, but also displays the most popular content to users based on the ranking, thereby increasing user engagement and content exposure. In addition, the introduction of ranking information provides a new dimension for community interaction and content sharing. Users can see the popularity of their AR configurations in the global or local community, which inspires them to continuously optimize and innovate their AR experiences. This ecosystem based on user-generated content not only enriches the diversity of AR experiences, but also promotes communication and creative sharing among users, bringing vitality to the entire community. At the same time, this also provides new marketing opportunities for advertisers and brands, who can combine their content with high-ranking AR experiences through sponsorship or cooperation to achieve more effective promotion effects.

[0062] Step S20, obtaining an augmented reality delivery point according to the augmented reality information, where the augmented reality delivery point is a location where the augmented reality information is triggered.

[0063] It should be noted that AR drop points are key geographic locations that define the specific places where users interact with AR content. These drop points can be static, such as a famous landmark or commercial area, or dynamic, such as specific points on the user's driving path. The system accurately calculates the location of the drop points by analyzing the geographic tags and trigger conditions in the AR information. When the user's device, such as a smartphone or in-vehicle system, detects that it is approaching these preset drop points, the relevant AR content will be automatically triggered. These contents include historical reenactments, virtual tour guides, game elements, advertising, etc., which are superimposed on the real world in the form of graphics, video or audio through the user's device, providing users with rich information and immersive experience.

[0064] Further, based on the augmented reality information, the geographical location information for delivery is obtained, and by parsing the geographical location information for delivery, the longitude and latitude data and related geographical tags are obtained, and the augmented reality delivery points are obtained based on the longitude and latitude data and related geographical tags. The longitude and latitude data and geographical tags together define the specific delivery location of the augmented reality content in the real world. The system parses the longitude and latitude data and geographical tags through an advanced geographic information system (GIS) to extract precise geographic coordinates and related geographical tags, such as building names, street names, or descriptions of specific places. Using these longitude and latitude data and geographical tags, the system is able to create a detailed geographic database that is used to store and manage all potential augmented reality delivery points. When the user moves near these delivery points, the system uses the device's GPS or other positioning technology to determine the user's specific location and match it with the delivery points in the database. Once the match is successful, the corresponding augmented reality content will be triggered and displayed through the user's device in a visual, auditory or other sensory form.

[0065] Furthermore, the real-time traffic status and estimated vehicle arrival time are obtained based on the vehicle driving information; the delivery point optimization algorithm is used to optimize the delivery point based on the real-time traffic status and the estimated vehicle arrival time, and the augmented reality delivery point is adjusted in real time. The system further optimizes the delivery strategy based on the complexity of the delivery location information, such as terrain features, traffic conditions, or user behavior patterns. For example, in a commercial area with dense traffic, the system will adjust the order or frequency of content display to avoid information overload. In historical sites or museums, the system will dynamically adjust the display of augmented reality content based on the user's tour route and stay time to provide a richer and more coherent experience.

[0066] The setting of AR drop points not only enhances the user's perception of reality, but also provides merchants and content creators with new ways to interact with users. For example, retailers can set up drop points near their stores, and when users enter this area, special offers or product information will be displayed on their devices. In addition, cultural relics can set up drop points at key points to show tourists historical scenes and explanations, thereby enhancing educational and entertainment value.

[0067] In order to optimize the user experience, the system can also dynamically adjust the content and display methods of the placement points according to the user's behavior and preferences. By collecting data on the user's interaction with the placement points, the system can learn the user's interests and provide more personalized content.

[0068] Step S30, obtaining the current position of the vehicle according to the vehicle driving information.

[0069] It is important to understand that the vehicle's real-time location information is accurately captured and updated in real time through the vehicle's onboard GPS system, sensors, and advanced data processing algorithms. This information includes not only the vehicle's longitude and latitude coordinates, but also multi-dimensional data such as the vehicle's speed, direction, acceleration, and possible traffic conditions. Using vehicle driving information, the system can provide drivers with highly customized navigation assistance and augmented reality experiences. For example, when the vehicle approaches a specific drop-off point, such as a restaurant, store, or tourist attraction, the system triggers related augmented reality content, such as virtual signs, user reviews, promotional information, etc., which are directly superimposed in the driver's field of view. The display of this information not only enhances the driving experience, but also provides an innovative marketing channel for local businesses.

[0070] In addition, the data of the vehicle's current location can also be used for social sharing and fleet management. For example, car owners can share their real-time location with friends or family, or achieve more efficient coordination and communication during fleet driving. The system can also provide personalized entertainment content based on vehicle location data, such as recommending music or videos based on the cultural characteristics of the area where the vehicle is located.

[0071] To further enhance the user experience, the system can also combine weather forecasts, road conditions and driver preferences to intelligently recommend driving routes and itinerary planning. In autonomous driving mode, the vehicle's current location data is the basis for autonomous navigation and decision-making. Through continuous learning and optimization, the system can predict the driver's needs, prepare and adjust the vehicle's settings in advance, and achieve a truly intelligent driving experience.

[0072] Step S40, projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle.

[0073] It should be noted that when the vehicle enters the preset drop point range, the system uses on-board equipment, such as HUD or the vehicle's central control screen, to accurately superimpose virtual information on the real scene outside the vehicle. This projection display includes not only visual elements such as 3D models, images and animations, but also audio prompts or tactile feedback to enhance the user's perceptual experience.

[0074] It should be understood that, according to the augmented reality information, the animation effect, voice response, video playback and vibration feedback of the interactive behavior are obtained. When the current position of the vehicle reaches the preset range of the augmented reality information delivery point, the animation effect, voice response, video playback and vibration feedback are sent to the vehicle-mounted device for projection display. The interactive design of augmented reality information is intended to provide an immersive user experience and enhance the user's perception and participation through multiple sensory stimulations. The system can trigger the corresponding animation effect, voice response, video playback and vibration feedback according to the preset interactive behavior in the augmented reality information. These interactive elements work together to create a multi-dimensional interactive experience, making the display of virtual information more vivid and interesting. When the vehicle enters the preset delivery range of the augmented reality information, the vehicle-mounted device will automatically activate these interactive elements. The animation effect is displayed on the vehicle screen to attract the user's attention in a visual form; the voice response provides auditory information through the vehicle audio system to guide the user's operation or provide additional information; the video playback can display more detailed content, such as product introduction or usage tutorial; and the vibration feedback is transmitted through the seat or steering wheel to simulate the touch of the real world and enhance the user's immersion.

[0075] Further, the contents of the augmented reality information projection include marketing activities, preferential information, points rewards or entertainment content. Obtain the marketing operation and maintenance information of the augmented reality information; obtain preferential activities, brand characteristics and user evaluations according to the marketing operation and maintenance information; when the current position of the vehicle reaches the preset range of the augmented reality information delivery point, send the preferential activities, brand characteristics and user evaluations to the vehicle-mounted device for projection display. By analyzing and processing the marketing operation and maintenance data in the augmented reality information in real time, customized marketing content can be accurately provided to users. This includes extracting current preferential activities, such as seasonal discounts, limited-time promotions or member-only discounts, directly related to the geographical location where the vehicle is about to arrive. At the same time, the system will also display the core features of the relevant brands, such as unique design concepts, technological innovations or environmental protection characteristics, as well as aggregated user evaluations, to provide users with references for purchasing decisions. When the vehicle approaches the preset augmented reality information delivery point, the information is intuitively displayed to the driver in the form of augmented reality through the vehicle-mounted device. For example, when the vehicle approaches a restaurant, the vehicle screen may display the restaurant's specially recommended dishes, customer evaluations and current discount information. This timely display of information not only attracts customers' attention, but also provides valuable information at the critical moment when they make decisions.

[0076] Further, environmental parameter information and user driving habit parameters are obtained; the delivery distance difference is obtained according to the augmented reality delivery point and the current position of the vehicle; the scaling ratio and the viewing angle adjustment parameters are calculated according to the delivery distance difference, environmental parameter information and user driving habit parameters; the projection image of the augmented reality information is dynamically adjusted according to the scaling ratio and the viewing angle adjustment parameters. After obtaining environmental parameter information, such as weather conditions, lighting conditions and user driving habit parameters, such as average driving speed and common route preferences, the system calculates the distance difference between the augmented reality delivery point and the current position of the vehicle. Based on this difference, combined with the current environmental parameters, for example, on cloudy days or at night, the brightness and contrast of the augmented reality image need to be increased to ensure visibility, and the user's driving habits, for example, for users who often drive fast, the size of the augmented reality information needs to be adjusted faster to ensure that the information is noticed within the optimal observation time, the system can calculate the appropriate scaling ratio and viewing angle adjustment parameters. These parameters are used to dynamically adjust the projection image of the augmented reality information to ensure that when the vehicle approaches the delivery point, the virtual information can be presented to the user in the most suitable way, neither too small to be difficult to perceive, nor too large to affect driving safety. For example, a virtual coupon icon may appear in the middle of the road in front of the user's vehicle. As the vehicle approaches the delivery point, the size of the 3D model will adjust accordingly to give the user a more realistic visual experience. When the user drives past the location or clicks on the virtual information on the screen, the augmented reality interaction is triggered. At this time, the in-vehicle system will inform the user that the information has been successfully obtained through voice broadcast, video animation or vibration feedback. In order to ensure a realistic augmented reality effect on the user's vehicle display, the system contains detailed 3D model data. These data include not only the basic properties of the virtual object such as three-dimensional shape, texture, color, but also advanced properties such as light and shadow effects, transparency, and animation details to enhance the realism of the virtual object.

[0077] This embodiment provides an augmented reality interactive information display method, which obtains augmented reality information and vehicle driving information, obtains augmented reality projection points according to the augmented reality information, obtains the current position of the vehicle according to the vehicle driving information, and projects the augmented reality information according to the augmented reality projection points and the current position of the vehicle. Dynamic and position-sensitive augmented reality interactive display is achieved through the vehicle position, which improves the driving experience and enhances user interaction.

[0078] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can refer to the above introduction, and will not be repeated later. Figure 2 The augmented reality interactive information display method step S40 also includes steps S401 to S403:

[0079] Step S401, obtaining vehicle time information.

[0080] It should be noted that when the vehicle is started or driving, the vehicle system will regularly obtain the latest augmented reality interactive information released by the car manufacturer's marketing and operation team from the cloud server. This information contains a specific display time period, and the augmented reality information will only be activated and displayed to the user during the specified time period. The system obtains the current time information of the vehicle and compares it with the time period set for the augmented reality information. If the current time is within the time period for information display and the vehicle's location is close to the delivery point, the on-board display module will start to display the augmented reality interactive information. For example, if the marketing and operation team plans to hold an event on a weekend afternoon, the augmented reality information of the relevant event will only be triggered during this time period. This ensures the freshness of the information and avoids the display of information during inactive times. It also helps control the timeliness of the information and ensures that the information obtained by users is always the latest and relevant.

[0081] Step S402: When the vehicle time information does not exceed the preset display time period and the vehicle's current position reaches within the preset range of the augmented reality information delivery point, the augmented reality information is sent for projection display.

[0082] It should be understood that when the vehicle's time information is within the preset display time period and the vehicle's current position enters the preset range of the augmented reality information delivery point, the system will automatically trigger the augmented reality information to be sent to the vehicle display module for projection display. This means that as long as the vehicle is in the correct time and space conditions, that is, the time is correct and the vehicle is close to the delivery point, the augmented reality interactive information will appear. For example, suppose the marketing and operation team sets up augmented reality information at the entrance of a city park between 2 and 4 pm on a certain day. When the user's vehicle approaches the park entrance during this time period, and the system detects that the distance between the vehicle's position and the preset delivery point is less than a certain range (such as 50 meters), the augmented reality information will appear on the vehicle's central control screen or other display screen.

[0083] Step S403: when the vehicle time information exceeds the preset display time period, the augmented reality information is stopped from being sent to the vehicle-mounted device for projection display.

[0084] It should be understood that when the vehicle's time information exceeds the preset display time period, the system will automatically stop sending augmented reality information to the vehicle-mounted device for projection display. This means that even if the vehicle is within the preset range of the augmented reality information delivery point, if the current time has exceeded the set display time period for the information, the vehicle display module will not display the augmented reality information. For example, if the marketing and operation team sets the augmented reality information of a specific activity to be displayed only between 2pm and 4pm every day, then when the user drives close to the delivery point at 7pm, although the vehicle's location meets the conditions, the system will not trigger the display of any augmented reality information because the time has exceeded the set time period.

[0085] This design not only ensures accurate delivery of information, but also dynamically adjusts the size and position of virtual objects according to the actual position of the vehicle, allowing users to experience a more realistic and immersive augmented reality effect as they approach the delivery point.

[0086] This embodiment obtains vehicle time information. When the vehicle time information does not exceed the preset display time period and the vehicle's current position reaches the preset range of the augmented reality information delivery point, the augmented reality information is sent for projection display. When the vehicle time information exceeds the preset display time period, the augmented reality information is stopped from being sent to the vehicle-mounted device for projection display. AR information is accurately delivered according to the control period to improve user experience and information management efficiency.

[0087] This application also provides an augmented reality interactive information display device, please refer to Figure 3 , the device comprises:

[0088] The acquisition module 10 is used to acquire augmented reality information and vehicle driving information.

[0089] The acquisition module 10 is further used to obtain an augmented reality delivery point according to the augmented reality information, where the augmented reality delivery point is a location where the augmented reality information is triggered.

[0090] The acquisition module 10 is also used to obtain the current position of the vehicle according to the vehicle driving information.

[0091] The sending module 20 is used to project and display the augmented reality information according to the augmented reality delivery point and the current position of the vehicle.

[0092] The augmented reality interactive information display device provided by the present application adopts the augmented reality interactive information display method in the above-mentioned embodiment, which can solve the technical problem of how to improve the user experience. Compared with the prior art, the beneficial effects of the augmented reality interactive information display device provided by the present application are the same as the beneficial effects of the augmented reality interactive information display method provided by the above-mentioned embodiment, and the other technical features in the augmented reality interactive information display device are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.

[0093] In one embodiment, the acquisition module 10 is also used to obtain animation effects, voice responses, video playback and vibration feedback of interactive behaviors based on augmented reality information; when the current position of the vehicle reaches within the preset range of the augmented reality information delivery point, the animation effects, voice responses, video playback and vibration feedback are sent to the vehicle-mounted device for projection display.

[0094] In one embodiment, the acquisition module 10 is also used to obtain marketing and operation information of the augmented reality information; based on the marketing and operation information, preferential activities, brand characteristics and user evaluations are obtained; when the current position of the vehicle reaches the preset range of the augmented reality information delivery point, preferential activities, brand characteristics and user evaluations are sent to the vehicle-mounted device for projection display.

[0095] In one embodiment, the sending module 20 is also used to obtain vehicle time information; when the vehicle time information does not exceed the preset display time period and the current position of the vehicle reaches the preset range of the augmented reality information delivery point, the augmented reality information is sent for projection display; when the vehicle time information exceeds the preset display time period, the augmented reality information is stopped from being sent to the vehicle-mounted device for projection display.

[0096] In one embodiment, the sending module 20 is further used to obtain the delivery geographical location information based on the augmented reality information; obtain the longitude and latitude data and related geographical markers by parsing the delivery geographical location information; and obtain the augmented reality delivery point based on the longitude and latitude data and related geographical markers.

[0097] In one embodiment, the sending module 20 is also used to obtain the real-time traffic status and the estimated vehicle arrival time according to the vehicle driving information; optimize the delivery point optimization algorithm according to the real-time traffic status and the estimated vehicle arrival time, and adjust the augmented reality delivery point in real time.

[0098] In one embodiment, the sending module 20 is also used to obtain environmental parameter information and user driving habit parameters; obtain the delivery distance difference according to the augmented reality delivery point and the current position of the vehicle; calculate according to the delivery distance difference, the environmental parameter information and the user driving habit parameters to obtain the scaling ratio and the viewing angle adjustment parameters; dynamically adjust the projection image of the augmented reality information according to the scaling ratio and the viewing angle adjustment parameters.

[0099] In one embodiment, the sending module 20 is also used to obtain user configuration information, which includes the displayed 3D model, interactive animation effects, location, and time; and upload the user configuration information to the cloud for sorting to obtain ranking information.

[0100] The present application provides an augmented reality interactive information display device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the augmented reality interactive information display method in the above-mentioned embodiment one.

[0101] Reference below Figure 4 , which shows a schematic diagram of the structure of an augmented reality interactive information display device suitable for implementing the embodiment of the present application. The augmented reality interactive information display device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4 The augmented reality interactive information display device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0102] like Figure 4As shown, the augmented reality interactive information display device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the augmented reality interactive information display device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 can allow the augmented reality interactive information display device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an augmented reality interactive information display device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0103] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0104] The augmented reality interactive information display device provided by the present application adopts the augmented reality interactive information display method in the above embodiment, which can solve the technical problem of how to improve the user experience. Compared with the prior art, the beneficial effects of the augmented reality interactive information display device provided by the present application are the same as the beneficial effects of the augmented reality interactive information display method provided by the above embodiment, and the other technical features in the augmented reality interactive information display device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0105] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0106] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0107] The present application provides a computer-readable medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the augmented reality interactive information display method in the above-mentioned embodiment.

[0108] The computer-readable medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0109] The computer-readable medium may be included in the augmented reality interactive information display device; or may exist independently without being assembled into the augmented reality interactive information display device.

[0110] The computer-readable medium carries one or more programs. When the one or more programs are executed by the augmented reality interactive information display device, the augmented reality interactive information display device can write computer program codes for performing the operations of the present application in one or more programming languages ​​or a combination thereof. The programming languages ​​include object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0111] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0113] The readable medium provided in this application is a computer-readable medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned augmented reality interactive information display method, and can solve the technical problem of how to improve user experience. Compared with the prior art, the beneficial effects of the computer-readable medium provided in this application are the same as the beneficial effects of the augmented reality interactive information display method provided in the above-mentioned embodiment, and will not be repeated here.

[0114] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned augmented reality interactive information display method when executed by a processor.

[0115] The computer program product provided in this application can solve the technical problem of how to improve user experience. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the augmented reality interactive information display method provided in the above embodiment, which will not be repeated here.

[0116] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for displaying interactive information in augmented reality, characterized in that: The method comprises: Obtain augmented reality information and vehicle driving information; Obtaining an augmented reality delivery point according to the augmented reality information, wherein the augmented reality delivery point is a location where the augmented reality information is triggered; According to the vehicle driving information, the current position of the vehicle is obtained; The augmented reality information is projected and displayed according to the augmented reality projection point and the current position of the vehicle.

2. The method according to claim 1, characterized in that The step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle includes: According to the augmented reality information, animation effects, voice responses, video playback and vibration feedback of interactive behaviors are obtained; When the current position of the vehicle reaches a preset range of the augmented reality information delivery point, the animation effect, the voice response, the video playback and the vibration feedback are sent to the vehicle-mounted device for projection display; The step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle further includes: Get marketing and operation information of augmented reality information; According to the marketing operation and maintenance information, obtain preferential activities, brand characteristics and user evaluations; When the current position of the vehicle reaches a preset range of the augmented reality information delivery point, the preferential activities, the brand characteristics and the user evaluations are sent to the vehicle-mounted device for projection display.

3. The method according to claim 1, characterized in that The step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle further includes: Get vehicle time information; When the vehicle time information does not exceed the preset display time period and the vehicle's current position reaches the preset range of the augmented reality information delivery point, the augmented reality information is sent for projection display; When the vehicle time information exceeds the preset display time period, the augmented reality information is stopped from being sent to the vehicle-mounted device for projection display.

4. The method according to claim 1, characterized in that The step of obtaining an augmented reality delivery point according to the augmented reality information includes: According to the augmented reality information, the geographical location information of the delivery is obtained; By parsing the delivery geographical location information, longitude and latitude data and related geographical markers are obtained; An augmented reality delivery point is obtained according to the latitude and longitude data and the relevant geographic markers.

5. The method according to claim 1, characterized in that After the step of obtaining the augmented reality delivery point according to the augmented reality information, the method further comprises: Obtaining real-time traffic status and estimating vehicle arrival time based on the vehicle driving information; The augmented reality delivery point is adjusted in real time by optimizing the delivery point optimization algorithm according to the real-time traffic status and the estimated vehicle arrival time.

6. The method according to claim 1, characterized in that After the step of projecting and displaying the augmented reality information according to the augmented reality projection point and the current position of the vehicle, the method further comprises: Obtain environmental parameter information and user driving habit parameters; Obtaining a delivery distance difference according to the augmented reality delivery point and the current position of the vehicle; Calculate according to the delivery distance difference, the environmental parameter information and the user driving habit parameter to obtain a scaling ratio and a viewing angle adjustment parameter; The projection image of the augmented reality information is dynamically adjusted according to the zoom ratio and the viewing angle adjustment parameter.

7. The method according to claim 1, characterized in that Before the step of acquiring augmented reality information and vehicle driving information, the method includes: Obtaining user configuration information, wherein the user configuration information includes a displayed 3D model, interactive animation effects, location, and time; The user configuration information is uploaded to the cloud for sorting to obtain ranking information.

8. An augmented reality interactive information display device, characterized in that: The device comprises: An acquisition module, used to acquire augmented reality information and vehicle driving information; The acquisition module is further used to obtain an augmented reality delivery point according to the augmented reality information, wherein the augmented reality delivery point is a location where the augmented reality information is triggered; The acquisition module is further used to obtain the current position of the vehicle according to the vehicle driving information; The sending module is used to project and display the augmented reality information according to the augmented reality delivery point and the current position of the vehicle.

9. An augmented reality interactive information display device, characterized in that: The device includes: a memory, a processor, and an augmented reality interactive information display program stored in the memory and executable on the processor, wherein the augmented reality interactive information display program is configured to implement the steps of the augmented reality interactive information display method according to any one of claims 1 to 7.

10. A medium, characterized in that An augmented reality interactive information display program is stored on the medium, and when the augmented reality interactive information display program is executed by the processor, the steps of the augmented reality interactive information display method according to any one of claims 1 to 7 are implemented.

Images