Recording route playback on augmented reality heads-up display applications

Abstract

A method for replaying route data with annotations for redisplay, comprising: recording a recorded route replay by a first user of a first motor vehicle and saving the recorded route replay to a website; selecting a playback of the recorded route replay by a second user of a second motor vehicle and entering a predetermined keyword by the second user to trigger playback; contacting the website and downloading GPS marker pictures of a predetermined next trip distance of travel of the second motor vehicle from the website; and retrieving one of the GPS marker pictures when a GPS trigger location is reached during a trip of the second motor vehicle and displaying the one of the GPS marker pictures on an image screen of a heads-up display of the second motor vehicle.

Description

Technical Field

[0001] This disclosure relates to recording the route of a motor vehicle in a replayable and annotated manner. Background Technology

[0002] In vehicle camera systems, existing map applications provide precise location of known points of interest. Sometimes, explorations undertaken during a vehicle journey to a destination are worth sharing with family and friends, or valuable to retain for reuse when repeating the journey. Known route recording and sharing applications allow users to record and share routes taken during a vehicle journey with others; however, these applications lack the ability to annotate images by other users and to reproduce them in a format available to a second vehicle.

[0003] Therefore, while current vehicle cameras and route recording systems have achieved their intended purpose, new and improved camera-based recording systems are still needed. Summary of the Invention

[0004] According to several aspects, a system for recording and re-displaying routes with real-time annotations includes a first motor vehicle having a camera system. A first imaging display device, defining a head-up display (HUD) or downward-facing display, is positioned within the first motor vehicle and receives camera imaging data from the camera system. The HUD or downward-facing display includes a video display screen presenting the camera imaging data. A first microphone array receives audio data from a first user of the first motor vehicle. Recorded route replays are created by adding user input from the first user of the first motor vehicle, the user input including the audio data; after activating recording of the camera imaging data, the recorded route replay identifies specific coordinates or locations along the travel route traveled by the first motor vehicle, including the audio data. A website receives the recorded route replays uploaded from the first motor vehicle and saves the recorded route replays for subsequent download to the second motor vehicle after initiating an operation on the second motor vehicle.

[0005] In another aspect of this disclosure, coordinates generated by a Global Positioning System (GPS) are added to the recorded route replay, the GPS-generated coordinates identifying the location of the point of interest identified by the user of the first motor vehicle.

[0006] In another aspect of this disclosure, a second user of the second motor vehicle enters a keyword to initiate the download of the recorded route replay to the second motor vehicle.

[0007] In another aspect of this disclosure, a second imaging display device, which defines a head-up display (HUD) or a downward-facing display and is positioned within the second motor vehicle, is used to replay the recorded route playback.

[0008] In another aspect of this disclosure, the microphone array receives voice data from a second user of the second motor vehicle.

[0009] In another aspect of this disclosure, the image screen of the augmented reality HUD or the downward-facing display of the second motor vehicle presents the route previously used by the first motor vehicle and the route that the second motor vehicle is now traveling.

[0010] In another aspect of this disclosure, the second user provides evaluation input to the recorded route replay.

[0011] In another aspect of this disclosure, after the second motor vehicle completes its second route, a prompt is provided to the second user requesting the second user to update the data of the recorded route replay.

[0012] In another aspect of this disclosure, the second user speaks a predefined keyword to activate audio recording at any location along the second route of travel in the second motor vehicle.

[0013] In another aspect of this disclosure, coordinates generated by the Global Positioning System (GPS) are added to the recorded route replay to identify the location of a point of interest identified by the first user of the first motor vehicle.

[0014] According to several aspects, a method for replaying annotated route data for re-display includes: recording the route replay by a first user of a first motor vehicle and saving the recorded route replay to a website; selecting a playback trigger for the recorded route replay by a second user of a second motor vehicle and having the second user enter a predetermined keyword to trigger the playback; contacting the website and downloading GPS marker images for a predetermined next trip distance of the second motor vehicle from the website; and when the second motor vehicle reaches a GPS trigger location during its trip, retrieving one of the GPS marker images and displaying one of the GPS marker images on the image screen of a head-up display of the second motor vehicle.

[0015] In another aspect of this disclosure, the method further includes: displaying a navigation arrow on an augmented reality HUD or downward-facing display of the second motor vehicle, the navigation arrow indicating a direction of travel suggested by the first user to the second motor vehicle.

[0016] In another aspect of this disclosure, the method further includes: presenting a message on an augmented reality HUD or downward-facing display of the second motor vehicle, the message defining at least one of the first user's suggestions for food, sightseeing spots, and negative reviews provided by the first user during the recording of the recorded route replay.

[0017] In another aspect of this disclosure, the method further includes: sharing the recorded route replay via a mobile application of the second user's cellular phone to input it into the second motor vehicle.

[0018] In another aspect of this disclosure, the method further includes: providing option information to the second user via synthesized speech after the second user selects to replay the recorded route and enters the keyword; and identifying the type of interest to be replayed via the user's voice in the second motor vehicle.

[0019] In another aspect of this disclosure, the method further includes: downloading data from the website as a replay of the recorded route before reaching the GPS coordinates, and discarding the data after the replay is complete.

[0020] In another aspect of this disclosure, the method further includes: adding user comments to the content of the recorded route replay; and assigning priority sorting values ​​to the user comments to be displayed.

[0021] According to several aspects, a method for replaying annotated route data for re-display includes: generating a recorded route replay using a map generated by a Global Positioning System (GPS), the GPS-generated map identifying a route taken by a first motor vehicle belonging to a first user; contacting a website and transmitting the recorded route replay from the website to a second motor vehicle; continuously applying a set of GPS coordinate data to the recorded route replay to define the current position of the second motor vehicle; adding audio data, including sound data input by a second user, to the recorded route replay such that the recorded route replay identifies specific coordinates or positions along the route traveled by the second motor vehicle; and displaying the recorded route replay to a second user of the second motor vehicle using an augmented reality head-up display (HUD) or downward-facing display of the second motor vehicle.

[0022] In another aspect of this disclosure, the method further includes: initiating the start of the recording route replay when the first keyword is received from the second user.

[0023] In another aspect of this disclosure, the method further includes: initiating operation of the microphone array of the second motor vehicle to receive and record voice data of the second user; and annotating the recorded route playback to add GPS location and the voice data from the microphone array.

[0024] Further areas of application will become apparent from the description provided herein. It should be understood that the descriptions and specific examples are for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description

[0025] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way.

[0026] Figure 1 This is a left-side front view of a motor vehicle having a route recording and playback system according to an exemplary aspect;

[0027] Figure 2 It is facing Figure 1 The end front view viewed from the head-up display of a motor vehicle;

[0028] Figure 3 It is for use Figure 1 Flowcharts of the three operational stages of the system;

[0029] Figure 4 It is oriented towards use Figure 1 The end front view viewed from the head-up display of the second vehicle in the system;

[0030] Figure 5 It is used for operation Figure 1 A flowchart of the system's method steps;

[0031] Figure 6 Is Figure 1 A data log table recorded and saved during the exemplary operation of the system;

[0032] Figure 7 Is using Figure 1 A front view of a street food stall captured by the system's camera;

[0033] Figure 8 Is using Figure 1 A front view of a street food stall captured by the system's camera;

[0034] Figure 9 Is using Figure 1 The system's camera captures a front view of a roadside vegetable stall; and

[0035] Figure 10 Is using Figure 1A front view of the parking area of ​​a roadside shopping store, captured by the system's camera. Detailed Implementation

[0036] The following description is merely exemplary in nature and is not intended to limit this disclosure, application, or use.

[0037] refer to Figure 1 A recorded route playback system 10 is provided in a first motor vehicle 12 having one or more camera systems. The camera system, which may define a first forward-facing camera module 14, may be positioned in a rearview mirror housing 16 within the passenger compartment of the first motor vehicle 12. An alternative camera location for a second forward-facing camera module 18 may be in the front grille 20 of the first motor vehicle 12. Other locations on or within the first motor vehicle 12 may also be selected for the camera system or the forward-facing camera module 14. The first forward-facing camera module 14 is described in more detail in the following discussion; however, this discussion also applies to the operation of the second forward-facing camera module 18 if it or other camera modules are used.

[0038] refer to Figure 2 And refer again Figure 1 ,refer to Figure 1 The camera system of the first forward-facing directional camera module 14 of the described, defined route playback system 10 generates camera imaging data and sends the camera imaging data to an imaging display device, such as a head-up display (HUD) 22 located within the first motor vehicle 12. The HUD 22 may be positioned on a forward-facing dashboard 24 and may include a video display screen 26 that presents camera imaging data in real-time or reproduced from pre-recorded image files described below. According to several aspects, the head-up display (HUD) 22 may be replaced by a downward-facing display, and further discussion of the head-up display (HUD) 22 herein also applies to downward-facing displays.

[0039] The camera imaging data created by the first front-facing directional camera module 14 and the recorded route playback system 10 provides for the integration of imaging data from the first front-facing directional camera module 14 with audio data received from the microphone array 28. When selected by a first user (e.g., operator or passenger) of the first motor vehicle 12, the audio data is in the form of the vehicle user's voice data. Imaging data can be recorded by selecting the recording command control 30, and the imaging data, along with the audio data, can be combined with an existing route recording application to add more information to the recorded route. The first user can create a recorded route playback 32 by adding personal input (including the first user's voice data) at specific coordinates or locations via the audio data. This personal input is added by activating the recording command control 30 and by activating the recording of the camera imaging data generated by the recording command control 30 on the front-facing camera module 14. The first user can then recall and replay the recorded route playback 32 and share it with other travelers or second users, making the second user feel as if the first user is traveling with them, thus making the journey more interesting for other travelers.

[0040] refer to Figure 3 And refer again Figure 1 and Figure 2 The route recording and playback system 10 can be operated in three periods or phases. These periods or phases include, in the first phase 34, creating a route recording and playback 32 using a GPS-generated map 36 that identifies the route 38 taken by the first motor vehicle 12. The route 38 may begin at a route start point 40 and end at a route end point 42. The route 38 represents one or more highways, roads, streets, bridges, tunnels, etc., located between the route start point 40 and the route end point 42. GPS coordinate data is continuously applied to identify the current position of the first motor vehicle 12 along the route 38, such that the GPS coordinate data is applied to any input made by the first user to the route recording and playback system 10.

[0041] Data from the limited recording route playback 32, along with camera imaging data from the first front-facing directional camera module 14 and sound data received from the microphone array 28, are forwarded to a controller 44 located within the first motor vehicle 12, stored in the memory of the controller 44, and can be used for future playback from the controller. According to several aspects, the controller 44 is a non-generalized electronic control device having a pre-programmed digital computer or processor, memory or non-transitory computer-readable medium for storing data (such as control logic, software applications, instructions, computer code, data, lookup tables, etc.), and transceivers or input / output ports. Computer-readable media includes any type of media accessible by a computer, such as read-only memory (ROM), random access memory (RAM), hard disk drive, compact disc (CD), digital video disc (DVD), or any other type of memory. Non-transitory computer-readable media does not include wired, wireless, optical, or other communication links that transmit transient electrical signals or other signals. Non-transitory computer-readable media includes media where data can be permanently stored and media where data can be stored and later overwritten (such as rewritable optical discs or erasable memory devices). Computer code includes any type of program code, including source code, object code, and executable code.

[0042] In the second phase 46, the data of the limited recorded route playback 32 can be shared with one or more other parties, including the second user of the second motor vehicle 48. Data sharing can be performed via data uploaded and downloaded from a cloud-based data system, a mobile application 50 on the second user's cellular phone, and then entered into the recorded route playback system 10 of the second motor vehicle 48. The data of the limited recorded route playback 32 can also be transmitted using a data transmission protocol such as V2V protocol 52. V2V protocol 52 is defined as "vehicle-to-vehicle" communication, which is an automotive technology that allows multiple vehicles to "talk" to each other. V2V communication defines a self-organizing network on the highway.

[0043] According to several aspects, the second vehicle 48 may also include its own head-up display similar to HUD 22 or a second HUD 56, which, as noted above, can be replaced by a downward-facing display for the same reasons. The second vehicle 48 also includes a second microphone in microphone array 28, which receives input (including second audio data, such as predefined keywords and audio commands) from a second user of the second vehicle 48, said input which can be used to further annotate recorded route playback 32.

[0044] In the third stage 54, after being imported into at least the second vehicle 48, the recorded route replay 32 is displayed on the second HUD 56 of the second vehicle 48. The image screen 58 of the second HUD 56 displays the route 38 previously taken by the first vehicle 12 and now being traveled by the second vehicle 48. The second HUD 56 may be displayed on the windshield 60 of the second vehicle 48 and may display navigation arrows 62 indicating suggested directions of travel for the second vehicle 48. Messages 64 may also be displayed on the second HUD 56, such as food suggestions, good sightseeing spots, or negative reviews provided by the first user of the first vehicle 12 during the recorded route replay 32.

[0045] refer to Figure 4 As the second vehicle 48 travels along route 38, the image screen 58 of the HUD 56 displays a highlighted portion 66 of route 38 that is about to proceed. As the second vehicle 48 encounters features identified by the first user of the first vehicle 12, multiple instructions may be presented. These instructions may include camera images (such as reference images). Figures 7 to 10 (The camera images shown and described) and symbol 68, which may be, for example, a negative report symbol indicating that, for example, an upcoming rest area, identified by rest area sign 70 and accessible via exit 72, may not be expected (indicated by negative message 74). Sufficient time is provided to the operator of the second vehicle 48 to determine whether exit 72 should be used to access the identified rest area and to follow any recommendations provided by the recorded route replay 32.

[0046] refer to Figure 5Flowchart 76 illustrates the steps of using the recorded route replay system 10. In system initiation step 78, the trip of the second vehicle 48 is initiated. In the subsequent trigger query 80, the user of the second vehicle 48 selects whether to trigger the playback of the recorded route replay 32 and enters a predetermined keyword 82 to trigger the playback. If the user selects "No" 84 and does not play the recorded route replay 32, the procedure returns to trigger query 80. If the user selects to play the recorded route replay 32 and enters the keyword 82, in option presentation step 86, the recorded route replay system 10 provides option information to the user via synthesized speech. Immediately following option presentation step 86, in selection step 88, the user of the second vehicle 48 identifies the type of interest they wish to replay via voice. Then, a contact step 90 is performed, in which the second vehicle 48 contacts website 92 and downloads GPS marker images of the predetermined next trip distance (e.g., the next quarter mile). When the GPS trigger location 94 is reached during the trip, the appropriate GPS marker image is retrieved and displayed on the image screen 58 of the HUD 56. The image screen may further include point of interest indexing.

[0047] Note that if more than one image is available, you can refer to the following: Figure 6 Further discussion assigns the highest display priority to the images and audio content with the highest user ranking. In priority query 96, the user of the second vehicle 48 can choose whether the information should be displayed in the previously assigned priority order. If the user selects Yes (YES) 98 to present the content in their priority order, in pause step 100, the currently presented lower-priority image is paused, and the higher-priority image is displayed on the image screen 58 of the HUD 56. If the user selects No (NO) 102 to not present the content in their priority order, then proceed to continue playback step 104. The program can periodically return to priority query 96 to query whether additional information should be displayed in the previously assigned priority order. After continue playback step 104 is completed, in prompt step 106, the route replay system 10 prompts the second user for any updates or comments expected. Examples of user comments could be typing a "like" or "dislike" symbol or adding statements such as "outdated" or "inappropriate." Seasonal updates can also be typed. After step 106 is completed, the route recording and replay system 10 sends a new comment to website 92. Using second user input, in ranking step 110, website 92 applies ranking input to rank the content's relevance and usefulness. At trip end step 112, the second vehicle 48 and the route recording and replay system 10 terminate their operation.

[0048] refer to Figure 6 And refer again Figure 5As mentioned above (refer to the reference) Figure 5 The discussion concerns the population of an exemplary data log 114 after a selection is made by either the first or second user. Data log 114 includes a timestamp field 116, a latitude field 118, a longitude field 120, a trigger field 122, an audio file status field 124, an image file status field 126, and a user rating field 128. Initially, data log 114 is created after the user selects to trigger playback of route replay 32 during a trigger query 80 and enters a predetermined keyword 82. Data log 114 includes items in a first data row 129, including a timestamp, current latitude, and current longitude. Trigger field 122, audio file status field 124, image file status field 126, and user rating field 128 are initially "0" or marked as "empty". At a second time, defined by a second data row 130, the timestamp, latitude, and longitude values ​​have changed, and a "1" is entered in trigger field 122, indicating that the user has selected to replay route replay 32. Type audio symbol 132 in the audio file status bar 124, type video symbol 134 in the image file status bar 126, and type user rating symbol 136 in the user rating bar 128. Afterward, you can add, change, or delete data from the data log 114.

[0049] Overall reference Figures 7 to 10 An exemplary point of interest for the user of the first motor vehicle 12 is displayed on the HUD 56 of the second motor vehicle 48. See details. Figure 7 The camera image 138, identified as an unnamed food stall 140 with, for example, food, will be saved and transmitted to the second vehicle 48. An audio recording providing additional information may also be played. According to several aspects, the unnamed food stall 140 includes: GPS coordinate data, which triggers the display of the unnamed food stall 140 on the image screen 58 of the HUD 56 as the second vehicle 48 approaches (this further triggers the playback of audio data); and any visual data, such as directional arrows, to help the user of the second vehicle locate the unnamed food stall 140.

[0050] refer to Figure 8 And refer again Figure 2 and Figure 3 It can save camera images 142 that are identified as having, for example, poor food quality at a snack stall 144, comment on them, and transmit them to a second vehicle 48. As previously noted, it can also play audio recordings that provide additional information and replay points of interest on the image screen 58 of the HUD 56.

[0051] refer to Figure 9 And refer again Figure 2 and Figure 3It is possible that camera images 146 of the fruit stand 148 on route 38, which the first user of the first vehicle 12 considers to have the best fruit prices, have been saved, commented on, and transmitted to the second vehicle 48 for playback. As previously noted, audio recordings providing additional information can also be played, and points of interest can be played back onto the image screen 58 of the HUD 56.

[0052] refer to Figure 10 It is possible that camera images 150 of roadside shops 152 along route 38, which are considered to have the best clothing prices, have been saved, commented on, and transmitted to a second vehicle 48 for playback. As previously noted, audio recordings providing additional information can also be played, and points of interest can be played back onto the image screen 58 of the HUD 56.

[0053] Continue to refer to Figures 7 to 10 The captured camera images 138, 142, 146, and 150 are further defined to highlight images 138, 142, 146, and 150. Image processing is performed during recording to identify potential objects of interest, such as an unnamed food stall 140. Audio processing is then performed to identify one or more keywords 82 and to associate audio content with objects of interest. The user then annotates the captured images with the added keywords 82. Augmented reality graphics, such as the highlighted images 138, 142, 146, and 150, are added based on predefined keywords and objects of interest. Then, the images are referenced. Figure 6 A column is added to the data log 114 to identify augmented reality graphics. User ratings, such as those defined by user rating symbol 136, can then be added to the data log 114 to identify another prominent feature for future use.

[0054] The recorded route playback system 10 disclosed herein includes audio input to allow users to verbally provide feedback. Users can activate the front-facing camera recording function at points of public interest or atypical points of interest. Audio and video recordings are annotated for playback by a second vehicle 48. Recorded route playback 32 is shared with other users and displayed on information displays or HUDs of other or second vehicles.

[0055] Regarding the controller 44 discussed above, the memory may include computer-readable media (also referred to as processor-readable media), which includes any non-transitory (e.g., tangible) medium involved in providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such media can take many forms, including but not limited to non-volatile and volatile media. Non-volatile media may include, for example, optical discs or magnetic disks and other permanent storage. Volatile media may include, for example, dynamic random access memory (DRAM), which typically constitutes main memory. Such instructions may be transmitted via one or more transmission media, including coaxial cables, copper wires, and optical fibers (including wires containing a system bus coupled to the processor of the electronic control unit (ECU). Common forms of computer-readable media include, for example, floppy disks, floppy hard disks, magnetic tapes, any other magnetic media, CD-ROMs, DVDs, any other optical media, punched cards, paper tapes, any other physical media with a perforated pattern, random access memory (RAM), PROMs, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), any other memory chip or cassette, or any other media that a computer can read.

[0056] The databases, data repositories, or other data stores described herein can include various mechanisms for storing, accessing, and retrieving a wide range of data, including hierarchical databases, a set of files in a file system, application databases in specialized formats, relational database management systems (RDBMS), etc. Each such data store is typically contained on a computing device employing a computer operating system (such as one of the aforementioned operating systems) and accessed via a network in any one or more of various ways. File systems can be accessed from the computer operating system and can include files stored in various formats. In addition to the languages ​​used to create, store, edit, and execute stored programs, RDBMS typically employs a structured query language (SQL), such as a procedural language extension of the structured query language (PL / SQL) described above.

[0057] In some examples, system elements may be implemented as computer-readable instructions (e.g., software) on one or more computing devices (e.g., servers, personal computers, etc.), and these computer-readable instructions may be stored on an associated computer-readable medium (e.g., disks, storage devices, etc.). A computer program product may include such instructions stored on a computer-readable medium for performing the functions described herein.

[0058] In this application (including the definitions below), the term "module" or "controller" may be replaced by the term "circuit". The term "module" may refer to, be part of, or include: application-specific integrated circuits (ASICs); digital, analog, or mixed-signal analog / digital discrete circuits; digital, analog, or mixed-signal analog / digital integrated circuits; combinational logic circuits; field-programmable gate arrays (FPGAs); processor circuitry (shared, dedicated, or grouped) that executes code; memory circuitry (shared, dedicated, or grouped) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or combinations of some or all of the above (such as in a system-on-a-chip).

[0059] A module may include one or more interface circuits. In some examples, the interface circuits may include wired or wireless interfaces connected to a local area network (LAN), the Internet, a wide area network (WAN), or a combination thereof. The functionality of any given module disclosed herein can be distributed among multiple modules connected via the interface circuits. For example, multiple modules can allow for load balancing. In another example, a server (also known as a remote or cloud) module may perform some functions on behalf of a client module.

[0060] Regarding the media, processes, systems, methods, heuristics, etc., described herein, it should be understood that although the steps of such processes, etc., have been described as occurring in a certain ordered sequence, such processes can be practiced with the described steps performed in an order other than that described herein. Furthermore, it should be understood that some steps may be performed simultaneously, other steps may be added, or some steps described herein may be omitted. In other words, the description of the processes herein is provided for the purpose of illustrating certain embodiments and should in no way be construed as limiting the claims.

[0061] Replay videos are user-selectable information types (e.g., friends, geography, and history) and are triggered by GPS. Data saved as a route replay 32 is downloaded from the website 92 just before the appropriate GPS coordinates and expires or is discarded after replay. User comments and ratings prioritize the content to be displayed. Business content, including fast food and gasoline advertisements, is allowed upon user request.

[0062] During information retrieval and display, annotated routes are imported from the cloud or website 92, and navigation arrows 62 are displayed on HUD 56. Recorded audio is played, images saved and retrieved from the cloud or website 92 are played, and one or more secondary users can add additional comments or content, which can be saved for further use and replay.

[0063] The system disclosed herein allows integration of a front-facing camera module 14 and a microphone array 28 with existing route recording applications to generate recorded route replays 32. Users can add personal input at one or more specific coordinates, which can be GPS coordinates or locations input via audio. The user can then activate image capture using the front-facing camera module 14. Users can further share the recorded route replay 32 with friends. Friends will feel as if the user is traveling with them, making the trip more enjoyable. Replays are achieved by downloading video / audio clips from a website and are triggered by keyword 82 or other methods, replaying at the relevant GPS coordinates. After the replay, users can further annotate and comment on the content, and users can select advertising content from businesses suitable for the current environment (such as, but not limited to, gasoline, restaurants, fast food businesses, etc.).

[0064] The recorded route playback system 10 disclosed herein offers several advantages. These advantages include playback of existing route recording applications integrated with annotations from the front-facing camera module 14 and microphone array 28. This integration enables playback of the recorded route playback 32 during any subsequent vehicle operation configured to download the recorded route playback 32. When shared with other users and displayed in augmented reality format, the recorded route with audio and video annotations also provides playback options to a second user, including evaluations of multiple points of interest and other similar data.

[0065] Therefore, it should be understood that the above description is intended to be illustrative and not restrictive. Many embodiments and applications, besides the examples provided, will be apparent to those skilled in the art upon reading the above description. The scope of this disclosure should not be determined by reference to the above description, but rather by reference to the appended claims and the full scope of their equivalents. Future developments are anticipated and expected to occur in the field discussed herein, and the disclosed systems and methods will be incorporated into such future embodiments. In conclusion, it should be understood that the invention is capable of modifications and variations and is limited only by the following claims.

[0066] The description in this disclosure is merely exemplary in nature, and any changes that do not depart from the spirit and scope of this disclosure are intended to fall within its scope. Such changes should not be considered as departing from the spirit and scope of this disclosure.

Claims

1. A system for recording and re-displaying routes with real-time annotations, comprising: The first motor vehicle equipped with a camera system; A first imaging display device, defining a head-up display (HUD) or a downward-facing display, is positioned inside the first motor vehicle and receives camera imaging data from the camera system, wherein the HUD or the downward-facing display has a video display screen that presents the camera imaging data. A first microphone array receives first voice data from the first user of the first motor vehicle; The recorded route playback is created by adding user input from the first user of the first motor vehicle, the user input including the first audio data. After activating the recording of the camera imaging data, the recorded route playback includes specific coordinates or positions along the travel route of the first motor vehicle and includes the first audio data. The website that receives and saves the recorded route replay, which is uploaded from the first motor vehicle; A second motor vehicle downloads and replays the recorded route from the website; as well as A second microphone array receives second voice data from the second user of the second motor vehicle while the second motor vehicle is traveling along the same route as the first motor vehicle. The recorded route playback is updated to include the second voice data of the second user associated with at least one specific coordinate or location of the route traveled by the first motor vehicle.

2. The system of claim 1, further comprising a second imaging display device, the second imaging display device defining a second HUD or downward-facing display positioned within the second motor vehicle, and presenting a replay of the recorded route.

3. The system of claim 2, further comprising an image screen of a second HUD or downward-facing display of the second motor vehicle, the image screen displaying a route previously used by the first motor vehicle and now used as a second route of travel for the second motor vehicle.

4. The system of claim 3, further comprising a plurality of GPS marker images stored in the recorded route replay, wherein, When the GPS trigger location is reached during the second travel route of the second motor vehicle, one of the GPS marker images is displayed on the image screen of the second HUD of the second motor vehicle.

5. The system of claim 1, further comprising a predefined keyword entered by a second user of the second motor vehicle to initiate a download of the recorded route onto the second motor vehicle.

6. The system of claim 5, further comprising a second microphone array for receiving second voice data of a second user of the second motor vehicle.

7. The system of claim 5, further comprising an evaluation input by the second user to the recorded route replay.

8. The system of claim 5 further includes a prompt provided to the second user after the second motor vehicle completes its second route, requesting the second user to update the data of the recorded route replay.

9. The system of claim 5, further comprising a predefined keyword spoken by the second user to activate audio recording at any location of the second motor vehicle along the second route of travel.

10. The system of claim 1, further comprising coordinates generated by a Global Positioning System (GPS), said coordinates being added to the recorded route replay and identifying points of interest identified by a first user of the first motor vehicle.

Images