Instrument panel icon verification

Abstract

An icon verification system for a vehicle display is disclosed herein. An icon verification system may verify correctness and observability of icons displayed on a background on a vehicle infotainment system. The icon verification system may use edge detection, matching, and statistical algorithms to check various criteria of the displayed icons to determine whether the displayed icons meet specified criteria. When a fault is found between the displayed icon and the check criteria, a corrective action may be taken to ensure that incorrect information is not displayed. This allows the infotainment system to display graphics in the background while displaying static or animated security icons on the background while maintaining continuity of the vehicle security icon display.

Description

[0001] Related Applications

[0002] This non-provisional patent application claims priority for all common subject matter to earlier filed U.S. Provisional Patent Application No. 63 / 407,965, filed on September 19, 2022 and entitled “CLUSTER ICONVALIDATION.” The identified earlier filed provisional patent application is hereby incorporated by reference in its entirety into this application. Technical Field

[0003] Some embodiments described herein relate to screen graphics and icon verification systems. Specifically, embodiments of the present disclosure relate to graphics and icon display and verification systems for vehicle infotainment systems. Background Art

[0004] A vehicle may include a display that presents an instrument panel that presents various information to the driver of the vehicle. For example, the instrument panel may present speed, revolutions per minute, fuel level, and other graphics and icons that indicate various information related to the operation or status of vehicle systems and components. For example, a vehicle display may present icons to warn or notify a user of system and component failures or errors. Some conventional displays present warnings on a rich graphical user interface on an opaque background, which may not blend in with other content presented on the user interface. Summary of the invention

[0005] An embodiment of the present disclosure provides a first embodiment for an icon verification system, which includes: a vehicle display associated with a vehicle, the vehicle display being configured to present graphics and icons indicating a status of the vehicle; a memory, the memory being configured to store a plurality of icons; and a processor, the processor being configured to detect an icon when overlaid on a graphic presented on the vehicle display, compare the detected icon with the plurality of icons, verify the icon for overlaying the displayed graphic based on the comparison, and present the verified icon overlaid on the graphic on the display.

[0006] The present invention summary is provided to introduce in simplified form a series of concepts further described in the detailed description section below. The present invention summary is neither intended to identify the key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Other aspects and advantages of the present disclosure will be clear from the following detailed description of the embodiments and the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings, in which:

[0008] Figure 1Describes an exemplary hardware system of an embodiment of the present disclosure;

[0009] Figure 2 An exemplary dashboard depicting some embodiments of the present disclosure;

[0010] Figure 3 Illustrate exemplary icon color display and background matching of some embodiments of the present disclosure;

[0011] Figure 4 Continuing with some embodiments of the present disclosure Figure 3 Example icon color display and background matching;

[0012] Figure 5 Depicting an exemplary background that results in low observability of the icon;

[0013] Figure 6 Depicting exemplary matching criteria of some embodiments;

[0014] Figure 7 Describing an exemplary method for authentication across secure and insecure environments;

[0015] Figure 8 An exemplary animation depicting some embodiments of the present disclosure;

[0016] Fig. 9A and 9B depicts an exemplary instrument panel and safety icon overlay;

[0017] Figures 10A to 10C An exemplary infotainment system for implementing embodiments of the present disclosure is depicted;

[0018] Fig.11 depicts an exemplary primary display;

[0019] Fig.12 depicts an exemplary auxiliary display;

[0020] Fig.13 depicts an exemplary auxiliary display including climate control;

[0021] Fig.14 depicts an exemplary auxiliary display; and

[0022] Fig.15 An exemplary supplemental display including load and trailer status is depicted.

[0023] The drawings do not limit the present disclosure to the specific embodiments disclosed and described herein. The drawings are not necessarily drawn to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. DETAILED DESCRIPTION

[0024] The following detailed description refers to the accompanying drawings, which illustrate specific embodiments in which the present disclosure may be practiced. The embodiments are intended to describe various aspects in sufficient detail to enable those skilled in the art to practice those embodiments of the present disclosure. Other embodiments may be utilized and may be modified without departing from the scope of the present disclosure. Thus, the following detailed description should not be construed as having a limiting meaning. The scope of the present disclosure is limited only by the appended claims and the full scope of equivalents to which such claims are entitled.

[0025] In this description, reference to "one embodiment," "an embodiment," or "multiple embodiments" means that one or more features mentioned are included in at least one embodiment of the present technology. Separate references to "one embodiment," "an embodiment," or "multiple embodiments" in this description do not necessarily refer to the same embodiment, and are not mutually exclusive, unless so stated and / or known to a person skilled in the art from this description. For example, features, structures, actions, etc. described in one embodiment may also be included in other embodiments, but are not necessarily included. Therefore, the present technology may include various combinations and / or integrations of the embodiments described herein.

[0026] Embodiments of the present disclosure relate to an automotive display in communication with at least one processor configured to utilize various techniques to present graphics and icons providing information related to the operation and / or status of vehicle systems and components. An icon display and verification system can provide accurate drawing graphics or icons within a digital instrument panel and verify the drawn content presented (and in some cases, to be presented) by the vehicle display.

[0027] In some embodiments, the icon display and verification system may store computer executable instructions for employing object detection and classification algorithms for detecting and classifying displayed graphics and icons. In addition, in some embodiments, the icon display and verification system may provide a matching algorithm and determine the amount of error between the data indicating the stored graphics and / or icons and the displayed graphics and / or icons to determine the likelihood of a match. Using the functionality described herein, the icon verification system may determine the shape and verify the observability of the icon relative to the background. This processing may verify whether the icons and graphics are displayed in accordance with any manufacturer and / or vehicle standards.

[0028] Figure 1The illustrated diagram represents an exemplary hardware platform of an embodiment of an icon and graphic display and verification system (icon verification system 100). Computer 102 can be any computer associated with or providing a vehicle dashboard, and / or a general or special computing device of any size specification. For the purpose of illustration, several components are depicted for computer 102. In some embodiments, certain components may be arranged differently or not exist. There may also be additional components. Included in computer 102 is a system bus 104, whereby other components of computer 102 can communicate with each other. In some embodiments, there may be multiple buses, or components can communicate directly with each other. Connected to system bus 104 is a central processing unit (CPU) 106. Also attached to system bus 104 is one or more random access memory (RAM) modules 108. Also attached to system bus 104 is a graphics card 110. In some embodiments, graphics card 110 may not be a physically separate card, but may be integrated into a motherboard or CPU 106. In some embodiments, graphics card 110 has a separate graphics processing unit (GPU) 112 that can be used for graphics processing or for general computing. The GPU 112 can provide graphics and icon generation and verification, as described in the following embodiments. Also on the graphics card 110 is a GPU memory 114. A display 116 for user interaction is connected (directly or indirectly) to the graphics card 110. In some embodiments, the display is not present, while in other embodiments, the display is integrated into the computer 102. In some embodiments, the display 116 is a vehicle display 200 ( Figure 2 ). Similarly, peripherals such as a keyboard 118 and a mouse 120 are connected to the system bus 104. In some embodiments, these peripherals can be linked for input and updating the icon verification system 100. Like the display 116, these peripherals can be integrated into the computer 102 or not present, and can be provided as input by the display 116. A local storage device 122 is also connected to the system bus 104, and the local storage device 122 can be any form of computer readable media and can be installed internally in the computer 102 or removably attached externally.

[0029] Computer-readable media include volatile and non-volatile media, removable and non-removable media, and database-readable media can be considered. For example, computer-readable media include (but are not limited to) RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital versatile disc (DVD), holographic media or other optical disk storage devices, cassettes, magnetic tapes, magnetic disk storage devices and other magnetic storage devices. These technologies can store non-temporary data temporarily or permanently. However, unless otherwise expressly provided, the term "computer-readable medium" should not be interpreted as including physical but temporary signal transmission forms, such as radio broadcasts, electrical signals through wires, or light pulses through fiber optic cables. Examples of stored information include computer-usable instructions, data structures, program modules, and other data representations. In particular, computer-readable media include non-temporary computer-readable media that store computer-executable instructions, which, when executed, cause one or more processors to perform operations.

[0030] Finally, a network interface card (NIC) 124 is also connected to the system bus 104 and allows the computer 102 to communicate over a network such as a local area network 126. The NIC 124 can be any form of network interface known in the art, such as Ethernet, ATM, fiber optic, Bluetooth, or Wi-Fi (i.e., the IEEE 802.11 family of standards). The NIC 124 connects the computer 102 to a local network 126, which can also include one or more other computers, such as computer 128, and network storage devices, such as data stores 130. In general, a data store such as data store 130 can be any repository that can store and retrieve information as needed. Examples of data stores include relational or object-oriented databases, spreadsheets, file systems, flat files, directory services such as LDAP and Active Directory, or email storage systems. Data stores can be accessed through complex APIs (e.g., structured query language), simple APIs that only provide read, write, and find operations, or any level of complexity in between. Some data stores can additionally provide management functions for the data sets stored therein, such as backup or version control. The data store may be local to a single computer such as computer 128, accessible on a local network such as local network 126, or remotely accessible through Internet 132. Local network 126, in turn, is connected to Internet 132, which connects many networks, such as local network 126, remote networks 134, or directly attached computers such as computer 136. In some embodiments, computer 102 itself may be directly connected to Internet 132.

[0031] The embodiments of the present disclosure relate to Figure 2 . In some embodiments, the vehicle display 200 may be a display 116, which may communicate with a processor (e.g., a CPU 106, a GPU 112, etc.), and in some embodiments, the processor may be a plurality of processors connected in communication. As described herein, the processor may include any or all processing components of the icon verification system 100 including the CPU 106 and the GPU 112. The processor may be configured to accurately present graphic icons that provide information related to the operation and / or status of vehicle systems and components. The icon verification system 100 may display an image within the digital instrument panel 202 by accurately drawing graphics or icons using the stored computer executable instructions described herein. In addition, the icon verification system 100 may run a verification algorithm for verifying displayed icons and drawn content and icons. In addition, the icon verification system 100 may verify the content to be displayed and verify the observability of the icon based on the contrast between the icon and the background of the digital instrument panel 202.

[0032] The icon verification system 100 can implement edge detection techniques for the presented graphics and icons and compare the results with the stored graphics and / or icons to perform a matching function to ensure that the expected graphics and icons are presented correctly. These processes can, for example, reduce the impact of static or dynamic content (e.g., blurred background images) on which the graphics and icons are presented. For example, various graphics and icons can be changed based on the color and shape of the icons and displayed graphics to make the icons highly visible or include a high observability factor.

[0033] like Figure 2 As shown in , digital instrument panel 202 may provide graphics such as safety icons 204, maps 206, engine speed 208, and speedometer 210. As described herein, digital instrument panel 202 may display additional graphics as instructed by the processor.

[0034] like Figure 3 As shown in , the icon verification system 100 can display the security icon 204 in various ways. For example, the first icon 302 is displayed with a solid color background and a flat icon, while the second icon 304 is displayed with a color gradient background and a flat image, and the third icon 306 is displayed with a color gradient and a shadow or a three-dimensional shadow icon. All three icons produce edge detection results 308 similar to those detected by the algorithms described herein. Here, the security icon 204 can be displayed with various backgrounds that provide high visibility and high detectability through the various edge detection algorithms described below.

[0035] In some embodiments, an edge detection algorithm compares regions of the digital instrument panel 202, such as pixels or elements of a display, and provides a probability that each region is part of a displayed graphic or part of a background. Larger and larger regions may be identified so that the entire outline or edge of a feature is determined with an associated probability. As shown in edge detection results 308, a driver with a seat belt and airbag is detected. Thus, the safety icon 204 may indicate that the driver is wearing a seat belt and the airbag is enabled. However, the safety icon 204 may present any icon type or icon design.

[0036] In some embodiments, the algorithm detects the shape of the entire icon and / or graphic, rather than each individual pixel. For example, an area containing the entire icon can be analyzed. Edge detection of the color contrast between the background and the icon can be used to detect the shape of the icon, rather than detecting and classifying each individual pixel. This detection process allows the icon verification system 100 to determine the entire shape of the security icon 204 so that it matches the stored icon shape. The algorithm can iteratively compare the detected shape with the stored shape to determine the error between the shapes. The stored icon with the minimum associated error can be a match with the security icon 204 with a corresponding possibility.

[0037] In some embodiments, the processor (e.g., CPU 106, GPU 112, etc.) can utilize various edge detection algorithms to extract information from the digital image displayed by the vehicle display 200. One common type of edge detection algorithm is the Sobel operator, which calculates the gradient magnitude of an image (e.g., safety icon 204) using a 3x3 kernel. The algorithm highlights edges by detecting changes in pixel intensity values ​​between adjacent pixels. Another type of edge detection algorithm is the Canny edge detector, which utilizes more complex processing involving signal processing techniques such as smoothing, gradient calculations, non-maximum suppression, and hysteresis thresholding. The Canny edge detector is known for its ability to accurately detect edges with low noise and high accuracy.

[0038] In addition to the Sobel operator and the Canny edge detector, the processor can also use the Gaussian Laplacian (LoG) algorithm for edge detection. The LoG algorithm is a multi-order process that applies a Gaussian filter to the image to smooth the noise and then applies a Laplacian filter to detect changes in pixel intensity. In addition, the processor can employ the Prewitt operator for edge detection. The Prewitt operator is similar to the Sobel operator in that it uses a 3x3 kernel to calculate the gradient magnitude of the image. However, the Prewitt operator uses a different kernel that places more emphasis on diagonal edges, resulting in a slightly different edge map than the Sobel operator. This algorithm is commonly used in applications such as corner detection and motion detection. In general, the choice of edge detection algorithm depends on the specific application and the desired accuracy and noise reduction level, and any edge detection algorithm is contemplated to be within the scope of the present disclosure.

[0039] In some embodiments, an error threshold may be applied to determine the observability of the security icon 204. For example, if the error is less than a threshold, it may be determined that the security icon 204 corresponds to a stored icon with a high probability. This may also indicate that the security icon 204 has high detectability and potentially high observability to the user. Similarly, or alternatively, if the error is greater than a threshold, the matching algorithm may not find a solution. Therefore, the detectability and observability may be low. When the detectability and / or observability are low, the security icon 204 may be replaced with the security icon overlay 902 ( Fig. 9B ). This process will be described in more detail below.

[0040] like Figure 3 As shown in , halo effects, lighting effects, and 3-dimensional effects have minimal impact on the accuracy and effectiveness of such techniques. Therefore, the techniques described in this article provide robust detection, classification, matching, and verification methods.

[0041] In some embodiments, Figure 4 As shown in , depending on the background 212 and any other factors, the icon verification system 100 can utilize different color combinations to make the graphics and icons stand out more, or be recognizable from the background 212. For example, the color contrast icon / background 402 can be red / black (first icon 406), red / yellow (second icon 408), red / green (third icon 410), or any other color combination. Here, the color combinations are represented by various grayscale gradients; however, any color combination can be used to show a clear difference between the background 212 and the security icon 204. The color combination can be selected by scanning the color gradient field, and any combination with the highest detectability and observability can be selected to display the security icon 204 and the background 212. The observability can be shown in the column 404 representing the security icon 204 detected with the color contrast 402.

[0042] The color variations and combinations may show a sharp contrast between the security icon 204 and the background 212, such that pixels displaying the security icon 204 are distinguishable from pixels displaying the background 212. This provides more accurate results when running the edge detection verification algorithm described above. Additionally, the high color contrast between the security icon 204 and the background 212 may again result in high detectability and observability when detecting shapes from the background in a selected area that includes the entire icon. Figure 4 As shown in , the icon verification system 100 can identify colors in a narrow portion of available colors, resulting in less contrast between colors, that may be appropriate based on the colors of other content presented on the display of the digital dashboard 202 .

[0043] Figure 5 An exemplary background 212 that results in a low observability factor is depicted. In some embodiments, the contrast of the colors can be determined by measuring the color of the background 212 and the color of the safety icon 204 shown using the contrasting icon / background color scheme 504. A threshold value can be compared to the determined contrast value to determine whether the contrast is large enough to allow or should change the color of the background 212 and / or the color of the safety icon 204. For example, the background 212 can be an animated movie or a changing graphic showing changing colors. The background 212 may have a color similar to the displayed graphics and / or the safety icon 204. Therefore, it may be difficult for the driver to see the safety icon 204. Compared to the threshold, the low contrast between the safety icon 204 and the background 212 can be measured as low observability. If the observability or contrast is below the threshold, the color of the safety icon 204 can be changed, or the safety icon 204 can be replaced with a safety icon overlay 902, as described in the following embodiments.

[0044] In some embodiments, as described above, the background 212 may be a changing graphic that the icon verification system 100 cannot control, such as a movie, television program, screen saver, dynamic picture, etc. Therefore, only the detection and observability of the security icon 204 may be utilized. Thus, if the background 212 is changing, there may be situations where the color of the background 212 may be significantly similar to the color of the security icon 204. In these situations, the security icon 204 may not be detectable and, therefore, may not be observable.

[0045] Figure 6Depicted is an exemplary verification criterion 602 for comparison between the color of an icon 204 and its background 212 by the icon verification system 100. The exemplary verification criterion 602 can be visualized as a projection in a two-dimensional color space, such as visualization 604. For example, the verification criterion 602 can include a constant distance 606 between the icon and the background color, a constant maximum color component 608, a common case of a constant sum 610 of the color components, an acceptable range 612 of values ​​between the constant sum 610 and the constant maximum component 608, and a scaling factor 614 that results in a high detection factor. All data associated with the various verification criteria can be stored and used to train future models when implementing results. The verification criteria can verify not only the size and shape of the icon, but also the coordinate position and the relative distance between the icons. In addition, common problems can be stored and specifically looked for when analyzing the detected icons, or common problems can be given a higher weight. In addition, the error data calculated when comparing the detected icon data with the stored features can be compared with a threshold to determine whether the displayed and detected icon is acceptable.

[0046] In some embodiments, the icon verification system 100 can utilize the secure environment 700 (e.g., the CPU 106) and the unsecure (non-secure) environment 702 (e.g., the GPU 112) to ensure that certain information expected to be presented on the digital dashboard 202 is in fact being presented. The icon verification system 100 can request the GPU 112 for the current state of the content to be included in each frame presented on the digital dashboard 202. The instructions sent by the CPU 106 can cause the GPU 112 to execute certain instructions and related commands to evaluate whether certain security-related graphics (icons) and information will be presented. For example, the CPU 106 can request the GPU 112 for the current state of the content to be presented in each frame on the digital dashboard 202 and the execution of a checksum of the graphics. The CPU 106 can use the information returned from the GPU 112 to verify the presentation of security-related graphics (icons) and information within each frame by comparing the received information with the expected values ​​stored in the memory.

[0047] like Figure 7As shown in , at step 706, the secure environment 702 (e.g., CPU 106) can generate a batch of processing requests and acceptance criteria, and send a batch of requests to the unsecure environment 704 (e.g., GPU 112), and store the expected results for each request as verification criteria in memory (e.g., RAM 108 or local storage device 122). As shown below, the secure environment 702 can create a batch of requests (e.g., 8 requests), which is a number selected for illustrative purposes. At step 708, the processor can store the expected value for each request in memory (different patterns and different colors for each type of request are used to illustrate the expected results for each request). In some embodiments, as shown in step 710, the processor can scramble (reorder) the batches before sending each batch to ensure that GPU 112 will respond to the latest request from the processor (rather than sending a cached response based on a previous batch query) because the order of the responses will change due to the scrambling. For example, various parameters of the request (e.g., order, offset, address, etc.) may be scrambled (reordered) at each iteration to ensure that the execution of GPU 112 and the return of the request from GPU 112 are not frozen (unchanged). In this example, the response to the scrambled request is expected to be, for example, CADABCDA

[0048] Processing the request may be done in an unsecure environment 704, such as GPU 112. At step 712, the processing request may be sent to the unsecure environment 704 for processing. At step 716, the processing request may be received by the unsecure environment, and at step 718, the request may be processed by standard processes of GPU 112. At step 720, the results of step 718 may be output and sent back to the secure environment 702 for evaluation.

[0049] At step 714, the processor (secure environment 702) stores the validation criteria until the unsecure environment 704 processes the request at step 718 and provides the result back to the secure environment 702 at step 720. At step 720, the processor receives a response including the processing result of the unsecure environment 704. The processor can store the response in the secure environment 702 in a memory and validate the response by applying the validation criteria stored in the memory for each request at step 722. The validation criteria can be any function of one or more responses. For example, the function can evaluate whether one or more values ​​are below a threshold, above a threshold, or within a predetermined range.

[0050] In some embodiments, the evaluation of certain responses may be conditional on the values ​​of other responses. For example, if the first response is above a predetermined threshold, it is determined whether the checksum provided in the second response is equal to the stored reference checksum. In this example, as shown in step 720, the response is CADABADA. When compared with the expected result of CADABCDA above, the processor is caused to confirm that 7 of the batch of 8 requests meet expectations. For the sixth response that does not match the expected response stored in the memory (i.e., the response is A instead of C), in step 724, the processor will generate a fault for the response.

[0051] In some embodiments, the processor may evaluate the failure based on one or more failure conditions. For example, several results, such as error counters, may be accumulated to check whether the accumulated error counter is above or below a stored error threshold. Similarly, for animation, only one (or more) of the multiple reference frames and the checksum of each reference frame should match the frame (or frames) being presented on the vehicle display 200.

[0052] like Figure 8 As shown in , animation 800 is a series of graphics presented sequentially to present a moving illustration of a safety warning (e.g., safety icon 204) or safety information. As shown in sequential frames (first frame 802 and second frame 804), the driver is leaning toward the airbag, indicating that an accident has occurred. The safety icon 204 shows that the airbag is active. Thus, in the event of an accident, the airbag will be deployed.

[0053] When a fault in the security icon 204 is detected as described above, the icon verification system 100 can take corrective actions or other safety measures. For example, the icon verification system 100 can send instructions to draw a known and opaque icon at a specific location in each frame while the fault persists. Similarly, the icon verification system 100 can force the display to shut down so as not to display any incorrect information.

[0054] The type, number, and order of requests may be determined and selected by the processor based on one or more safety analyses, such as a Failure Modes and Effects Analysis (FMEA) process, that covers all possible failures that may occur in the unsafe environment 704. For example, the order of requests for each batch of requests may be changed based on the type or format of the individual responses to each batch of queries to ensure that the responses received from GPU 112 are for the most recent request, rather than for a previous batch of queries.

[0055] Fig. 9AAn exemplary safety warning icon (e.g., safety icon 204) of a vehicle display 200 is depicted. The vehicle display 200 may present a rich graphical user interface including various content presented to the driver (e.g., a map 206 containing navigation information, infotainment information, entertainment content, etc.) that may cause safety warnings (icons) and / or safety information not to be presented to the driver, or may make the perception of the presented safety warnings (icons) and / or safety information difficult to perceive. The techniques disclosed herein enable a vehicle system to confirm that such safety warnings (icons) and / or safety information are being presented to the driver and are being presented in a manner that adequately informs the driver. For example, in some embodiments, the vehicle display 200 may be configured to present entertainment content (e.g., a movie or music video, an audio visualizer, etc.) to the driver during an autonomous driving condition, and the icon verification system 100 may implement the disclosed techniques to present safety warnings (e.g., safety icon 204) and / or safety information over such entertainment content in a manner that adequately informs the driver of any problems. In embodiments, certain entertainment content may need to be stored in memory for limited use (e.g., retrieval for presentation purposes only) in a manner that limits access to the processor and GPU 112. For such limitations, the techniques disclosed herein enable the icon verification system 100 to generate and send a batch of requests related to content to be presented on the vehicle display 200 in an unsecure (non-secure) environment (such as the GPU 112) to ensure presentation of security-related graphics (icons) and information as intended by the icon verification system 100 while complying with any restrictions applicable to the storage, access, and use of entertainment content.

[0056] Fig. 9A The example shown in illustratively illustrates a background 212 being presented behind a security icon 204. In this case, the background 212 may be any of the graphics described above. The background 212 may be animated, changing color and shape, such as a movie or motion picture. The security icon 204 may be displayed because the analysis described above may determine that the security icon 204 is visible and detectable and has no faults (or includes faults below a minimum error threshold) as described above. Alternatively, as described above, Fig. 9B As shown in , the background 212 may provide a conflict with the security icon 204. Therefore, in order not to display incorrect information, the security icon 204 can be replaced by the security icon overlay 902.

[0057] Thus, the icon verification system 100 can ensure that the vehicle display 200 presents safety warnings (icons) and / or safety information on the rich graphical user interface, on other content presented on the user interface, by generating and sending a batch of requests to the GPU 112, generating expected criteria (e.g., values, predetermined ranges of expected results, conditions for evaluating certain responses, etc.) and storing them in a processor-accessible memory, evaluating various possible failures in the GPU 112 based on failure analysis such as failure mode and effects analysis (FMEA) in the functional safety development process, such as possible corruption of the GPU memory 114 (a checksum can confirm that such an event has not occurred), computational failures, or data transmission errors, verifying the responses by comparing each response to the expected results (verification criteria) stored in the memory, and taking corrective actions based on which request is unexpected or after a threshold number of failures is exceeded. Fig. 9B As shown in , the background 212 is presented between the persistent content (top-level content that cannot be obscured by other content) and other content presented on the vehicle display 200 to demonstrate that the presentation of safety-related graphics (icons) and information is presented by the GPU 112 as expected by the processor (e.g., CPU 106).

[0058] Example Environment

[0059] The following text sets forth an example environment in which the display features described herein may be implemented. However, it should be understood that this description is to be construed as exemplary only, and does not describe every possible embodiment, as it would be impractical to describe every possible embodiment. In view of the teachings and disclosures herein, numerous alternative embodiments may be implemented.

[0060] Vehicles that may include components of the described system include, but are not limited to, automobiles, trucks, buses, two-wheeled motor vehicles, aircraft, boats and other watercraft, and any mobile structure capable of transporting large quantities of materials to one or more geographic locations.

[0061] Various implementations of the system provide a comprehensive solution that simplifies the interface of the vehicle while adding greater depth to the content available in the vehicle. The system acts as an intermediary between the vehicle operator, the vehicle, and the remote system. The system described herein can be communicatively coupled to the icon verification system 100. For example, in some configurations, two or more large electronic display panels are coupled to the vehicle dashboard to present various information to the vehicle operator. The display panels discussed herein (e.g., the main display panel 1002, the auxiliary display panel 1004, the supplementary display panel 1006) can be or can include a vehicle display 200 for implementing the above-disclosed embodiments. One or more displays can be touch screens to facilitate operator input. In addition, it should be emphasized that when used in this description and the appended claims to indicate included features, elements, or steps, the term input should never be interpreted as excluding the use of input controls independent of the touch screen. In some embodiments, input controls coupled to the steering wheel or the center console, armrest, or support trim of the vehicle can be used to provide operator input. In some embodiments, the input control can include a touch screen.

[0062] like Figures 10A to 10C As shown in FIG, a vehicle infotainment system 1000 ("system") may include two or more independent display panels (e.g., a primary display panel 1002, an auxiliary display panel 1004, and a supplemental display panel 1006) that are sized to be mounted on a dashboard 1008 or other location in the cab. The dashboard 1008 may be primarily flush against the front of the cab, have a portion that protrudes from the front of the cab, is curved to provide optimal accessibility to the vehicle operator and passengers, or is separate from a portion located above the windshield.

[0063] The system can be configured in a variety of ways to maximize accessibility and facilitate visibility of the display panel within the vehicle cab. In some embodiments, the display panel is mounted or can be adjusted to be positioned within the operator's arm's length to provide touch input. The display panel can be mounted in other areas of the cab, such as the cab berth area, for use when the vehicle is stationary and / or in motion. In some configurations, the content of the individual display panels can be merged into a single display panel. The single display panel will also be mounted within the operator's arm's length. In some embodiments, the system can be configured to mount the display panel externally or use a portable electronic device to transmit the content of the display panel.

[0064] The system may use one or more subsystems to provide functionality to assist the vehicle operator in operating the vehicle and / or manage services related to the operation of the vehicle. In some embodiments, these subsystems may be automatically activated if the system determines that certain conditions exist. For example, if the system determines that the operator's visibility may be limited (e.g., nighttime, fog, heavy precipitation, etc.), one or more subsystems may be activated.

[0065] The system transmits information to and receives information from the operator in a seamless and efficient manner. In some embodiments, the system uses two or more display panels to transmit information to the operator and uses an interface for the operator to input control commands to manage the elements controlled by the system.

[0066] The system is capable of receiving information and / or control commands from the vehicle operator, wireless data broadcasts, and remote servers. The interface between the system and the vehicle operator may use buttons, touch-sensitive display panels using infrared (IR), resistive or capacitive technology, universal serial bus (USB) devices, external keyboards, audible communications including automatic speech recognition (ASR) capabilities, open wireless technologies for exchanging data with fixed and mobile communication devices over short distances (including but not limited to analog radio frequency (RF), personal area networks (i.e., Bluetooth, infrared (IR) wireless, ultra-wideband (UWB), ZigBee, etc.), and wireless local area networks (i.e., IEEE 802.11ac ... 802.11) to provide operator input control commands. Methods for the system to receive information using wireless data broadcasts may include standardized or proprietary signal broadcasts from broadcast towers and base stations installed at fixed or mobile locations. For example, the system may include a transceiver capable of sending and receiving communication signals of a Citizen Band (CB) radio. The system may use a CB radio base station installed at a fixed location to communicate CB radio signals with operators and passengers riding in other vehicles or by individuals. In some embodiments, the system can receive wireless data broadcasts from a warehouse that broadcasts low-power signals to vehicles visiting the warehouse to pick up and / or unload loads. Methods for the system to receive information from a remote server include long-range and short-range wireless networks, including but not limited to frequency modulation (FM), orbital and land-based satellites, cellular telephone networks, and other wireless methods (e.g., Wi-Fi (IEEE 802.11)). 802.11), Bluetooth, infrared (IR) wireless, ultra-wideband (UWB), ZigBee, etc.). For example, the system may include one or more radio modules for receiving and transmitting signals for wireless data broadcasting and communications with remote devices. In one embodiment, the system includes a cellular transceiver for transmitting and transmitting data to and from one or more remote servers. In one implementation, the cellular transceiver is a GSM modem. The GSM modem can be coupled to an external cellular antenna connected to the rear of the system. In some implementations, the system may include an integrated antenna to eliminate the need for a bulky and difficult to install external antenna. For example, the GSM antenna can be integrated into the GSM modem, which in turn can be placed toward the front of the system (e.g., within or near a panel of the system to enable cellular reception).

[0067] The system is intended to provide information, routes, and dispatch guidance based on the vehicle's current location, fuel, and materials being transported using the vehicle. Dispatch guidance may include optimal stopover points based on the number of hours the operator has operated the vehicle. If the operator is limited by a maximum number of hours that the vehicle can be operated, the dispatch guidance may include the number of hours the vehicle has been operated and the number of hours available to operate the vehicle. In some embodiments, a location determination component is used to determine the vehicle's current location. If the system determines that the vehicle's current location requires adjustment of one or more elements, the system may automatically adjust. For example, if the system determines that the vehicle has crossed a border from a country that uses the metric system into a country that uses another measurement system (such as the U.S. customary measurement system that uses inches and miles), legal requirements and customs may be automatically adjusted. The system will automatically adjust the navigation system, instrumentation (i.e., the units used to measure the vehicle's speed), and driving and load regulations of the country the vehicle is entering.

[0068] The display panel may include a main display panel 1002, an auxiliary display panel 1004, and one or more supplemental display panels 1006. Depending on the type of vehicle, the display panel may be located on the dashboard 1008, on a console mounted on the floor of the vehicle cab, above the vehicle windshield, in the vehicle cab berth, below the dashboard, completely or partially on the cab floor panel, or outside the cab. In some embodiments, the display panel may be adjusted to move or tilt from a mounted position to any position. For example, a display panel mounted in the dashboard 1008 may be moved closer to or further away from the vehicle operator, tilted 360 degrees or any other position to allow the operator to access its content.

[0069] The display panel can provide the function of presenting content with high-resolution images while allowing the user to input control commands. The display panel can visually present content using a liquid crystal display (LCD), a light-emitting diode (LED) display, a plasma display panel (PDP), a holographic or other electronic visual display method. The display panel can provide user input by using a touch screen using infrared (IR), resistive, capacitive or other touch sensing technology.

[0070] like Figures 10A to 10C As shown in , some configurations of the system may use any combination of the main display panel 1002, the auxiliary display panel 1004, and one or more supplemental display panels 1006 (if any). For example, the auxiliary display panel 1004 may be placed next to, below, integrated with, or on the opposite side of the windshield from the main display panel 1002. The main display panel 1002 may be located so that all of its contents can be seen by the vehicle operator in the cab. Figures 10A to 10C As shown in , in some cases, the main display panel 1002 can be located directly in front of the steering wheel.

[0071] The main display panel 1002 may be used to convey current vehicle instrument readings and highly important information to the vehicle operator. The system provides functionality for the vehicle operator or a third party to customize the content of the main display panel 1002. For example, the content of the main display panel 1002 may be customized to include optional instrument readings that the vehicle operator selects to be presented in addition to the default and / or legally required instruments in the instrument panel.

[0072] Fig.11 The main display panel 1002 illustrated in the figure may also include one or more high-resolution information center displays 1102. The information center display 1102 provides flexibility in display output for the system. In some embodiments, the information center display 1102 is used to interchangeably present all new and / or existing content that is not currently presented on other parts of the main display panel 1002 or other display panels.

[0073] Auxiliary display panel 1004 can be used to present instrumentation, information, and entertainment content. The presented content can be stored and / or originated locally or remotely.

[0074] like Figure 12 to Figure 15 As shown in , the auxiliary display panel 1004 can be mainly used to provide an interface mode for the vehicle operator to enter control commands to manage navigation, messaging, audio, climate control, trailer information, driver data, diagnostics and weather interface modes. In some embodiments, two or more interface modes can be available on the auxiliary display panel 1004 at the same time.

[0075] One or more supplemental display panels 1006 may be used to provide additional system flexibility. One or more supplemental display panels 1006 may present the same content as the primary display panel 1002 and the auxiliary display panel 1004. Fig. 10A and Fig. 10B As shown in , there are various configurations for the infotainment system 1000 to incorporate one or more supplemental display panels 1006 .

[0076] The system may also include one or more routing modules to process cartographic data in conjunction with one or more location determination components (i.e., GPS receivers). The cartographic data may be stored in a memory and / or obtained from a remote service via one or more communication elements. The routing module represents the functionality of determining a suitable route between two locations. The routing module may use the cartographic data to determine the shortest, fastest, best autonomy (e.g., battery impact), and / or most fuel-efficient route between two locations. For example, the routing module may be used to route a vehicle to any destination, calculate an estimated time of arrival (ETA), estimated autonomy, and determine the status of the vehicle compared to a predetermined location (i.e., ahead of schedule, behind schedule, or on schedule), or update the route to meet scheduling requirements. The routing information may be presented to the operator using any display panel and / or audible communication.

[0077] The system may also include functionality that enables it to identify and manage vehicle operators. In some embodiments, the vehicle operator may be identified by a key, electronic vehicle entry or operating device (e.g., a keyless entry transmitter, a vehicle remote start transmitter, a portable media device, a cellular phone, etc.). The system may manipulate the information presented to the vehicle operator in an arrangement associated with the vehicle operator. For example, the system may identify the vehicle operator and customize the information presented to him accordingly. If the system identifies that multiple vehicle operators alternate vehicle operations, the system may manage the driving schedules of two drivers. In some embodiments, the vehicle may modify adjustable elements, such as the operator's preferred time of day for operating the vehicle, preferred route characteristics, to accommodate the identified vehicle operator.

[0078] The system may also include one or more processors, memories, communication modules, sensors, media drives, coolers, fans, and connectors for adding additional hardware. One or more of these components may perform the functions and operations described herein.

[0079] In some embodiments, information, content, and control commands may be limited when the vehicle's current speed exceeds a predetermined threshold speed. For example, the predetermined threshold speed may be 5 miles per hour.

[0080] like Fig.11 As shown in , the main display panel 1002 can be used to present a digital dashboard portion (e.g., digital dashboard 202) and one or more information center displays 1102. The system provides functionality that allows an operator to customize the presentation and / or appearance of elements presented in the main display panel 1002. The content of the digital dashboard portion and the information center display 1102 can be resized or repositioned by the system, a third party, or an operator. For embodiments in which the main display panel 1002 is configured as a touch screen, the digital dashboard portion can present switches that provide user input.

[0081] The digital instrument panel portion presents instrument content that conveys information about vehicle operation. The digital instrument panel portion may include all of the content of the main display panel 1002 excluding the information center display 1102. In some embodiments, the content presented by the main display panel 1002 may be limited to the digital instrument panel portion. The system may also present some or all of the content of the digital instrument panel portion in the form of an analog tachometer readout or an instant readout.

[0082] The instrument content presented to the operator in the digital instrument panel portion may include, but is not limited to, a diagnostic warning indicator light 1104, a left turn signal 1106, a right turn signal 1108, an analog speedometer 1110, an instantaneous speedometer 1112, the current gear of the transmission 1114, an engine tachometer 1116, an odometer 1118, and any other sensor readings or calculations related to the performance of the vehicle or trailer. The diagnostic warning indicator light 1104 may be associated with the content presented on the auxiliary display panel 1004. In some embodiments, the diagnostic warning indicator light 1104 may present the current status of the system presented on the auxiliary display panel 1004. The sensors and gauges presented may include, but are not limited to, a fuel gauge 1120, a pressure sensor 1122, an exhaust fluid level 1123, an oil pressure sensor 1124, a battery voltage 1125, a coolant temperature sensor 1126, an oil temperature sensor, a clock, amperage of the electrical system, an air filter sensor, suspension load at various points along the cargo trailer, an oil sensor for the drive axle, a brake pressure sensor, a brake air tank pressure sensor, headlight indicators, taillight indicators, cargo trailer environmental sensors, and various other notifications commonly found in vehicle dashboards.

[0083] The digital instrument panel portion may present information related to the instantaneous speed of the vehicle, such as velocity, using an analog speedometer 1110 and / or an instantaneous speedometer 1112. The system provides a feature that allows the vehicle operator to customize the content by manually adjusting the units of the speed information presented between miles per hour (mph), kilometers per hour (kph), or any other unit of measurement indicating the vehicle's speed of travel.

[0084] In some embodiments, the system can automatically adjust the measurement unit of the vehicle's speed to the measurement system used in the vehicle's current geographic location. The system can use the location determination component to determine the vehicle's current location. For example, if the system determines that the vehicle has transitioned from a geographic region that uses the metric system to a geographic region that uses U.S. customary units, the system can automatically change the units indicating speed from kilometers per hour (kph) to miles per hour (mph).

[0085] The digital instrument panel portion may also provide information about the vehicle's fuel economy. This includes, but is not limited to, historical fuel economy data, current fuel economy estimates based on engine performance, and fuel economy predictions based on driving information. In some embodiments, the system may determine and present to the operator an indication of the best time to change transmission gears based on performance and / or fuel economy criteria.

[0086] The digital instrument panel portion may also provide information about the vehicle battery. This includes, but is not limited to, power consumption data, current autonomy estimates based on engine performance, consumption of equipment such as heating systems, and / or driving information. In some embodiments, the system may determine and present to the operator an indication of the best time to change transmission gears, change engine output, change regenerative braking settings, etc. based on performance and / or autonomy criteria.

[0087] The digital instrument panel portion may also provide information about the distance traveled by the vehicle. In some embodiments, this includes presenting one or more odometers 1118. The odometers 1118 may indicate the total distance traveled since the vehicle was manufactured and the distance traveled since the odometers were reset. In some embodiments, the odometers 1118 may present the remaining distance to a point of interest or turning point, which may be calculated by the system or entered by the operator.

[0088] In some embodiments, dynamic lane guidance functionality is used to help the operator determine which lanes correctly position the vehicle for upcoming road changes, turning points, and intersections.

[0089] In some embodiments, the lane detection function is used to help the operator determine whether the vehicle may inadvertently cross the lane boundary of the road of travel and enter another road lane or shoulder area. In some embodiments, the system can determine the current position of the vehicle relative to the lane of the road of travel by using image pattern recognition and / or position determination components.

[0090] In some embodiments, the collision monitoring function is used to help the operator determine the presence of an object located in front of or behind the vehicle. In some embodiments, the system uses signal reflection technology, such as infrared (IR) signal reflection and / or laser ranging systems. Signal reflection technology detects the presence of an object by using one or more signal transmitting units and one or more receiving sensors to collect any signals reflected from the surface of the object. In some embodiments, the system uses infrared (IR) signal reflection to create an image of the detected object based on the signal received by the receiving sensor. The system can present the image to the operator using one or more display panels or projector systems. The projection system can be a head-up display technology that presents information on the vehicle windshield, or a three-dimensional technology that can be presented anywhere in the vehicle cabin.

[0091] like Fig.11 As shown in , in addition to the digital instrument panel portion, the main display panel 1002 may also include one or more high-resolution information center displays 1102. The information center display 1102 may be used to present any information to the vehicle operator and provide an area for receiving user touch input. The information center display 1102 may enable the operator to easily learn about communication, navigation, and / or entertainment information, regardless of the same information currently being provided elsewhere by the infotainment system 1000.

[0092] In some embodiments, the information center display 1102 can be used to notify the operator of various information. The information that can be presented to the operator includes, but is not limited to: a navigation interface with mapping and routing information from a routing module, wireless communication information, dynamic lane guidance, reversing camera and / or sensor output, blind spot information, driver alerts, trip information, vehicle information, trailer information, diagnostic information, warnings, infotainment system settings, web browsers, relevant driving information, time, and any other content that the system, vehicle operator, or third party chooses to present. The wireless information that can be integrated into the system may include the communication frequency (e.g., CB radio frequency) currently being used by the vehicle operator. In some embodiments, the system can provide a function that enables the vehicle operator to select a communication frequency, initiate and terminate the transmission of an audio signal, and monitor the communication frequency for activity. The dynamic lane guidance function helps the operator determine which lane to enter for upcoming road changes, turning points, and intersections. In some embodiments, dynamic lane guidance is linked to a routing module.

[0093] In some embodiments, the system can present information received from a remote source such as a remote server or wireless broadcast using the information center display 1102. For example, the information center display 1102 can present electronic messages, Internet content, and other forms of electronic information.

[0094] In some embodiments, the system may present critical and / or time sensitive information (i.e., diagnostics or communication warnings) on the message center display 1102. The system may provide the ability to customize content to include an indication of new information received from a remote source. For example, the indication may be provided via a dedicated icon or text that flashes or remains on until acknowledged by the operator. The indication of new information may only be presented for a predetermined period of time.

[0095] In some embodiments, content or portions of content currently presented in the message center display 1102 can be shrunk and expanded to display new and related information. As the infotainment system and / or vehicle operator changes the content presented, new and pre-existing content can be moved to various forms and locations within the message center display 1102.

[0096] like Fig.12 As shown in , the system can present one or more selected interface modes within the system control window 1202. An interface mode is a collection of operator inputs and information to be communicated to the operator. The system control window 1202 presents information and standard controls for the selected interface mode. In some embodiments, the content or portion of the content currently presented in the system control window 1202 can be shrunk and expanded to display new and related information. In some embodiments, the available interface modes may include navigation, messaging, audio, climate, load / trailer, driver data, diagnostics, and weather. Fig.12 As shown in , the system provides the operator with the ability to select one or more interface modes using selection inputs 1204-1218, and the selection inputs 1204-1218 may include but are not limited to navigation selection input 1204, message selection input 1206, audio selection input 1208, climate selection input 1210, load / trailer selection input 1212, driver data selection input 1214, diagnostic selection input 1216 and weather selection input 1218.

[0097] Available selection inputs 1204-1218 may be presented anywhere in the auxiliary display panel 1004. Fig.12 As shown in , selection inputs 1204-1218 can be located along a lower portion of auxiliary display panel 1004. In some embodiments, the actively selected interface mode can be indicated in some way by the selection input. Fig.13 As shown in , the auxiliary display panel 1004 is in the climate control interface mode and the climate selection input 1210 is highlighted along the perimeter of the input.

[0098] The selection inputs 1204-1218 may contain useful information presented within their boundaries so that some information is delivered without requiring the operator to select an interface mode. In some embodiments, the navigation selection input 1204 may contain current heading 1220, the message selection input 1206 may contain voicemail information 1222 and email information 1224, the audio selection input 1208 may contain current radio station or track information 1226, the climate selection input 1210 may contain current or desired cabin temperature 1228 and air conditioning status 1230, the load / trailer selection input 1212 may contain trailer diagnostic information 1232, the driver data selection input 1214 may contain drive time information 1234, the diagnostic selection input 1216 may contain current diagnostic information 1236 for the vehicle, and the weather selection input 1218 may contain current weather information 1238.

[0099] In some embodiments, the system control window 1202 allows touch input from the operator because the auxiliary display panel 1004 is a touch screen. The operator can use the touch input function to input the desired changes. In some embodiments, the currently selected control is indicated in some way, such as by highlighting with a different color. Fig.13 As shown in , the currently selected climate standard controls, including sleeper air conditioning switch 1326, outside air flow switch 1330, cab air conditioning switch 1322 and cab air conditioning switch 1336 are highlighted to convey their selection to the operator.

[0100] The vehicle operator can choose to present independent enhanced elements 1240, 1242 in the auxiliary display panel 1004. The enhanced elements 1240, 1242 can be instruments, communication information, or media content. In some embodiments, the vehicle operator can customize the content, size, number, and layout of the enhanced elements 1240, 1242 presented. Fig.12 As shown in , the presented enhancement elements 1240 , 1242 may be full-sized instrumentation on either side of the system control window 1202 .

[0101] In some embodiments, when the system receives a control command from the vehicle operator to change the content of the independent augmented elements 1240, 1242, the system will make such changes. For example, the change may be to introduce a rotation of one or more previously hidden augmented elements. Figure 2 As shown in , the system can change the presented enhancement elements 1240, 1242 by selecting the left incrementer 1244 to change the enhancement element 1240, or by selecting the right incrementer 1246 to change the enhancement element 1242.

[0102] like Fig.12 As shown in , the auxiliary display panel 1004 can be used in an audio interface mode to provide the vehicle operator with information and controls about one or more available audio sources. When the auxiliary display panel 1004 is in the audio interface mode, the presented content can include any combination of one or more system control windows 1202, enhancement elements 1240, 1242, and selection inputs for available interface modes.

[0103] The system control window 1202 presents audio information and audio standard controls. Fig.12 As shown, the audio information presented may include audio modulation information 1248, audio type information 1250, current track information 1252, and related audio information 1254. In addition, the audio standard controls may include a stored channel input 1256, a channel search input 1258, an audio modulation selection input 1260, a channel grouping selection input 1262, a media menu 1264, a sound menu 1266, and a program menu 1268.

[0104] In some embodiments, the system can automatically populate the stored channel input 1256 with available broadcast frequencies based on the current geographic location of the vehicle. The system can determine the current location data of the vehicle by using a location determination component, such as a GPS component or an A-GPS function provided by a cellular network provider.

[0105] In some embodiments, where the auxiliary display panel 1004 is a touch screen, the system may provide functionality that allows the operator to touch and slide the frequency indicator along the graphical frequency range to quickly select the desired radio frequency. Additionally, the system may provide a radio presentation functionality that enables the operator to use the touch screen to assign new values ​​to stored channel outputs 1256 by simply pressing and holding a stored channel input 1256 to assign the currently tuned broadcast station as the value of the stored channel input 1256.

[0106] like Fig.13 As shown in , the auxiliary display panel 1004 can be used in a climate control interface mode to provide the vehicle operator with information and controls about the climate of the vehicle cab, sleeper, and trailer (if any). When the auxiliary display panel 1004 is in the climate control interface mode, the content presented may include one or more system control windows 1202, enhanced elements 1240, 1242, and selection inputs 1204-1218 for available interface modes.

[0107] The system control window 1202 may present any combination of climate control information and climate standard controls. In some embodiments, the climate control interface may be limited to the cab and berth areas. Fig.13 As shown in FIG. 1 , the system control window 1202 may be divided into a sleeper climate control area 1302 and a cab climate control area 1304. The climate control information presented may include a current vehicle sleeper temperature 1306, a current cab temperature 1308, a sleeper fan level 1310, and a cab fan level 1312. In addition, climate standard controls may include a cab temperature adjustment 1314, a sleeper temperature adjustment 1316, a cab fan adjustment 1318, a sleeper fan adjustment 1320, a cab air conditioning switch 1322, a cab maximum air conditioning switch 1324, a sleeper air conditioning switch 1326, a rear defrost 1328, an external air flow switch 1330, a circulating air flow switch 1332, air flow zones 1334-1342, and an off switch 1344.

[0108] The auxiliary display panel 1004 can be used in a navigation interface mode to provide an interface mode for accessing navigation information. The navigation function provided by the system can use a position determination component to assist the operator. When the auxiliary display panel 1004 is in the navigation interface mode, the content presented may include one or more system control windows 1202, enhanced elements 1240, 1242, and selection inputs for available interface modes.

[0109] Systems including position determination components can utilize position determination technology, such as the Global Positioning System (GPS) and / or other satellite and terrestrial positioning systems. In this manner, the location of the system can be identified to enable the system to provide various position and navigation functions. In various configurations, the system can include a GPS-enabled device including a receiver configured to receive signals from various location transmitting sources via an antenna.

[0110] The Global Positioning System (GPS) has been developed to provide accurate positioning data. In a conventional GPS system, a receiver is used to capture an input signal to identify the location of the receiver relative to one or more GPS signal sources (such as satellites). In this way, a device including the receiver can be used to navigate from the identified location to a specified location.

[0111] When the device is equipped with a library of roads (e.g., streets, avenues, boulevards, paths, highways, freeways, alleys, paths), the device may be able to indicate a route between the identified location and the specified location. For example, upon accepting a destination, the device may access a library containing road data to indicate which roads can be used to reach the specified location.

[0112] The presentation content of the system control window 1202 may include current location information and scheduling information that can be viewed in the driver data interface mode. For the purpose of the following discussion, the presented location information may include any combination of location determination functions, which may involve various navigation technologies and other technologies that may be supported by "knowing" one or more locations. For example, the location determination function may be used to provide location data, timing data, speed data, and various other navigation-related data. The system may be configured in various ways to perform a variety of navigation-related functions. For example, the system may be configured for vehicle navigation as shown, air navigation (e.g., for airplanes, helicopters), maritime navigation, personal use (e.g., as part of fitness-related equipment), etc. Thus, the system may include various devices to determine the location of the system using one or more of the technologies described above.

[0113] Signals from various location transmission platforms may be processed by a navigation module, which may be executed by the system's processor and stored in the system's memory. The navigation module represents the functionality of "knowing" location, such as by processing signals obtained from the location transmission platform to provide the location determination functions described above, such as positioning system, speed, time, etc. For example, the navigation module may be executed to use the location data stored in the memory to display the current location on a map, etc. The navigation module may also be executed to provide other location determination functions, such as determining the current speed, calculating the arrival time, etc. A variety of other examples are also contemplated.

[0114] The system may also include a routing module. The routing module represents functionality for determining a suitable route between two locations. The routing module may use cartographic data to determine the shortest, fastest, and / or most fuel-efficient route between two locations. The cartographic data may be stored in memory and / or obtained from a remote service via one or more communication elements.

[0115] Although the GPS system is described in this document, it is apparent that a variety of other positioning systems may be used, such as ground-based systems (e.g., wireless telephone systems or data systems that broadcast location data from cellular towers), wireless networks that transmit positioning signals, etc. For example, the position determination function may be implemented using a server in a server-based architecture, from a ground-based infrastructure, through one or more sensors (e.g., a gyroscope or odometer), etc. Other exemplary systems include, but are not limited to, the Global Orbiting Navigation Satellite System (GLONASS), the Galileo navigation system, or other satellite navigation systems.

[0116] The system can use the supplemental display panel 1006 to present any information to the operator or receive touch input control commands from the operator. In some embodiments, the content available for presentation on the supplemental display panel 1006 is linked to the information displayed on the primary display panel 1002 and / or the auxiliary display panel 1004.

[0117] In some embodiments, the operator can select Fig.14 and Fig.15 The single supplemental display panel 1006 shown in FIG. 1 controls the transport and performance features of the vehicle and trailer. The supplemental display panel 1006 may allow the use of a touch screen to receive input control commands. The adjustment of features may be performed using electrical switches for adjustment presented on the supplemental display panel 1006 that receive touch input from the operator. This adjustment method may be used to control any switch. For example, the system may provide the operator with the ability to adjust common light switches (such as switches required for headlights, driving lights, fog lights, exterior cab lights, instrument dimming lights, hazard lights, exterior beacon lights, auxiliary driving lights, sleeper lights, rear air conditioning, and taillights).

[0118] In some embodiments, the vehicle operator can adjust performance-related components such as engine fan, engine brake, DPF emissions, cruise control, and cruise selection. In addition, the vehicle operator can also adjust key vehicle and trailer settings such as trailer air suspension height and / or hardness, air suspension, fifth wheel locking and / or unlocking, and differential locking and / or unlocking.

[0119] In some embodiments, the independent augmented elements 1240 and 1242 in the auxiliary display panel 1004 may be instrument content (eg, a measuring instrument). Instrument content that may be used as independent augmented elements 1240 and 1242 in the auxiliary display panel 1004 may include other alternative measuring instruments.

[0120] Although the present disclosure has been described with reference to the embodiments illustrated in the accompanying drawings, it should be noted that equivalents may be employed and substitutions may be made herein without departing from the scope of the disclosure as recited in the claims.

[0121] Having thus described various embodiments, what is claimed to be new and desired to be protected by Letters Patent includes the following.

Claims

1. An icon verification system, comprising: a vehicle display associated with the vehicle, the vehicle display configured to present graphics and icons indicative of a status of the vehicle; a memory configured to store a plurality of icons; and A processor, the processor being configured to: detecting an icon when overlaid on a graphic presented on said vehicle display; comparing the detected icon with the plurality of stored icons; Based on the comparison, verifying an icon for overlaying on the displayed graphic; as well as A verified icon is presented overlaid on the graphic on the display.

2. The icon authentication system of claim 1, wherein the processor is further configured to detect the icon based on the shape of the icon using an edge detection algorithm. 3 . The icon authentication system of claim 2 , wherein the processor is further configured to compare a background color of the background of the vehicle display to an icon color of the icon and determine the observability of the icon.

4. The icon verification system of claim 3, wherein the processor is further configured to display a security icon overlay on the icon when the observability of the icon is below an observability threshold.

5. The icon verification system of claim 4, wherein the icon is animated.

6. The icon authentication system of claim 4, wherein the background is animated.

7. The icon verification system of claim 1, wherein the processor is further configured to: generating one or more criteria for validating an icon including a processing request; Produces one or more expected results; Sending processing requests to a graphics processing unit (GPU); Receive processing results from the GPU; as well as The processed result is compared to the one or more expected results to verify the processed result.

8. The icon verification system of claim 7, wherein the icon is animated, The processor is further configured to: scrambling components of a processing request for each time frame associated with the icon; updating the one or more expected results based on the scrambling; and The icon is validated based on one or more expected results for each frame of the icon.

9. An icon verification system, comprising: a memory configured to store a plurality of icon shapes; and a processor communicatively coupled to a graphics processing unit (GPU) associated with a vehicle, the GPU configured to present graphics and icons indicating a status of the vehicle via a vehicle display, the processor configured to: detecting, by an edge detection algorithm, an icon shape of the icon when overlaid on a graphic presented on the vehicle display; comparing the detected icon shape with the plurality of stored icon shapes; Based on the comparison, verifying an icon for overlaying on the displayed graphic; as well as A verified icon is presented overlaid on the graphic on the vehicle display.

10. The icon authentication system of claim 9, wherein the processor is further configured to compare a background color of a background of the vehicle display to an icon color of an icon and determine the observability of the icon.

11. The icon authentication system of claim 10, wherein the processor is further configured to display a security icon overlay on the icon when the observability of the icon is below an observability threshold.

12. The icon authentication system of claim 11, wherein the icon is animated.

13. The icon authentication system of claim 11, wherein the background is animated.

14. The icon verification system of claim 9, wherein the processor is further configured to: generating one or more criteria for validating an icon including a processing request; Produces one or more expected results; Send processing requests to the GPU; Receive processing results from the GPU; as well as The processed result is compared to the one or more expected results to verify the processed result.

15. The icon verification system of claim 14, wherein the icon is animated, The processor is further configured to: scrambling components of a processing request for each time frame associated with the icon; updating the one or more expected results based on the scrambling; and The icon is validated based on one or more expected results for each frame of the icon.

16. An icon verification system, comprising: a processor configured to instruct a graphics processing unit (GPU) to present graphics and icons indicating a status of the vehicle via a vehicle display; a memory communicatively coupled to the processor and configured to store a plurality of icons; and The processor is further configured to: detecting a shape of an icon when overlaid on a graphic presented on said vehicle display; comparing the detected icon with the plurality of stored icons; Based on the comparison, verifying an icon for overlaying on the displayed graphic; as well as A verified icon is presented overlaid on the graphic on the vehicle display.

17. The icon authentication system of claim 16, wherein the processor is further configured to display a security icon overlay on the icon when the observability of the icon is below an observability threshold.

18. The icon authentication system of claim 16, wherein the processor is further configured to detect the icon based on the shape of the icon using an edge detection algorithm.

19. The icon verification system of claim 16, wherein the processor is further configured to: generating one or more criteria for validating an icon including a processing request; Produces one or more expected results; Send processing requests to the GPU; Receive processing results from the GPU; as well as The processed result is compared to the one or more expected results to verify the processed result.

20. The icon verification system of claim 19, wherein the icon is animated, The processor is further configured to: scrambling components of a processing request for each time frame associated with the icon; updating the one or more expected results based on the scrambling; and The icon is validated based on one or more expected results for each frame of the icon.

Images