Information processing method and device applied to rear-row vehicle-mounted display equipment
By integrating ADAS, SR and AR view functions into the rear-seat in-vehicle display device, data interaction with the front driver-side in-vehicle display device and the autonomous driving system is achieved, solving the problem of rear passengers being unable to obtain real-time information about the vehicle's surroundings, improving information transparency and interactive experience, and enhancing their understanding of and trust in ADAS functions.
Patent Information
- Application Number
- CN202510968227.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-14
- Publication Date
- 2025-09-26
AI Technical Summary
The in-vehicle display devices of rear passengers are unable to display real-time perception information of the vehicle's surrounding environment, especially when ADAS is activated, resulting in information island phenomenon, affecting the riding experience and understanding and trust in ADAS functions.
ADAS, SR, and AR view functions are integrated into the rear-seat in-vehicle display device. Through a newly added communication module, data interaction with the front driver-side in-vehicle display device and the autonomous driving system is achieved, providing the ADAS system with real-time environment rendering trajectory maps and explanatory text on decision-making behaviors.
It improves rear passengers' understanding and trust in ADAS functions, enhances information transparency and interactive experience, expands the functional value of in-vehicle display devices, and promotes the development of intelligent driving experience.
Smart Images

Figure CN120697552A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicle control technology, and in particular to an information processing method and device applied to a rear-seat vehicle-mounted display device. Background Art
[0002] In existing vehicle designs, only the driver's in-vehicle display device can display a real-time rendering of the vehicle's surroundings. The in-vehicle displays for rear passengers (such as those in the second and third rows) are primarily used for entertainment and lack the ability to display real-time information about the vehicle's surroundings. Especially when ADAS (Advanced Driver Assistance Systems) is activated, rear passengers are unable to access the real-time operating status of ADAS functions through their in-vehicle displays. This results in an information silo within the overall vehicle intelligent experience, leading to a lack of understanding and participation in the real-time operation of ADAS functions, which in turn affects their satisfaction with the riding experience. Summary of the Invention
[0003] In view of this, an embodiment of the present invention provides an information processing method and device for a rear-seat vehicle-mounted display device, which can at least solve the problem in the prior art that the rear-seat vehicle-mounted display device has a single function and cannot provide rear-seat passengers with real-time ADAS operation status other than entertainment.
[0004] To achieve the above-mentioned object, according to one aspect of an embodiment of the present invention, there is provided an information processing method for a rear-seat vehicle-mounted display device, comprising:
[0005] acquiring a current state of an autonomous driving function from an autonomous driving system in response to a trigger operation of an operation key indicating an autonomous driving view on the display device;
[0006] In response to the autonomous driving function being currently activated, obtaining real-time operating information corresponding to the autonomous driving function;
[0007] The information type of the real-time operation information is identified, and a display mode preset for the information type and the real-time operation information are used to render a view displayed by the display device, and the real-time operation information is displayed through the view.
[0008] To achieve the above-mentioned object, according to another aspect of an embodiment of the present invention, there is provided an information processing device for a rear-seat vehicle-mounted display device, comprising:
[0009] a state acquisition module, configured to acquire a current state of the autonomous driving function from the autonomous driving system in response to a triggering operation of an operation key indicating an autonomous driving view on the display device;
[0010] an information acquisition module, configured to acquire real-time operation information corresponding to the autonomous driving function in response to the autonomous driving function being currently activated;
[0011] The information display module is used to identify the information type of the real-time operation information, use the preset display mode for the information type and the real-time operation information, render the view displayed by the display device, and display the real-time operation information through the view.
[0012] To achieve the above-mentioned objective, according to another aspect of an embodiment of the present invention, an information processing electronic device applied to a rear-seat vehicle-mounted display device is provided.
[0013] The electronic device of an embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement any of the above-mentioned information processing methods applied to rear-seat vehicle display devices.
[0014] To achieve the above-mentioned purpose, according to another aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, any of the above-mentioned information processing methods applied to rear-seat vehicle-mounted display devices is implemented.
[0015] To achieve the above objectives, according to another aspect of an embodiment of the present invention, a computer program product is provided. A computer program product according to an embodiment of the present invention includes a computer program that, when executed by a processor, implements the information processing method for a rear-seat in-vehicle display device provided in an embodiment of the present invention.
[0016] According to the solution provided by the present invention, one embodiment of the aforementioned invention has the following advantages or beneficial effects: It provides the rear-seat passenger in-vehicle display with a real-time rendering of the ADAS system's environment trajectory and explanatory text explaining the reasons for its decision-making, enabling rear-seat passengers to intuitively understand the operation of the vehicle's autonomous driving functions. This solution improves the information transparency and interactive experience for rear-seat passengers during the ride, enhances their understanding and trust in ADAS functions, expands the functional value of rear-seat in-vehicle displays, and further promotes the development of an intelligent driving experience.
[0017] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings are provided for a better understanding of the present invention and are not intended to limit the present invention.
[0019] Figure 1This is a schematic diagram of the main flow of an information processing method applied to a rear-seat vehicle-mounted display device according to an embodiment of the present invention;
[0020] Figure 2(a) is a schematic diagram of a panoramic view displayed by SR technology;
[0021] Figure 2(b) is a schematic diagram of the AR image of the vehicle head direction displayed by AR technology;
[0022] Figure 3(a) is a schematic diagram of the panoramic view after superimposing the trajectory;
[0023] Figure 3(b) is a schematic diagram of the AR image after superimposing the trajectory;
[0024] Figure 4 is a flow chart of an optional information processing method applied to a rear-seat vehicle-mounted display device according to an embodiment of the present invention;
[0025] Figure 5 is a flowchart of a specific information processing method applied to a rear-seat vehicle-mounted display device according to an embodiment of the present invention;
[0026] Figure 6 This is a schematic diagram of main modules of an information processing device applied to a rear-seat vehicle-mounted display device according to an embodiment of the present invention;
[0027] Figure 7 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;
[0028] Figure 8 It is a schematic diagram of the structure of a computer system of a mobile device or server suitable for implementing the embodiments of the present invention. DETAILED DESCRIPTION
[0029] The following description of exemplary embodiments of the present invention is made in conjunction with the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding. These details should be considered as merely exemplary. Therefore, it should be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.
[0030] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned. They should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0031] The embodiments and features of the embodiments of the present invention may be combined unless they conflict. The acquisition, transmission, storage, use, and processing of data in the technical solution of the present invention comply with relevant national laws and regulations, are used for legal and reasonable purposes, are not shared, disclosed, or sold beyond these legal uses, and are subject to supervision and management by regulatory authorities.
[0032] With respect to user information, necessary measures should be taken to prevent unauthorized access to such personal information data, ensure that persons with access to such personal information data comply with relevant laws and regulations, and ensure the security of user personal information. Once such user personal information data is no longer needed, risks should be minimized by restricting or even prohibiting data collection and / or deleting the data. Where applicable, including in certain relevant applications, user privacy should be protected by de-identifying the data, for example, by removing specific identifiers (e.g., date of birth), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the specific address level), controlling how the data is stored, and / or other methods of de-identification.
[0033] Currently, the in-vehicle displays for rear-seat passengers in most vehicles have relatively limited functionality, primarily focused on entertainment and basic information services. They are unable to display real-time images of the vehicle's surroundings. Especially with ADAS activated, rear-seat passengers struggle to access key information such as the vehicle's surroundings, future driving trajectory, and the specific reasons behind the ADAS's decisions. This information asymmetry can easily lead to rear-seat passengers lacking understanding of the ADAS's real-time operational information, leading to concerns about its performance and, in some cases, even questioning or opposing the driver's activation of ADAS, impacting the user experience and acceptance of intelligent driving technology.
[0034] To address these issues, this solution expands upon the existing rear-seat in-vehicle display by adding a communication module to enable data exchange with the front driver-side in-vehicle display (e.g., HMI) and the autonomous driving system. This module enables the rear-seat in-vehicle display to capture and display the ADAS's perceived image of the vehicle's surroundings, the planned future driving trajectory, and related decision-making explanations in real time, thereby breaking down information barriers and improving the transparency and consistency of human-machine interaction throughout the vehicle.
[0035] At the user interaction level, a new "ADAS View" operation button (that is, the operation button indicating the autonomous driving view) has been added to the interface of the rear-seat in-vehicle display device. The user can trigger the system linkage mechanism with one click. The in-vehicle system (or the processor of the rear-seat in-vehicle display device, or the processor that manages all the in-vehicle display devices of the vehicle) will link the in-vehicle display device on the front driver's side and the autonomous driving system, retrieve the real-time operation information of the ADAS and render it to the view of the rear-seat in-vehicle display device, forming an intuitive and visual ADAS perception interface to help passengers fully understand the vehicle's current driving status and system behavior logic.
[0036] In addition, this solution also brings a number of significant advantages. First, by providing rear passengers with rich ADAS operating information, it not only satisfies their curiosity about the vehicle's ADAS functions, but also alleviates the boredom of the ride to a certain extent, improving the overall travel experience. Secondly, with the help of a visual combination of graphics and text, rear passengers can see more clearly how the ADAS function perceives the environment, makes judgments and performs operations, thereby enhancing their trust and recognition of the ADAS function, and helping to promote the popularization and application of intelligent driving technology among the public. Furthermore, in specific scenarios, rear passengers can also assist the driver in paying attention to road conditions and the working status of ADAS (such as takeover) by understanding the vehicle's operating status, playing a certain auxiliary safety role and further improving the driving safety of the entire vehicle.
[0037] In summary, this solution effectively solves the problem of information loss for rear passengers during ADAS operation through information sharing and interface optimization, enhances the transparency and friendliness of human-computer interaction, and provides strong support for building a more intelligent, safe, and reliable driving experience.
[0038] See also Figure 1 , which shows a main flow chart of an information processing method for a rear-seat vehicle-mounted display device provided by an embodiment of the present invention, including the following steps:
[0039] S101: In response to a trigger operation of an operation key indicating an autonomous driving view on the display device, obtaining a current state of an autonomous driving function from an autonomous driving system;
[0040] S102: In response to the autonomous driving function being currently activated, obtaining real-time operation information corresponding to the autonomous driving function;
[0041] S103: Identify the information type of the real-time operation information, use a preset display mode for the information type and the real-time operation information to render a view displayed by the display device, and display the real-time operation information through the view.
[0042] In this solution, the rear-seat in-vehicle display device can adopt RSE (Rear Seat Entertainment), which is usually installed behind the headrest of the front seat or the roof for rear passengers to watch videos, browse pictures, and perform other operations. In practice, it can also be set in the armrest of the rear seat, for example, by using a small table, equipping each rear seat with a small table with an in-vehicle display device to improve the convenience of use. The in-vehicle display device can be an electronic display device such as a liquid crystal display (LCD), a light emitting diode (LED) display, a plasma display, or an electroluminescent display. The screen operation of the rear-seat in-vehicle display device can be achieved through a matching remote control or touch screen interface, which is convenient for rear passengers to use. At the same time, the rear-seat in-vehicle display device supports Wi-Fi and 4G / 5G network connections to communicate and exchange data with the in-vehicle display device on the front driver's side and the autonomous driving system.
[0043] Regarding step S101, this solution adds an ADAS view operation button to the interactive interface of the rear-seat in-vehicle display device, allowing rear-seat passengers to actively activate and operate the rear-seat in-vehicle display device while riding. When the screen is turned on, the ADAS view operation button will be displayed on the display device's interactive interface. When the rear-seat passenger triggers this operation button, the in-vehicle system will respond to this operation, automatically obtain the current status of the ADAS function, and determine whether the current status is active. If the ADAS function is not yet activated, the rear-seat in-vehicle display device will display a text reminder on the interactive interface, such as "Autopilot is not turned on, ADAS view is not available", to inform the rear-seat passengers that they are currently unable to view real-time operating information related to the ADAS function.
[0044] As an optimized implementation method, this solution also adds a "vehicle AR (Augmented Reality) or SR (Spatial Reality) view operation key" (i.e., vehicle view operation key) to the interactive interface of the rear-seat on-board display device to enrich the visualization experience of the rear passengers. When the rear passengers are interested in the vehicle's surrounding environment information, they can select and trigger the "vehicle AR / SR view operation key" through the interactive interface of the rear-seat on-board display device. At this time, the on-board system will render the corresponding vehicle AR / SR rendering in real time, that is, display the AR or SR image in the vehicle's real-time perception interface. This AR / SR-based visualization presentation method helps rear passengers understand the current vehicle's surrounding environment information, thereby improving the overall driving experience.
[0045] SR generally refers to the technology of collecting images of the vehicle's surrounding environment through sensors in multiple directions (such as cameras), and then stitching the collected environmental images into a 360-degree panoramic view through image processing algorithms, as shown in Figure 2(a). This helps occupants of the vehicle to more intuitively understand the vehicle's surrounding environment. Its typical application scenarios include parking assistance, environmental perception during low-speed driving, and blind spot monitoring.
[0046] AR is a technology that graphically overlays virtual information onto real-world scenes. Using specific hardware and software algorithms, users can see a fusion of real and virtual elements, enhancing the intuitiveness and immersion of information. If a rear passenger selects the AR view button, the vehicle's system captures a panoramic view of the vehicle's surroundings in the same manner as SR. The difference is that the system captures the current window image, aligned with the vehicle's front direction, from the panoramic view. Simultaneously, the system obtains navigation guidance information for the path ahead based on the vehicle's positioning information, including environmental perception information such as lane predictions, traffic participant status, and target obstacle identification. This perception data is then overlaid onto the current window image as a virtual information layer, resulting in an AR image. This AR image is then displayed in the vehicle's real-time perception interface through augmented reality (see Figure 2(b)). This feature not only enhances the entertainment and interactivity of the rear passengers' ride but also strengthens their understanding and trust in the vehicle's intelligent perception capabilities.
[0047] In this implementation, it is necessary to first trigger the "Vehicle AR / SR View Operation Key" to display the vehicle's real-time perception interface, and set the "ADAS view operation key" in the vehicle's real-time perception interface. When rear passengers are interested in the real-time operation of the ADAS function, they can also view relevant information by triggering the "ADAS view operation key" on the vehicle's real-time perception interface. If the ADAS function is not currently activated, a prompt message will be displayed in the vehicle's real-time perception interface, such as "Automatic assisted driving is not turned on, ADAS view is not available." If the ADAS function is activated, switch to the ADAS real-time AR / SR rendering layer, that is, the autonomous driving real-time perception interface.
[0048] In summary, this solution integrates ADAS, SR and AR viewing functions into the rear-seat on-board display device. When the ADAS function is not activated, the rear passengers can view the vehicle's surrounding environment information through SR or AR. When the ADAS function is activated, they can further view the real-time operation of the ADAS function. This not only expands the interaction methods and visual experience of the rear passengers, but also provides a new interactive entry point and application possibility for the deep integration of future smart cockpits and autonomous driving technologies.
[0049] In steps S102 and S103, the vehicle-mounted system of this solution can communicate and exchange data with the front driver's side vehicle-mounted display device and the autonomous driving system. With the ADAS function activated, while the rear-seat vehicle-mounted display device displays the autonomous driving real-time perception interface, the vehicle-mounted system can obtain real-time operational information of the autonomous driving function from the front driver's vehicle-mounted display device and the autonomous driving system, including but not limited to key content such as the planned trajectory path, perceived vehicle surroundings, and trajectory decision information, thereby achieving multi-screen collaboration and information synchronization.
[0050] When the driver activates the ADAS function, the front-row in-car display will display the ADAS real-time AR / SR rendering layer. This layer is rendered based on the future trajectory planned by the autonomous driving system and the perceived environment around the vehicle. The future trajectory is calculated based on the destination information and the vehicle's current location information. The vehicle's surrounding environment information is collected by sensors, which typically include at least one of cameras, radar, and lidar for high-precision perception of the road environment.
[0051] In one embodiment, "obtaining real-time autonomous driving function operation information from the front driver's in-vehicle display" specifically includes synchronously obtaining the future trajectory path and vehicle surrounding environment information from the front in-vehicle display. Based on this information, the in-vehicle system can generate an ADAS trajectory rendering. This ADAS trajectory rendering can be presented differently from the ADAS real-time AR / SR rendering layer viewed by the front driver to meet the different visualization needs of rear passengers or remote monitoring scenarios.
[0052] Furthermore, the in-vehicle system can generate different ADAS trajectory renderings based on different view modes: ADAS SR trajectory renderings or ADAS AR trajectory renderings. In SR mode, the system first identifies the expected driving trajectory corresponding to the future trajectory path from the panoramic view and annotates the expected driving trajectory in the panoramic image using a preset visualization form (such as specific color annotation, trajectory line style, etc.). Finally, it generates an ADAS SR trajectory rendering to intuitively show the user the vehicle's future driving intentions, as shown in Figure 3(a).
[0053] In AR mode, the system overlays the future trajectory planned by the autonomous driving system onto the current viewport image in the augmented reality image as a virtual information layer. After image fusion processing, it generates an ADAS AR trajectory rendering. This virtual information layer can include visual elements such as trajectory line type, color identification, and dynamic arrows to more vividly and accurately express the vehicle's driving path and behavior predictions over the next period of time, as shown in Figure 3(b).
[0054] In one embodiment, the aforementioned "obtaining real-time operational information about autonomous driving functions from the autonomous driving system" primarily involves acquiring trajectory decision information. To effectively exchange this information, the system first generates a trajectory decision message based on the acquired future trajectory path and sends this message to the autonomous driving system, triggering it to return the corresponding trajectory decision information. During the subsequent information display phase, the system identifies the trajectory decision information as text and renders it using a preset text display method. This information is then displayed within the autonomous driving real-time perception interface, intuitively conveying the autonomous driving's behavioral intent.
[0055] As an optimization approach, the autonomous driving real-time perception interface can be partitioned to display the autonomous driving trajectory rendering and trajectory decision information in different areas. For example, the autonomous driving trajectory rendering can be displayed in the left area and the trajectory decision information can be displayed in the right area. Alternatively, the autonomous driving trajectory rendering and trajectory decision information can be displayed separately in a top-bottom partitioning scheme. Since the renderings are typically large, top-bottom partitioning may result in compression, so this solution prefers a left-right partitioning scheme.
[0056] The method provided in the above embodiment provides the rear-seat passenger in-vehicle display with a rendered image of the ADAS system's trajectory and explanatory text regarding its decision-making, enabling rear-seat passengers to intuitively understand the real-time operation of the vehicle's autonomous driving functions. This solution improves the transparency and interactive experience of rear-seat passengers during the ride, enhances their understanding and trust in ADAS functions, expands the functional value of rear-seat in-vehicle displays, and further promotes the development of an intelligent driving experience.
[0057] See also Figure 4 , shows a flow chart of an optional information processing method applied to a rear-seat vehicle-mounted display device according to an embodiment of the present invention, including the following steps:
[0058] S401: Determine the current driving state of the vehicle, and obtain a preset explanation field for the current driving state;
[0059] S402: using a preset decision explanation model, extracting parameters corresponding to the explanation field from the trajectory decision information, and generating explanation information for the trajectory decision information based on the extracted parameters;
[0060] S403: Rendering a view displayed by the display device using the text display mode and the explanation information, and displaying the explanation information through the view;
[0061] S404: In response to a rear passenger triggering an operation of a detailed explanation operation key in the view, obtaining a preset detailed explanation field for the current driving state;
[0062] S405: using a preset decision explanation model, extracting parameters corresponding to the detailed explanation field from the trajectory decision information, so as to generate detailed explanation information for the trajectory decision information based on the extracted parameters and the explanation information, or based on the extracted parameters;
[0063] S406: Rendering a view displayed by the display device using the text display mode and the detailed explanation information, and displaying the detailed explanation information through the view.
[0064] To further enhance the readability and user understanding of trajectory decision information, this solution proposes an optimized implementation: instead of directly displaying the original trajectory decision information, or after displaying the original trajectory decision information, semantically enhance the trajectory decision information through structured interpretation and natural language expression. Specifically, the system introduces a pre-set "Vision Language Model (VLM)" model for textual interpretation of autonomous driving behavior, a pre-set decision interpretation model, which is used to provide anthropomorphic and scenario-based natural language descriptions of the trajectory decision information of the autonomous driving system.
[0065] The decision explanation model pre-configures various explanation field templates based on the vehicle's current operating state (e.g., driving or parking). For example, in the driving state, the explanation fields include direction, behavior, time / distance, and reason. In the parking state, the structure remains essentially the same, but the reason field can be flexibly omitted based on the actual scenario. By parsing the key parameters in the trajectory decision information and combining them with the aforementioned explanation field templates, the system automatically generates explanation information that aligns with the current driving scenario, making it easier for users to understand the behavioral logic of the autonomous driving system.
[0066] For example, when the driving function is activated, ADAS decision-making behavior will be output in the format of "direction + behavior + time / distance + reason", such as: "Changing lanes to the left, the vehicle in front is moving slowly", "Drive right into the rightmost lane, follow the navigation to enter the ramp after 500m", "Turn right in front and brake, a bicycle is passing 10m behind the right", etc. When the parking function is activated, it is presented in the format of "direction + behavior + time / distance + (reason)", such as: "Reversing into the parking space in front of the left, parking in R gear once, 4m remaining in the path", "Parking sideways into the parking space on the right, parking in R gear twice, 6m remaining in the path", "Reversing into the parking space on the left, braking, a pedestrian is passing 5m to the left", etc. These examples clearly express the operating intention and also take into account safety reminders.
[0067] Ultimately, the system visualizes the generated interpretation information using a preset text display format and embeds it into the real-time autonomous driving perception interface. This allows users to not only "see" changes in the vehicle's surroundings and trajectory, but also "understand" the system's behavioral logic, thereby enhancing their trust in and acceptance of autonomous driving technology. This design not only enhances the intelligent interaction capabilities of the entire vehicle system but also provides a solid technical foundation for future application scenarios such as human-machine co-driving and multimodal fusion interaction.
[0068] Trajectory decision information refers to the behavioral decisions made by the autonomous driving system during operation based on a comprehensive assessment of environmental perception data, vehicle status, and path planning results. For example, decisions such as "about to change lanes," "preparing to brake," and "beginning parking" are generated. Explanation information represents this trajectory decision information in natural language, presenting the autonomous driving system's behavioral intent in a readable and understandable format. This representation allows even non-expert users to quickly understand the vehicle's intended actions and their underlying logic.
[0069] Detailed explanations expand upon the explanatory information, providing richer context, logical justification, or risk warnings to help users better understand the autonomous driving system's decision-making process. For example, based on the explanation of "Lane change right, execute in 50 meters," the detailed explanation could be supplemented with: "Lane change right, execute in 50 meters. Reason: Slow vehicle ahead identified, target lane clear, meeting safe lane change conditions." This approach not only enhances the transparency of human-machine interaction but also provides passengers with a greater sense of control and security.
[0070] As a further optimized implementation, this solution can also provide a "Detailed Explanation" button in the interface when displaying trajectory decision information or its corresponding explanation information. For example, this button can be placed next to the ADAS textual information display area on the rear-seat onboard display device, or a "Detailed Explanation" button can be added for each trajectory decision information or explanation information displayed. When a rear passenger triggers this button, the system will invoke the decision interpretation model based on the current driving or parking function status to conduct in-depth analysis of the trajectory decision information. Specifically, the decision interpretation model extracts parameters corresponding to the detailed explanation fields from the trajectory decision information. Based on the extracted parameters or in combination with the aforementioned explanation information, detailed explanation information for the trajectory decision information is generated, thereby meeting the different levels of user needs for information depth.
[0071] In addition, users can also set "Detailed Explanation" as the default display mode through personalized settings. In this mode, after obtaining the trajectory decision information and before displaying it, the system will automatically load the detailed explanation field template corresponding to the current driving state from the configuration library, and combine it with the decision explanation model to extract parameters that match these fields from the trajectory decision information, and then generate complete detailed explanation information based on these parameters. Ultimately, the real-time perception interface of autonomous driving will display both the trajectory decision information and the corresponding detailed explanation information, or only the detailed explanation information, completing the information communication loop from "seeing" to "understanding".
[0072] The above design not only improves the semantic expression capability of the vehicle's intelligent interactive system, but also provides good technical support for future scenarios such as human-machine co-driving, multimodal fusion interaction, and passenger information visualization, further promoting the development of intelligent driving systems towards "understandable, predictable, and trustworthy."
[0073] Example 1: When the driving function is currently active, the ADAS system's detailed decision explanation follows the following semantic structure: "Current vehicle behavior + Current system perception / navigation + Reason for system behavior + System decision." This structure integrates autonomous driving behavior with environmental perception and path planning, allowing passengers to fully understand the system's behavioral motivations and execution logic. Examples include: "The current lane has a speed limit of XX. The system recognizes the vehicle ahead is currently traveling at XX. There is space in the left lane for lane change, so the system decides to overtake the slower vehicle ahead." "Currently in the middle lane, the navigation prompts an on-ramp in 500 meters. There is space in the right lane for lane change, so the vehicle changes to the right lane in advance." "Currently turning right, the system recognizes a bicycle about to pass 10 meters to the right. Continuing right creates a collision risk, so the system decides to brake." In these examples, each piece of information encompasses real-time perception of the current road conditions, the system's judgment basis, and the resulting driving action, helping users build trust in the autonomous driving system's behavioral intent.
[0074] Example 2: When the parking function is currently activated, the ADAS system's detailed decision explanation information uses another expression structure: "User's target parking space + vehicle parking method + (current system perception) + system behavior reason + system decision." This structure not only reflects the correspondence between user intention and system response, but also combines dynamic perception data during the parking process to enhance the scenario relevance and safety prompts of the information. For example: "The user selects the left front parking space, the vehicle reverses into the garage, and the system recognizes that the space allows one parking entry in R gear, with 4 meters remaining in the path." "The user selects the right parking space, the vehicle reverses into the garage, and the system recognizes that the space requires two parking entries in R gear, with 6 meters remaining in the path." "The user selects the left parking space, the vehicle reverses into the garage, and the system recognizes that a pedestrian passes 5 meters to the left during the parking process, posing a collision risk, so the system brakes."
[0075] Through the above-mentioned formatted detailed explanation information, the system can provide consistent and logically clear information output in different driving scenarios, which not only meets the user's need to understand autonomous driving behavior, but also enhances the transparency and trust of human-computer interaction.
[0076] The method provided in the above embodiment, by combining pre-set explanation fields with a decision explanation model, achieves a structured interpretation and hierarchical display of autonomous driving trajectory decision information. It can dynamically generate explanations of varying depths based on user needs, improving the clarity of information presentation and interactive flexibility. This approach not only enhances rear-seat passengers' understanding and trust in the ADAS system's operating status, but also further enriches the information service capabilities of in-vehicle display devices, enhancing the user-friendliness and intelligence of the intelligent driving experience.
[0077] See also Figure 5 , shows a schematic diagram of an information processing flow for a rear-seat in-vehicle display device according to an embodiment of the present invention. The driver is set as A, the rear passenger is set as B, the front-seat in-vehicle display device such as HIMI is set as C, the rear-seat in-vehicle display device such as RSE is set as D, the autonomous driving ADAS system is set as E, and the vehicle sensor is set as F. The entire process includes the following steps:
[0078] S501: When a rear passenger is interested in information about the vehicle's surroundings, they can select and trigger a "vehicle AR / SR view operation key" through the interactive interface of the rear-seat onboard display device;
[0079] S502 , the vehicle system responds to this operation by displaying the vehicle AR / SR rendering interface on the rear vehicle display device, i.e., switching the interactive interface to display the vehicle real-time perception interface;
[0080] S503. During the display of the vehicle AR / SR rendering interface, information about the vehicle's surrounding environment is obtained. Here, sensors are used to collect multi-directional environmental images around the vehicle, and the environmental images are processed using AR or SR technology to obtain information about the vehicle's surrounding environment.
[0081] S504, rendering and displaying vehicle surrounding environment information in the vehicle AR / SR rendering image;
[0082] S505: When the rear passenger is interested in the real-time operation of the ADAS function, he or she may also trigger the "ADAS view operation key" on the vehicle's real-time perception interface, i.e., the operation key indicating the ADAS view;
[0083] S506 , the vehicle system responds to this operation and obtains the current status of the ADAS function from the ADAS system;
[0084] S507, the ADAS system feeds back the vehicle system the current status of the ADAS function;
[0085] S508 , in response to the ADAS function being currently in an inactive state, the vehicle system displays a prompt message indicating that the ADAS function is inactive in the vehicle AR / SR rendering interface;
[0086] S509 , in response to the ADAS function being currently activated, the vehicle system switches the vehicle real-time perception interface to display the ADAS AR / SR rendering interface;
[0087] S510: The driver activates the ADAS function;
[0088] S511: When the driver activates the ADAS function, the front-row in-vehicle display will display the ADAS real-time AR / SR rendering layer, which is generated by the ADAS system's planned future trajectory path and the perceived vehicle's surrounding environment information. The future trajectory path is calculated based on the destination information and the vehicle's current location information, and the vehicle's surrounding environment information is collected by sensors;
[0089] S512: The vehicle system synchronously obtains the future trajectory path planned by the ADAS system and the perceived vehicle surrounding environment information from the front driver's vehicle display device;
[0090] S513. If the vehicle is equipped with AR technology, the vehicle system uses AR technology to overlay the future trajectory path onto the AR image in the form of a virtual information layer to generate an augmented reality ADAS trajectory rendering, and displays the rendering in a graphic display on the left side of the ADAS AR / SR rendering interface.
[0091] S514. If the vehicle is equipped with SR technology, the vehicle system generates an ADAS trajectory rendering using the SR technology based on the future trajectory path and the panoramic view, and displays the rendering in a graphic display on the left side of the ADAS AR / SR rendering interface.
[0092] S515: After obtaining the future trajectory path, the vehicle system generates a trajectory decision message based on the future trajectory path and sends the trajectory decision message to the ADAS system;
[0093] S516: The ADAS system returns the vehicle system trajectory decision information;
[0094] S517: The vehicle-mounted system renders the trajectory decision information in a preset text display mode, and displays the trajectory decision information on the right side of the ADAS AR / SR rendering interface;
[0095] S518: The vehicle-mounted system determines the current driving state of the vehicle, obtains a preset explanation field for the current driving state, generates explanation information of the trajectory decision information based on the explanation field using a preset decision explanation model, renders the explanation information in a preset text display mode, and displays it on the right side of the ADAS AR / SR rendering interface;
[0096] S519, rear passenger triggers the "detailed explanation" operation key;
[0097] S520: The vehicle-mounted system obtains a preset detailed explanation field for the current driving state, uses a preset decision explanation model, generates detailed explanation information of the trajectory decision information based on the detailed explanation field, and renders the detailed explanation information in a preset text display mode, and displays it on the right side of the ADAS AR / SR rendering interface.
[0098] See also Figure 6 , which shows a schematic diagram of the main modules of an information processing device 600 applied to a rear-seat vehicle-mounted display device provided by an embodiment of the present invention, including:
[0099] a state acquisition module 601 for acquiring a current state of an autonomous driving function from an autonomous driving system in response to a triggering operation of an operation key indicating an autonomous driving view on the display device;
[0100] an information acquisition module 602 for acquiring real-time operation information corresponding to the autonomous driving function in response to the autonomous driving function being currently activated;
[0101] The information display module 603 is used to identify the information type of the real-time operation information, use the preset display mode for the information type and the real-time operation information, render the view displayed by the display device, and display the real-time operation information through the view.
[0102] In the implementation device of the present invention, the state acquisition module 601 is used to:
[0103] Provide an interactive interface;
[0104] In response to a rear passenger triggering an operation on a vehicle view operation key in the interactive interface, switching the interactive interface to display a vehicle real-time perception interface;
[0105] In response to a rear passenger triggering an operation key indicating an autonomous driving view in the vehicle real-time perception interface, an operation is performed to obtain the current state of the autonomous driving function from the autonomous driving system.
[0106] The implementation device of the present invention further includes an environment information display module, which is used to: obtain vehicle surrounding environment information; render the vehicle real-time perception interface according to the vehicle surrounding environment information, so as to display the vehicle surrounding environment information in the vehicle real-time perception interface;
[0107] The vehicle surrounding environment information is a panoramic view or an augmented reality image, and the process of obtaining the panoramic view includes: obtaining environmental images of multiple directions around the vehicle collected by sensors installed on the vehicle, and generating a panoramic view based on the environmental images of the multiple directions;
[0108] The process of obtaining an augmented reality image includes: obtaining environmental images in multiple directions around the vehicle collected by sensors installed on the vehicle; generating a panoramic view based on the stitching of the environmental images in multiple directions, and intercepting a current window image corresponding to the direction of the vehicle head from the panoramic view; obtaining navigation guidance information of the path ahead of the vehicle based on the vehicle's positioning information; and superimposing the navigation guidance information on the current window image in the form of a virtual information layer to generate an augmented reality image.
[0109] In the embodiment of the present invention, the information acquisition module 602 is used to: acquire real-time operating information corresponding to the automatic driving function from the front driver's vehicle display device and the automatic driving system;
[0110] wherein the future trajectory path and vehicle surrounding environment information are synchronously obtained from the front driver's in-vehicle display device; wherein the future trajectory path is planned by the automatic driving system based on the destination information and the vehicle's positioning information;
[0111] A trajectory decision message is generated based on the future trajectory path, and the trajectory decision message is sent to the automatic driving system to receive trajectory decision information returned by the automatic driving system.
[0112] In the embodiment of the present invention, the information display module 603 is used to:
[0113] generating an autonomous driving trajectory rendering image based on the future trajectory path and the vehicle surrounding environment information, identifying an information type of the autonomous driving trajectory rendering image as a graph type, rendering a view displayed on the display device using a graph display mode preset for the graph type and the autonomous driving trajectory rendering image, and displaying the autonomous driving trajectory rendering image through the view;
[0114] The information type of the trajectory decision information is identified as a text type, and a text display mode preset for the text type and the trajectory decision information are used to render a view displayed by the display device, and the trajectory decision information is displayed through the view.
[0115] In the embodiment of the present invention, the information display module 603 is used to:
[0116] When the vehicle surrounding environment information is a panoramic view, identifying an expected driving trajectory corresponding to the future trajectory path from the panoramic view; annotating the expected driving trajectory in the panoramic view in a preset visualization manner to generate a spatially realistic autonomous driving trajectory rendering;
[0117] In a case where the vehicle surrounding environment information is an augmented reality image, the future trajectory path is superimposed on the augmented reality image in the form of a virtual information layer to generate an augmented reality autonomous driving trajectory rendering image.
[0118] In the implementation device of the present invention, after displaying the trajectory decision information through the view, the device further includes an interpretation module for:
[0119] Determining a current driving state of the vehicle, and obtaining a preset explanation field for the current driving state;
[0120] Using a preset decision explanation model, extracting parameters corresponding to the explanation field from the trajectory decision information, and generating explanation information for the trajectory decision information based on the extracted parameters;
[0121] The text display mode and the explanation information are used to render a view displayed by the display device, and the explanation information is displayed through the view.
[0122] In the device implemented in the present invention, after displaying the explanation information through the view, the device further includes a detailed explanation module, which is configured to:
[0123] In response to a rear passenger triggering an operation of a detailed explanation operation key in the view, obtaining a preset detailed explanation field for the current driving state;
[0124] extracting parameters corresponding to the detailed explanation fields from the trajectory decision information using a preset decision explanation model, so as to generate detailed explanation information for the trajectory decision information based on the extracted parameters and the explanation information, or based on the extracted parameters;
[0125] The text display mode and the detailed explanation information are used to render a view displayed by the display device, and the detailed explanation information is displayed through the view.
[0126] In the embodiment of the present invention, the information display module 603 is used to:
[0127] Determining a current driving state of the vehicle, and obtaining a preset detailed explanation field for the current driving state;
[0128] extracting parameters corresponding to the detailed explanation field from the trajectory decision information using a preset decision explanation model, so as to generate detailed explanation information for the trajectory decision information based on the extracted parameters;
[0129] The text display mode, the trajectory decision information and the detailed explanation information or the detailed explanation information are used to render a view displayed by the display device, and the trajectory decision information and the detailed explanation information or the detailed explanation information are displayed through the view.
[0130] In addition, the specific implementation content of the device in the embodiment of the present invention has been described in detail in the above method, so the repeated content will not be described again here.
[0131] Figure 7 An exemplary system architecture 700 to which embodiments of the present invention may be applied is shown, including an in-vehicle system 701, a front-seat driver's in-vehicle display device 702, a rear-seat in-vehicle display device 703, an autonomous driving system 704, a sensor 705, and a vehicle 706;
[0132] The sensor 705 is used to obtain environmental images in multiple directions around the vehicle; the vehicle-mounted system 701 generates vehicle surrounding environment information based on these environmental images using AR or SR technology;
[0133] The autonomous driving system 704 is configured to plan a future trajectory path based on the destination information and the vehicle's positioning information when the vehicle's autonomous driving function is activated. The in-vehicle system 701 generates an autonomous driving rendering based on the future trajectory path and the vehicle's surrounding environment information, and transmits the rendering to the front driver's in-vehicle display device 702 for display.
[0134] A new communication module has been added to the rear-seat in-vehicle display device 703 to enable data exchange with the front-seat driver-side in-vehicle display device and the autonomous driving system. New "Vehicle AR / SR View" and "ADAS View" operation keys have been added to the rear-seat in-vehicle display interface. In response to user-triggered actions, the in-vehicle system 701 triggers corresponding actions. Specifically, the rear-seat passenger first triggers the "Vehicle AR / SR View" operation key to display the vehicle AR / SR rendering interface. When the rear-seat passenger is interested in the real-time operation of the ADAS function, they trigger the "ADAS View" operation key on the vehicle AR / SR rendering interface to view relevant information. If the ADAS function is not currently active, a prompt is displayed in the vehicle AR / SR rendering interface. If the ADAS function is active, the system switches to the ADAS real-time AR / SR rendering layer. Real-time autonomous driving function operation information, including but not limited to key content such as the planned trajectory path, perceived vehicle surroundings, and trajectory decision information, is obtained from the front-seat driver-side in-vehicle display device and the autonomous driving system. Different display modes are used for different content. The ADAS real-time AR / SR rendering layer can be partitioned to display these contents in different areas.
[0135] The vehicle-mounted system 701 may include at least one processor that executes instructions stored in a non-transitory computer-readable medium, such as a memory. The vehicle-mounted system 701 provides executable code that implements information processing for the rear-seat vehicle-mounted display devices. The processor can be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, the processor can be a dedicated device such as an application-specific integrated circuit (ASIC) or other hardware-based processor. Those skilled in the art will understand that the processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, the memory can be a hard drive or other storage medium located in a housing different from the computer. Therefore, references to a processor or computer will be understood to include references to a collection of processors, computers, or memories that may or may not operate in parallel. Rather than using a single processor to perform the steps described herein, some components, such as the steering assembly and the deceleration assembly, can each have their own processor that performs only determinations related to the functions specific to the component. It should be understood that the above components are only examples. In actual applications, components in the above modules or systems may be added or deleted according to actual needs. Figure 7 It should not be understood as limiting the embodiments of the present application.
[0136] Reference below Figure 8 , which shows a schematic structural diagram of a computer system 800 of a terminal device suitable for implementing an embodiment of the present invention. Figure 8 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0137] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage unit 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the system 800 are also stored in the RAM 803. The CPU 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0138] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, and the like; an output section 807 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 808 including a hard disk; and a communication section 809 including a network interface card such as a LAN card or a modem. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 810 as needed, so that computer programs read therefrom can be installed into the storage section 808 as needed.
[0139] In particular, according to the embodiments disclosed in the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 809, and / or installed from a removable medium 811. When the computer program is executed by the central processing unit (CPU) 801, the above-mentioned functions defined in the system of the present invention are performed.
[0140] It should be noted that the computer-readable medium described in the present invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media can include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. This propagated data signal can take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, or any suitable combination thereof.
[0141] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0142] The modules described in the embodiments of the present invention may be implemented in software or hardware. The modules described may also be provided within a processor. For example, a processor may be described as comprising a status acquisition module, an information acquisition module, and an information display module. The names of these modules do not, in some cases, limit the modules themselves. For example, information acquisition may also be described as an "information synchronization module."
[0143] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiments, or may exist independently and not incorporated into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to execute any of the above-described information processing methods for a rear-seat in-vehicle display device.
[0144] The computer program product of the present invention includes a computer program, which, when executed by a processor, implements the information processing method applied to the rear-seat vehicle-mounted display device in the embodiment of the present invention.
[0145] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.
Claims
1. An information processing method applied to a rear-seat vehicle-mounted display device, characterized in that: include: acquiring a current state of an autonomous driving function from an autonomous driving system in response to a trigger operation of an operation key indicating an autonomous driving view on the display device; In response to the autonomous driving function being currently activated, obtaining real-time operating information corresponding to the autonomous driving function; The information type of the real-time operation information is identified, and a display mode preset for the information type and the real-time operation information are used to render a view displayed by the display device, and the real-time operation information is displayed through the view.
2. The method according to claim 1, characterized in that Also includes: Provide an interactive interface; In response to a rear passenger triggering an operation on a vehicle view operation key in the interactive interface, switching the interactive interface to display a vehicle real-time perception interface; In response to a rear passenger triggering an operation key indicating an autonomous driving view in the vehicle real-time perception interface, an operation is performed to obtain the current state of the autonomous driving function from the autonomous driving system.
3. The method according to claim 2, characterized in that The method further comprises: Obtain information about the vehicle's surroundings; Rendering the vehicle real-time perception interface according to the vehicle surrounding environment information, so as to display the vehicle surrounding environment information in the vehicle real-time perception interface; The vehicle surrounding environment information is a panoramic view or an augmented reality image, and the process of obtaining the panoramic view includes: obtaining environmental images of multiple directions around the vehicle collected by sensors installed on the vehicle, and generating a panoramic view based on the environmental images of the multiple directions; The process of obtaining an augmented reality image includes: obtaining environmental images in multiple directions around the vehicle collected by sensors installed on the vehicle; generating a panoramic view based on the stitching of the environmental images in multiple directions, and intercepting a current window image corresponding to the direction of the vehicle head from the panoramic view; obtaining navigation guidance information of the path ahead of the vehicle based on the vehicle's positioning information; and superimposing the navigation guidance information on the current window image in the form of a virtual information layer to generate an augmented reality image.
4. The method according to claim 1, wherein The acquiring of real-time operating information corresponding to the autonomous driving function includes: acquiring real-time operating information corresponding to the autonomous driving function from a front driver's in-vehicle display device and an autonomous driving system; wherein the future trajectory path and vehicle surrounding environment information are synchronously obtained from the front driver's in-vehicle display device; wherein the future trajectory path is planned by the automatic driving system based on the destination information and the vehicle's positioning information; A trajectory decision message is generated based on the future trajectory path, and the trajectory decision message is sent to the automatic driving system to receive trajectory decision information returned by the automatic driving system.
5. The method according to claim 4, characterized in that The identifying the information type of the real-time operation information, rendering a view displayed by the display device using a preset display mode for the information type and the real-time operation information, and displaying the real-time operation information through the view includes: generating an autonomous driving trajectory rendering image based on the future trajectory path and the vehicle surrounding environment information, identifying an information type of the autonomous driving trajectory rendering image as a graph type, rendering a view displayed on the display device using a graph display mode preset for the graph type and the autonomous driving trajectory rendering image, and displaying the autonomous driving trajectory rendering image through the view; The information type of the trajectory decision information is identified as a text type, and a text display mode preset for the text type and the trajectory decision information are used to render a view displayed by the display device, and the trajectory decision information is displayed through the view.
6. The method according to claim 5, characterized in that The generating of the autonomous driving trajectory rendering image based on the future trajectory path and the vehicle surrounding environment information includes: When the vehicle surrounding environment information is a panoramic view, identifying an expected driving trajectory corresponding to the future trajectory path from the panoramic view; annotating the expected driving trajectory in the panoramic view in a preset visualization manner to generate a spatially realistic autonomous driving trajectory rendering; In a case where the vehicle surrounding environment information is an augmented reality image, the future trajectory path is superimposed on the augmented reality image in the form of a virtual information layer to generate an augmented reality autonomous driving trajectory rendering image.
7. The method according to claim 5, characterized in that After displaying the trajectory decision information through the view, the method further includes: Determining a current driving state of the vehicle, and obtaining a preset explanation field for the current driving state; Using a preset decision explanation model, extracting parameters corresponding to the explanation field from the trajectory decision information, and generating explanation information for the trajectory decision information based on the extracted parameters; The text display mode and the explanation information are used to render a view displayed by the display device, and the explanation information is displayed through the view.
8. The method according to claim 7, characterized in that After displaying the explanation information through the view, the method further includes: In response to a rear passenger triggering an operation of a detailed explanation operation key in the view, obtaining a preset detailed explanation field for the current driving state; extracting parameters corresponding to the detailed explanation fields from the trajectory decision information using a preset decision explanation model, so as to generate detailed explanation information for the trajectory decision information based on the extracted parameters and the explanation information, or based on the extracted parameters; The text display mode and the detailed explanation information are used to render a view displayed by the display device, and the detailed explanation information is displayed through the view.
9. The method according to claim 5, characterized in that The rendering of a view displayed by the display device using the text display mode preset for the text type and the trajectory decision information, and displaying the trajectory decision information through the view includes: Determining a current driving state of the vehicle, and obtaining a preset detailed explanation field for the current driving state; extracting parameters corresponding to the detailed explanation field from the trajectory decision information using a preset decision explanation model, so as to generate detailed explanation information for the trajectory decision information based on the extracted parameters; The text display mode, the trajectory decision information and the detailed explanation information or the detailed explanation information are used to render a view displayed by the display device, and the trajectory decision information and the detailed explanation information or the detailed explanation information are displayed through the view.
10. An information processing device applied to a rear-seat vehicle-mounted display device, characterized in that: include: a state acquisition module, configured to acquire a current state of the autonomous driving function from the autonomous driving system in response to a triggering operation of an operation key indicating an autonomous driving view on the display device; an information acquisition module, configured to acquire real-time operation information corresponding to the autonomous driving function in response to the autonomous driving function being currently activated; The information display module is used to identify the information type of the real-time operation information, use the preset display mode for the information type and the real-time operation information, render the view displayed by the display device, and display the real-time operation information through the view.