Display method, intelligent cabin, vehicle, storage medium and program product

Abstract

The invention can be applied to the field of intelligent cabins, and particularly relates to a display method, an intelligent cabin, a vehicle, a storage medium and a program product, and the method comprises the steps: obtaining to-be-displayed instrument data and to-be-displayed central control data; rendering the instrument data and the central control data based on a first service in response to the situation that the abnormal condition affecting display is not detected, and then displaying the instrument data and the central control data; and in response to the detected abnormal condition influencing the display, rendering the instrument data based on a second service and then displaying the instrument data. Through the method, the stability of the display system is improved.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and more particularly to a display method and smart cockpit, vehicle, storage medium and program product. Background Technology

[0002] As vehicles gradually move towards low-carbon and intelligent development, the layout of vehicle cabins is becoming increasingly simplified. Integrating various functions of the vehicle cabin into the vehicle's central control device has become the mainstream trend in vehicle cabin design. These functions include: air conditioning control, seat adjustment, audio-visual adjustment, navigation, and instrument information display.

[0003] However, as the most important human-machine interaction device in the vehicle, the central control device has a large number of application software running on it, which is prone to malfunctions, resulting in abnormal display problems such as black screen, flickering screen, and distorted screen, which in turn prevents the vehicle's instrument information from being displayed normally, seriously affecting vehicle driving safety. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a display method and a smart cockpit, vehicle, storage medium and program product, which can improve the stability of the display.

[0005] According to a first aspect of the present disclosure, a display method is provided, comprising:

[0006] Acquire the instrument data and central control data to be displayed;

[0007] In response to the absence of any abnormal situation affecting the display, the instrument data and the central control data are rendered and displayed based on the first service;

[0008] In response to the detection of the anomaly affecting the display, the instrument data is rendered and displayed based on the second service.

[0009] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0010] In response to detecting an anomaly in the display process of the instrument data and / or the central control data based on the first service, the instrument data is rendered and displayed based on the second service; wherein, the display process includes at least one of the following: layer rendering, layer compositing, and image display.

[0011] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0012] In response to the detection of a system malfunction other than the first service, the instrument data is rendered and displayed based on the second service.

[0013] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0014] In response to detecting that the difference between the data to be displayed after rendering the initial data based on the first service and the initial data is greater than a preset difference threshold, the instrument data is rendered and displayed based on the second service; wherein, the initial data includes the instrument data and the central control data.

[0015] In some embodiments, the step of rendering and displaying the instrument data and the central control data based on the first service in response to the absence of detected abnormal conditions affecting the display includes:

[0016] In response to the absence of any abnormal situation affecting the display, the instrument data and the central control data are rendered and displayed based on the first service supported by the central processing unit, the layer processor, and the display processor.

[0017] The step of responding to the detection of an anomaly affecting the display by rendering and displaying the instrument data based on the second service includes:

[0018] In response to the detection of the anomaly affecting the display, the instrument data is rendered and displayed based on the second service supported by the central processing unit.

[0019] In some embodiments, the rendering and display of the instrument data and the central control data based on the first service supported by the central processing unit, the layer processor, and the display processor includes:

[0020] The instrument data and the central control data are rendered using the rendering services supported by the layer processor to obtain the rendered instrument layer and the rendered central control layer.

[0021] The rendered instrument layer and the rendered central control layer are composited using the compositing service supported by the display processor to obtain a composite display image;

[0022] The display image is displayed using the display services supported by the central processing unit.

[0023] According to a second aspect of the present disclosure, a smart cockpit is provided, comprising:

[0024] The acquisition module is used to acquire the instrument data and central control data to be displayed;

[0025] The first rendering and display module is used to render and display the instrument data and the central control data based on the first service in response to the absence of detected abnormal conditions affecting the display.

[0026] The second rendering and display module is used to render and display the instrument data based on the second service in response to the detection of the abnormal situation affecting the display.

[0027] The second rendering and display module is further configured to, in response to detecting an anomaly in the display process of the instrument data and / or the central control data based on the first service, render and display the instrument data based on the second service; wherein the display process includes at least one of the following: layer rendering, layer compositing, and image display.

[0028] The second rendering and display module is also used to render and display the instrument data based on the second service in response to detecting a system malfunction other than the first service.

[0029] The second rendering and display module is further configured to, in response to detecting that the difference between the data to be displayed after rendering the initial data based on the first service and the initial data is greater than a preset difference threshold, render and display the instrument data based on the second service; wherein the initial data includes the instrument data and the central control data.

[0030] The first rendering and display module is also used to render and display the instrument data and the central control data based on the first service supported by the central processing unit, the layer processor and the display processor in response to the absence of detected abnormal conditions affecting the display.

[0031] The second rendering and display module is further configured to, in response to the detection of the abnormal situation affecting the display, render and display the instrument data based on the second service supported by the central processing unit.

[0032] The first rendering and display module is further configured to use the rendering service supported by the layer processor to render the instrument data and the central control data respectively to obtain a rendered instrument layer and a rendered central control layer; use the compositing service supported by the display processor to composit the rendered instrument layer and the rendered central control layer to obtain a composite display image; and use the display service supported by the central processing unit to display the display image.

[0033] According to a third aspect of the present disclosure, a vehicle is provided, comprising:

[0034] processor;

[0035] Memory used to store computer programs or instructions;

[0036] The processor executes the computer program or instructions to implement the steps of the method described in the first aspect above.

[0037] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, the storage medium storing a computer program or instructions that, when executed by a processor, implement the steps of the method described in the first aspect above.

[0038] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program or instructions, which, when executed by a processor, implement the steps of the method described in the first aspect above.

[0039] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0040] In this embodiment, the vehicle detects whether any abnormal conditions affecting the display have occurred. If the normal screen display is unaffected, the first service renders and displays the instrument cluster data and central control data, providing a comprehensive view of all information. If an abnormal condition affects the screen display, the second service renders and displays only the instrument cluster data. Even in cases of display anomalies, this service can still display important instrument cluster information, improving the stability of the display system. Furthermore, compared to existing technologies that require an additional OSD chip or a screen with an OSD chip to handle instrument cluster information display issues, this embodiment is implemented using software processing, eliminating the need for an OSD and reducing hardware resource usage. The second service can further process the instrument cluster data before display, enhancing the flexibility and aesthetics of the display.

[0041] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0042] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0043] Figure 1 This is a schematic diagram of a vehicle cockpit in related technologies.

[0044] Figure 2 This is a schematic diagram of a central control screen in a vehicle cockpit, based on related technologies.

[0045] Figure 3This is a flowchart illustrating a display method according to an exemplary embodiment.

[0046] Figure 4 This is a schematic diagram illustrating a display processing based on a first service according to an exemplary embodiment.

[0047] Figure 5 This is a schematic diagram illustrating the normal display processing of a vehicle cockpit system according to an exemplary embodiment.

[0048] Figure 6 This is a schematic diagram illustrating an abnormal display of a vehicle cockpit system according to an exemplary embodiment.

[0049] Figure 7 This is a block diagram of an intelligent cockpit according to an exemplary embodiment.

[0050] Figure 8 This is a structural block diagram of a vehicle according to an exemplary embodiment. Detailed Implementation

[0051] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0052] Figure 1 This is a schematic diagram of a vehicle cockpit in related technologies. Figure 2 This is a schematic diagram of a central control screen in a vehicle cockpit, as shown in the relevant technology. Figure 1 As shown, the vehicle cabin contains only one central control screen 101, as... Figure 2 As shown, the upper left corner of the vehicle's central control screen 101 displays instrument information 201, while the area outside the upper left corner displays central control information 202 (e.g., navigation information, menu bar information, etc.). The vehicle's central control system integrates numerous applications (e.g., music software, call software, air conditioning software, etc.). When the software running on the central control system crashes or the display system malfunctions, the entire central control screen 101 may display abnormalities, affecting driving safety. For example, if the central control screen 101 flickers or displays a distorted image, it affects the accuracy of the user's observation of instrument information (driving safety information); in the case of a black screen, the user may even be unable to view the instrument information.

[0053] In this regard, the present disclosure provides a display method. Figure 3 This is a flowchart illustrating a display method according to an exemplary embodiment, such as... Figure 3 As shown, the method mainly includes the following steps:

[0054] S301. Obtain the instrument data and central control data to be displayed;

[0055] S302. In response to the absence of any abnormal situation affecting the display, the instrument data and the central control data are rendered and displayed based on the first service;

[0056] S303. In response to the detection of the abnormal situation affecting the display, the instrument data is rendered and displayed based on the second service.

[0057] The display method provided in this disclosure can be applied to smart cockpits including screens, such as vehicle cockpits, aircraft cockpits, and ship cockpits. In some possible implementations, the display method can be implemented by a processor calling computer-readable instructions stored in memory. In this disclosure, for ease of description, a vehicle cockpit is used as an example for illustration.

[0058] In this embodiment of the disclosure, the vehicle cabin includes a central control unit, which can adopt an operating system such as Android or iOS, and integrates many functions such as instrument applications, audio-visual references, and communication applications. The central control screen can support touch functionality to enhance the user's human-computer interaction experience.

[0059] In this embodiment of the disclosure, the instrument data to be displayed in the vehicle includes, but is not limited to: vehicle speed data, engine speed data, vehicle mileage data, vehicle gear data, fuel quantity data, coolant temperature data, light status data, battery status data, motor status data, and system fault data; wherein, system fault data may include engine fault data, brake system fault data, airbag system fault data, etc.

[0060] In this embodiment, the central control data to be displayed in the vehicle includes, but is not limited to: navigation data, multimedia data, monitoring data, Bluetooth connection data, and vehicle settings data. Among these, vehicle settings include seat adjustment data, air conditioning control data, vehicle driving mode selection data, and voice control settings data.

[0061] It should be noted that instrument panel data is usually real-time control information of the vehicle, used to ensure driving safety, and is characterized by real-time performance and high accuracy; central control data is usually entertainment and interactive information of the vehicle, used to enhance the interactive experience of the vehicle, and is characterized by a large amount of data.

[0062] In step S301, the vehicle can acquire the instrument data and central control data to be displayed in various ways. It can acquire the instrument data and central control data in real time, or it can acquire the instrument data and central control data upon receiving a display command. In this embodiment, when the vehicle acquires the instrument data and central control data in real time, the vehicle can acquire the instrument data and central control data at the same frequency, or it can acquire the instrument data and central control data at different frequencies. For example, the vehicle acquires the instrument data with high real-time requirements at a first sampling frequency and acquires the central control data with a large data volume at a second sampling frequency; wherein the first sampling frequency is higher than the second sampling frequency.

[0063] In this embodiment of the disclosure, abnormal situations affecting the display of the vehicle screen include, but are not limited to, black screen, flickering screen, and distorted screen. For example, a black screen caused by a system crash on the vehicle's central control unit; a flickering screen caused by a system lag on the vehicle's central control unit; and a distorted screen caused by a rendering program malfunction on the vehicle's central control unit.

[0064] In this embodiment of the disclosure, there are multiple ways to detect abnormal situations affecting the screen display. These include detecting whether there are any abnormalities in the process of displaying instrument data and / or central control data; detecting whether there are any abnormalities in the operation of the vehicle's cockpit system; and detecting whether there are any abnormalities in the rendered data sent for display.

[0065] In this embodiment of the present disclosure, after the vehicle performs the aforementioned step S301 to obtain the instrument data and central control data to be displayed, it can detect abnormal situations that affect the display. If the vehicle does not detect any abnormal situations that affect the display, it performs the aforementioned step S302 to render and display the instrument data and central control data based on the first service; if the vehicle detects any abnormal situations that affect the display, it performs the aforementioned step S303 to render and display the instrument data based on the second service.

[0066] In this embodiment of the disclosure, the first service is a different service from the second service, which may be due to different hardware resources required or different levels of complexity of the supported rendering functions.

[0067] In some embodiments, the first service can be configured as a service that is processed and supported by multiple processors in collaboration, and the second service can be configured as a service that is independently rendered and displayed and supported by a single processor. For example, the first service is a rendering service supported by a Graphics Processing Unit (GPU) and a Data Processing Unit (DPU), and the second service is a service supported by a Central Processing Unit (CPU).

[0068] In other embodiments, the first service can be configured to be supported by a more complex rendering function with strong graphics processing capabilities, while the second service can be configured to be supported by a simpler rendering function with higher graphics processing efficiency. For example, the first service is a rendering function that includes functions such as layer drawing and layer compositing, while the second service is a rendering function that only includes layer drawing functions.

[0069] In this embodiment, in response to the absence of any abnormal situation affecting the display, the vehicle renders and displays the instrument data and central control data based on the first service. Since the first service is set as a service that works in cooperation with multiple processors, drawing, compositing, and display can be performed separately by multiple processors, ensuring the efficiency of graphics processing even when the amount of data to be rendered is large. In response to the detection of any abnormal situation affecting the display, the vehicle renders and displays the instrument data based on the second service. Since the second service is set as a service that is processed independently by a single processor, the processor independently completes the rendering and display processing of the instrument data, simplifying the display process and enhancing the stability of the display.

[0070] In this embodiment of the disclosure, in response to the absence of any abnormal situation affecting the display, the vehicle renders and displays the instrument data and central control data based on the first service. Since the first service is set to support rendering functions with strong graphics processing capabilities, it can perform a series of operations such as multiple drawing, compositing, and scaling on the instrument data and central control data, resulting in good display effects. In response to the detection of any abnormal situation affecting the display, the vehicle renders and displays the instrument data based on the second service. Since the second service is set to support simple rendering functions with high graphics processing efficiency, it can quickly render and display the instrument data, resulting in high display efficiency.

[0071] In this embodiment of the present disclosure, in response to the detection of an abnormal situation affecting the display, the vehicle may immediately switch to the second service to render and display the instrument data upon detecting the abnormal situation; alternatively, it may wait for a preset time after detecting the abnormal situation, and if the abnormal situation affecting the display still cannot be restored to normal within the preset time, it may switch to the second service to render and display the instrument data.

[0072] In this embodiment, the vehicle can preset multiple custom display templates, and use a second service to rearrange and display the acquired instrument data using these custom display templates. For example, corresponding display templates can be predefined for the display styles of different car manufacturers to achieve personalized display of instrument information, increase display flexibility and aesthetics, and improve the human-machine interaction experience.

[0073] In related technologies, the main controller of the vehicle cockpit sends various vehicle-related data to the screen microcontroller unit (MCU) for processing and display via a Local Interconnect Network (LIN) bus. When the screen cannot receive image data sent by the main controller and cannot display it normally, the On Screen Display (OSD) chip converts the received instrument data into an image signal with a specific encoding format and sends the encoded image signal to the screen so that the screen can overlay the image corresponding to the instrument data onto the screen for display, ensuring that key information is still displayed during vehicle driving.

[0074] However, related technologies rely on OSD (On-Screen Display) for transmitting, receiving, and encoding instrument information to enable the display of instrument information in case of vehicle cockpit screen malfunctions. This hardware-based processing increases the hardware cost of the vehicle cockpit. Furthermore, since OSD can only perform image overlay functions and does not participate in the generation of image signals, it cannot change the resolution, color depth, or other attributes of the image signals, resulting in an uncustomizable and aesthetically unappealing screen display.

[0075] In this embodiment, the vehicle detects whether any abnormal conditions affecting the display have occurred. If the normal screen display is unaffected, the first service renders and displays the instrument cluster data and central control data, providing a comprehensive view of all information. If an abnormal condition affects the screen display, the second service renders and displays only the instrument cluster data. Even in cases of display anomalies, this service can still display important instrument cluster information, improving the stability of the display system. Furthermore, compared to existing technologies that require an additional OSD chip or a screen with an OSD chip to handle instrument cluster information display issues, this embodiment is implemented using software processing, eliminating the need for an OSD and reducing hardware resource usage. The second service can further process the instrument cluster data before display, enhancing the flexibility and aesthetics of the display.

[0076] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0077] In response to detecting an anomaly in the display process of the instrument data and / or the central control data based on the first service, the instrument data is rendered and displayed based on the second service; wherein, the display process includes at least one of the following: layer rendering, layer compositing, and image display.

[0078] In this embodiment of the present disclosure, the process of displaying instrument data and / or central control data based on the first service of the vehicle can be as follows: after rendering the instrument data and central control data, the image is directly sent for display, for example, displaying instrument information and central control information in different areas of the screen respectively; or after rendering the instrument data and / or central control data respectively, the rendered instrument layer and central control layer are combined and the image is sent for display, for example, displaying instrument information overlaid in the central control information display area.

[0079] In this embodiment of the disclosure, the vehicle performs anomaly detection on the display process of instrument data and / or central control data based on the first service. This can be done by detecting the layer rendering process of the instrument data and / or central control data. If a rendering anomaly is detected during the rendering of the instrument layer and / or central control layer, it can be determined that the display process of instrument data based on the first service is abnormal. Alternatively, it can be done by detecting the layer compositing of instrument data and / or central control data. If a compositing anomaly is detected during the compositing of the instrument layer and / or central control layer, it can be determined that the display process of instrument data based on the first service is abnormal. Layer rendering anomalies include at least: lack of rendering resources, rendering process timeout, rendering incompatibility, etc.; layer compositing anomalies include at least: lack of compositing layers, compositing process conflicts, incompatible formats of the layers to be composited, etc.

[0080] For example, when the vehicle's GPU makes a calculation error on the instrument data and / or central control data, when the GPU initially synthesizes ghosting in the layers of instrument data and / or central control data, or when the vehicle's DPU malfunctions during the rotation or cropping of the instrument data and / or central control data layers to be synthesized, it can be considered that the vehicle has detected an abnormality in the display process of instrument data and / or central control data based on the first service.

[0081] Figure 4 This is a schematic diagram illustrating a display processing based on a first service according to an exemplary embodiment, such as... Figure 4 As shown, the vehicle's display system includes a layer processor and a display processing unit, which work together to render and display instrument data and central control data.

[0082] In this embodiment of the disclosure, the layer processor can render multiple applications (APPs) (e.g., central control application 1, central control application 2, and instrument application 3) to obtain rendered application layer 1, application layer 2, and application layer 3. The compositing management service (Surface Flinger) performs compositing, scaling, and rotation operations on the above multiple application layers and sends the composited layer 11 to the display processing unit (e.g., DPU). The display processing unit will further combine the uncomposited layer 11 in the GPU with layer 4 to obtain a display image, which is then displayed on the screen through a display hardware interface (e.g., an interface that supports digital display protocols).

[0083] For example, the vehicle uses the GPU to render data from navigation, music, and instrument cluster applications to obtain navigation, music, and instrument cluster layers. The compositing management service then performs compositing, scaling, and rotation operations on these layers and sends them to the DPU. The DPU further composites any uncomposited layers from the GPU to obtain the display image, which is then displayed on the screen.

[0084] It should be noted that the entire display process based on the first service is complex, from the application's layer rendering to the compositing management service and the display processing unit. A problem in any of these processes can cause the vehicle's instrument information to fail to display correctly.

[0085] In this embodiment of the disclosure, the vehicle can detect and display the instrument data and / or central control data after rendering it based on the second service if any abnormality occurs in any part of the process of displaying instrument data and / or central control data in the first service. This helps to detect abnormal situations that affect the display in advance, reduces the occurrence of screen display abnormalities, and improves the real-time performance and stability of abnormal situation handling.

[0086] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0087] In response to the detection of a system malfunction other than the first service, the instrument data is rendered and displayed based on the second service.

[0088] It should be noted that, since the vehicle cockpit control system usually integrates many application software such as instrument application, navigation, audio and video application, Bluetooth application, and communication application, when multiple applications are running at the same time, or when the user frequently operates the application software displayed on the vehicle screen, or when some applications occupy a large amount of device resources, the vehicle cockpit control system is very prone to lag, crashes, and other issues, resulting in black screen, distorted screen, or screen freeze.

[0089] In this embodiment of the disclosure, the vehicle responds to the detection of a system malfunction other than the first service by detecting that the application software of the vehicle detection system is stuck or crashed; or the vehicle detects that the system resource occupancy rate exceeds a predetermined occupancy threshold (e.g., system crash or system stop responding); or the vehicle detects that the frequency of user screen operations exceeds a predetermined operation frequency.

[0090] In this embodiment of the disclosure, when the vehicle detects a system malfunction other than the first service, it renders and displays the instrument data based on the second service. That is, even if the vehicle's system lags or crashes, it can switch to the second service and display the instrument data (vehicle safety data). This reduces the amount of data processed when the vehicle system is malfunctioning, which is conducive to releasing the vehicle system's computing resources and thus helps the vehicle display system to quickly return to normal. While ensuring that the vehicle can still display instrument information in the event of a display malfunction, the stability of the display system operation is further improved.

[0091] In some embodiments, the step of rendering and displaying the instrument data based on a second service in response to detecting an anomaly affecting the display includes:

[0092] In response to detecting that the difference between the data to be displayed after rendering the initial data based on the first service and the initial data is greater than a preset difference threshold, the instrument data is rendered and displayed based on the second service; wherein, the initial data includes the instrument data and the central control data.

[0093] In this embodiment, there are several ways to detect the difference between the initial data (instrument data and central control data) processed by the vehicle based on the first service and the data to be displayed. This can include detecting differences in information such as icons and values ​​between the initial data and the data to be displayed, or detecting differences in information such as resolution, color, and contrast between the initial data and the data to be displayed. If the difference exceeds a preset difference threshold, the vehicle renders and displays the instrument data based on the second service. The method for determining the difference can be either the difference method or the ratio method; this disclosure does not limit this approach.

[0094] As mentioned above Figure 4As shown, the data to be displayed by the vehicle based on the rendering of the first service is cached in the output buffer of the display management unit, and then forwarded to the buffer of the screen hardware so that the screen can display the rendered instrument data and central control data. In this embodiment of the present disclosure, the vehicle can use the layer processor to read back the data to be displayed cached in the display management unit and / or the buffer of the screen hardware. If the data to be displayed is inconsistent with the initial data before the rendering of the first service (e.g., applying layer 1) (e.g., if the icons in applying layer 1 are distorted after rendering, or the values ​​are incorrect after rendering, etc.), the abnormal situation affecting the display can be confirmed to have been detected. It should be noted that if the data to be displayed after rendering based on the display process of the first service differs too much from the initial data before rendering (e.g., icon distortion, value changes, etc.), it may lead to a decrease in screen display resolution, display data errors, or even screen distortion, resulting in inaccurate data and poor display effect on the screen.

[0095] In this embodiment of the disclosure, after the vehicle obtains the data to be displayed, it compares the data to the initial data before rendering. If the difference is less than or equal to a preset difference threshold (the data displayed on the screen is accurate and the display effect is good), the screen displays relatively comprehensive instrument information and central control information normally. If the difference is greater than the preset difference threshold (the data displayed on the screen is inaccurate and the display effect is poor), the core instrument information of the vehicle is rendered and displayed, thereby improving the accuracy and clarity of the screen display.

[0096] In some embodiments, the step of rendering and displaying the instrument data and the central control data based on the first service in response to the absence of detected abnormal conditions affecting the display includes:

[0097] In response to the absence of any abnormal situation affecting the display, the instrument data and the central control data are rendered and displayed based on the first service supported by the central processing unit, the layer processor, and the display processor.

[0098] The step of responding to the detection of an anomaly affecting the display by rendering and displaying the instrument data based on the second service includes:

[0099] In response to the detection of the anomaly affecting the display, the instrument data is rendered and displayed based on the second service supported by the central processing unit.

[0100] In this embodiment of the disclosure, in response to the absence of any abnormal situation affecting the display, the vehicle renders and displays the instrument data and central control data based on the first service supported by the central processing unit, the layer processor, and the display processor. Figure 5 This is a schematic diagram illustrating the normal display processing of a vehicle cockpit system according to an exemplary embodiment, such as... Figure 5 As shown, the vehicle cockpit display system includes a multi-display management service (central processing unit), a layer processor, and a display processing unit (display processor). When the vehicle cockpit system is displaying normally, they work together to render and display vehicle instrument data and central control data.

[0101] In this embodiment, the layer processor can render multiple applications (APPs) (e.g., central control application 1, central control application 2, and instrument application 3) to obtain rendered application layer 1, application layer 2, and application layer 3. The compositing management service performs compositing, scaling, and rotation operations on the above multiple application layers and sends the composited layer 11 and layer 4 to the multi-display management service. If the vehicle does not detect any abnormal conditions affecting the display, the multi-display management service sends layer 11 and layer 4 to the display processing unit (e.g., DPU). The display processing unit will further composit the uncomposited layer 11 and layer 4 in the GPU to obtain the display image, which is then displayed on the screen through the display hardware interface. The multi-display management service can also send instructions to notify the lightweight instrument display application that layer 5 does not need to be displayed.

[0102] In this embodiment of the disclosure, in response to detecting the abnormal situation affecting the display, the vehicle renders and displays the instrument data based on a second service supported by the central processing unit. Figure 6 This is a schematic diagram illustrating a display malfunction of a vehicle cockpit system according to an exemplary embodiment, such as... Figure 6 As shown, the vehicle cockpit display system includes a multi-display management service (central processing unit), a layer processor, a display processing unit (display processor), and a lightweight instrument display application (central processing unit). In the event of an abnormal display in the vehicle cockpit system, these components work together to render and display vehicle instrument data and central control data.

[0103] In this embodiment, the layer processor can render multiple applications (e.g., central control application 1, central control application 2, and instrument application 3) to obtain rendered application layer 1, application layer 2, and application layer 3. The compositing management service performs compositing, scaling, and rotation operations on the above multiple application layers and sends the composited layer 11 and layer 4 to the multi-display management service. If the vehicle detects an abnormal situation affecting the display, the multi-display management service can send a request to the lightweight instrument display application to obtain layer 5 (instrument layer) obtained by the lightweight instrument display application using the central processing unit to draw the image. The obtained layer 5 corresponds to the instrument data and is sent to the display processing unit for display on the screen through the display hardware interface.

[0104] It should be noted that the first service is a rendering service supported by multiple processors (e.g., CPU, GPU, DPU, etc.), which involves multiple rendering and compositing operations on multiple layers of multiple applications. The rendering process is numerous and complex, consumes a lot of device resources, and is prone to conflicts, rendering errors, compositing errors, and other problems. The second service is a rendering service supported by a single processor (e.g., CPU). The second service has fewer rendering processes, only rendering and displaying instrument data. It consumes fewer device resources and is less prone to process conflicts, multi-layer rendering, compositing errors, etc.

[0105] In this embodiment of the present disclosure, when the vehicle cockpit system display is normal, the vehicle utilizes a first service supported by multiple processors for rendering and display, which helps to improve the display capability and effect of the vehicle cockpit screen; when the vehicle cockpit system display is abnormal, the vehicle utilizes a second service supported by a single processor for rendering and displaying instrument information, which helps to ensure that instrument information can still be displayed even when the vehicle cockpit screen display is abnormal, thereby improving the stability and security of the screen display.

[0106] In some embodiments, the rendering and display of the instrument data and the central control data based on the first service supported by the central processing unit, the layer processor, and the display processor includes:

[0107] The instrument data and the central control data are rendered using the rendering services supported by the layer processor to obtain the rendered instrument layer and the rendered central control layer.

[0108] The rendered instrument layer and the rendered central control layer are composited using the compositing service supported by the display processor to obtain a composite display image;

[0109] The display image is displayed using the display services supported by the central processing unit.

[0110] As mentioned above Figure 5 , Figure 6 As shown, the vehicle uses the rendering service supported by the layer processor to render the instrument data and the central control data respectively, to obtain the rendered instrument layer (e.g., layer 4) and the rendered central control layer (e.g., layer 11); the rendering service supported by the display processor (display processing unit) is used to composite the rendered instrument layer (layer 4) and the rendered central control layer (layer 11), and the composite display image is sent to the display service supported by the central processing unit through the display hardware interface for display.

[0111] In this embodiment of the disclosure, when the vehicle cockpit system is displaying normally, the vehicle uses a first service supported by multiple processors for rendering and display. Each processor processes the generation, composition, and display of layers respectively. The multi-processor has strong processing power, which helps to improve the display capabilities and effects of the screen.

[0112] Figure 7 This is a block diagram of a smart cockpit according to an exemplary embodiment. For example... Figure 7 As shown, the intelligent cockpit 700 mainly includes:

[0113] The acquisition module 701 is used to acquire the instrument data and central control data to be displayed;

[0114] The first rendering and display module 702 is used to render and display the instrument data and the central control data based on the first service in response to the absence of detected abnormal conditions affecting the display.

[0115] The second rendering and display module 703 is used to render and display the instrument data based on the second service in response to the detection of the abnormal situation affecting the display.

[0116] The second rendering and display module 703 is further configured to, in response to detecting an abnormality in the display process of the instrument data and / or the central control data based on the first service, render and display the instrument data based on the second service; wherein the display process includes at least one of the following: layer rendering, layer compositing, and image display.

[0117] The second rendering and display module 703 is also used to render and display the instrument data based on the second service in response to detecting a system malfunction other than the first service.

[0118] The second rendering and display module 703 is further configured to, in response to detecting that the difference between the data to be displayed after rendering the initial data based on the first service and the initial data is greater than a preset difference threshold, render and display the instrument data based on the second service; wherein the initial data includes the instrument data and the central control data.

[0119] The first rendering and display module 702 is also used to render and display the instrument data and the central control data based on the first service supported by the central processing unit, the layer processor and the display processor in response to the absence of detected abnormal conditions affecting the display;

[0120] The second rendering and display module 703 is further configured to, in response to the detection of the abnormal situation affecting the display, render and display the instrument data based on the second service supported by the central processing unit.

[0121] The first rendering and display module 702 is further configured to use the rendering service supported by the layer processor to render the instrument data and the central control data respectively to obtain a rendered instrument layer and a rendered central control layer; use the compositing service supported by the display processor to composit the rendered instrument layer and the rendered central control layer to obtain a composite display image; and use the display service supported by the central processing unit to display the display image.

[0122] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0123] Figure 8 This is a structural block diagram of a vehicle according to an exemplary embodiment. (Refer to...) Figure 8 The vehicle 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input / output (I / O) interface 812, sensor component 814, and communication component 816.

[0124] Processing component 802 typically controls the overall operation of device 800, such as operations associated with at least one of display, telephone call, data communication, camera operation, and recording operation. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0125] Memory 804 is configured to store various types of data to support operation on device 800. Examples of such data include at least one of the following: instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, and videos. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0126] Power supply component 806 provides power to various components of device 800. Power supply component 806 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 800.

[0127] Multimedia component 808 includes a screen that provides an output interface between device 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen may be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0128] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0129] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, and buttons. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0130] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or one of its components, the presence or absence of user contact with device 800, orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include an optical sensor, such as a complementary metal-oxide-semiconductor (CMOS) or charge-coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include, but is not limited to, at least one of the following: an accelerometer, a gyroscope, a magnetometer, a pressure sensor, and a temperature sensor.

[0131] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as Wi-Fi, 4G, 5G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.

[0132] In an exemplary embodiment, device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0133] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including executable instructions or a computer program, which can be executed by the processor 820 of the device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0134] A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform any of the display methods described above in the embodiments of this disclosure.

[0135] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the display methods described above in this disclosure.

[0136] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0137] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A display method characterized by comprising: The method comprises: acquiring instrument data and central control data to be displayed; in response to no abnormal situation affecting display being detected, rendering and then displaying the instrument data and the central control data based on a first service; in response to the abnormal situation affecting display being detected, rendering and then displaying the instrument data based on a second service.

2. The method of claim 1, wherein, The rendering and then displaying the instrument data based on the second service in response to the abnormal situation affecting display being detected comprises: in response to an abnormality occurring in a display flow of the instrument data and / or the central control data based on the first service being detected, rendering and then displaying the instrument data based on the second service; wherein the display flow comprises at least one of the following: layer rendering, layer composition, image display.

3. The method of claim 1, wherein, The rendering and then displaying the instrument data based on the second service in response to the abnormal situation affecting display being detected comprises: in response to a system running abnormality other than the first service being detected, rendering and then displaying the instrument data based on the second service.

4. The method of claim 1, wherein, The rendering and then displaying the instrument data based on the second service in response to the abnormal situation affecting display being detected comprises: in response to a difference between display data obtained by rendering and then processing initial data based on the first service and the initial data being greater than a preset difference threshold, rendering and then displaying the instrument data based on the second service; wherein the initial data comprises the instrument data and the central control data.

5. The method according to any one of claims 1 to 4, characterized in that, The rendering and then displaying the instrument data and the central control data based on the first service in response to no abnormal situation affecting display being detected comprises: in response to no abnormal situation affecting display being detected, rendering and then displaying the instrument data and the central control data based on the first service supported by a central processing unit, a layer processing unit and a display processing unit; The rendering and then displaying the instrument data based on the second service in response to the abnormal situation affecting display being detected comprises: in response to the abnormal situation affecting display being detected, rendering and then displaying the instrument data based on the second service supported by the central processing unit.

6. The method of claim 5, wherein, The rendering and then displaying the instrument data and the central control data based on the first service supported by the central processing unit, the layer processing unit and the display processing unit comprises: rendering and then processing the instrument data and the central control data respectively based on a rendering service supported by the layer processing unit, to obtain rendered instrument layers and rendered central control layers; performing composition processing on the rendered instrument layers and the rendered central control layers based on a composition service supported by the display processing unit, to obtain a composed display image; displaying the display image based on a display service supported by the central processing unit.

7. An intelligent cabin, characterized in that, It comprises: an acquisition module, configured to acquire instrument data and central control data to be displayed; a first rendering and then displaying module, configured to, in response to no abnormal situation affecting display being detected, render and then display the instrument data and the central control data based on a first service; A second rendering display module is configured to display the instrument data based on a second service after rendering the instrument data in response to detecting the abnormal situation affecting the display.

8. A vehicle characterized by comprising: Comprise: a processor; a memory for storing computer programs or instructions; wherein the processor executes the computer programs or instructions to implement the steps of the method of any one of claims 1 to 6.

9. A non-transitory computer-readable storage medium storing a computer program or instructions, the computer program or instructions comprising the steps of: When the computer programs or instructions in the storage medium are executed by the processor, the steps of the method of any one of claims 1 to 6 are implemented.

10. A computer program product comprising computer programs or instructions, characterized in that, The computer programs or instructions are executed by the processor to implement the steps of the method of any one of claims 1 to 6.

Images