Display method, device and equipment of cabin adjustment interface and storage medium

Abstract

The application discloses a display method and device of a cabin adjustment interface, equipment and a storage medium, and belongs to the field of vehicle engineering. The method comprises the following steps: displaying a cabin background picture and / or a foreground blocking picture in the cabin adjustment interface, the cabin background picture presenting a cabin space with a three-dimensional perspective relationship; the foreground blocking picture presents a cabin foreground structure located in front of a three-dimensional seat model; in response to an adjustment operation on the seat, displaying the three-dimensional seat model above the cabin background picture, and driving the three-dimensional seat model to continuously move and / or rotate; wherein, in the process of moving and / or rotating the three-dimensional seat model, the cabin background picture and / or the foreground blocking picture remain static, and the part of the three-dimensional seat model overlapping with the cabin foreground structure is continuously blocked by the foreground blocking picture, and the blocked area changes accordingly with the movement and / or rotation of the three-dimensional seat model. The method can reduce the rendering load of the cabin adjustment interface.

Description

Technical Field

[0001] This application relates to the field of vehicle engineering, and in particular to a method, apparatus, device, and storage medium for displaying a cockpit adjustment interface. Background Technology

[0002] With the development of intelligent cockpit technology, vehicle HMIs (Human Machine Interfaces) have gradually evolved from traditional two-dimensional icons, buttons, and lists to spatialized interactive interfaces that include 3D vehicle models, 3D cockpits, and real-time lighting and shadow effects. In seat adjustment scenarios, the user interface increasingly needs to utilize a 3D cockpit perspective to intuitively display seat position, rotation angle, and spatial relationships, thereby enhancing the realism and immersion of the user experience (UX).

[0003] In related technologies, to achieve the aforementioned spatialized interactive effects, a real-time 3D cockpit rendering scheme is adopted. Elements such as the vehicle interior space, floor, door panels, dashboard, seats, shadows, and ambient light are constructed into 3D models, and a real-time rendering engine (such as Unity) is used to render a dynamic 3D image with realistic perspective and lighting effects. During real-time rendering, the system needs to handle a large number of model, material, lighting, and shadow calculations, relying on the high-performance collaborative work of the Graphics Processing Unit (GPU) and the Central Processing Unit (CPU) to provide smooth visual feedback during user interaction.

[0004] However, real-time rendering solutions place high demands on the performance of in-vehicle hardware. For embedded hardware environments such as in-vehicle central control screens and rear screens, excessively high real-time rendering loads may lead to decreased frame rates, increased memory pressure, longer loading times, and increased heat generation and power consumption. Summary of the Invention

[0005] This application provides a method, apparatus, device, and storage medium for displaying a cockpit control interface, which can reduce the rendering load of the cockpit control interface. The technical solution is as follows: According to one aspect of this application, a method for displaying a cockpit adjustment interface is provided, the method comprising: The cockpit adjustment interface displays a cockpit background image and / or a foreground occlusion image. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional seat model. In response to an adjustment operation on the seat, a three-dimensional seat model is displayed above the cockpit background screen, and the three-dimensional seat model is driven to move and / or rotate continuously; During the movement and / or rotation of the 3D seat model, the cabin background image and / or the foreground occlusion image remain stationary, and the portion of the 3D seat model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly as the 3D seat model moves and / or rotates.

[0006] According to another aspect of this application, a display device for a cockpit adjustment interface is provided, the device comprising: The display module is used to display the cockpit background image and / or the foreground occlusion image in the cockpit adjustment interface. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional seat model. The interaction module is used to receive adjustment commands for the seat; The display module is configured to display a three-dimensional seat model above the cockpit background screen in response to an adjustment operation on the seat, and to drive the three-dimensional seat model to move and / or rotate continuously. During the movement and / or rotation of the 3D seat model, the cabin background image and / or the foreground occlusion image remain stationary, and the portion of the 3D seat model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly as the 3D seat model moves and / or rotates.

[0007] According to another aspect of this application, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set being loaded and executed by the processor to implement the cockpit adjustment interface display method as described above.

[0008] According to another aspect of this application, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, code set, or instruction set is stored therein, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the cockpit adjustment interface display method as described above.

[0009] According to another aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the cockpit control interface display method provided in various alternative implementations of the above aspects.

[0010] The beneficial effects of the technical solution provided in this application include at least the following: The cockpit adjustment interface is divided into multiple layers: a cockpit background image and a 3D seat model; or a 3D seat model and a foreground occlusion image; or a cockpit background image, a 3D seat model, and a foreground occlusion image. The cockpit adjustment interface is rendered by combining a 2D image and a 3D model, so that the interface rendering only needs to render the variable part of the interface: the 3D seat model, without rendering the usually fixed content: the background and / or foreground. When the user adjusts the seat, the 3D seat model in the interface moves or rotates accordingly, while the 2D cockpit background image and foreground occlusion image remain unchanged. This provides the user with a 3D spatial operation experience while reducing the number of models that need to be rendered, thus reducing the rendering load. The 2D cockpit background image has a 3D perspective, providing the user with a sense of 3D space; the foreground occlusion image layer overlays the 3D seat model, providing the user with a sense of spatial enclosure. The occlusion relationship between the 3D seat model and the foreground occlusion image further enhances the user's sense of 3D space. While ensuring the 3D display effect, the 3D rendering load is reduced, the interface display frame rate is guaranteed, the memory pressure of the vehicle system is reduced, the loading time of the interface and operation response is reduced, the heat generation of the vehicle system is reduced, and the power consumption of the vehicle system is reduced. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a schematic diagram of an in-vehicle terminal provided in an exemplary embodiment of this application; Figure 2 This is a flowchart of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 3 This is a schematic diagram of a cockpit background screen provided in an exemplary embodiment of this application; Figure 4 This is a schematic diagram of a cockpit adjustment interface provided in an exemplary embodiment of this application; Figure 5 This is a schematic diagram of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 6 This is a flowchart of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 7This is a schematic diagram of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 8 This is a flowchart of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 9 This is a schematic diagram of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 10 This is a flowchart of a cockpit adjustment interface display method provided in an exemplary embodiment of this application; Figure 11 This is a schematic diagram of the structure of a cockpit adjustment interface display device provided in an exemplary embodiment of this application; Figure 12 This is a schematic diagram of the structure of an in-vehicle terminal provided in an exemplary embodiment of this application.

[0013] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. Detailed Implementation

[0014] To make the technical solution and advantages of this application clearer, the embodiments of this application will be described in further detail below.

[0015] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0016] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0017] Figure 1 A block diagram of an in-vehicle terminal 110 provided in an exemplary embodiment of this application is shown.

[0018] The vehicle-mounted terminal 110 has a display program for a cockpit adjustment interface installed and running. The display program for the cockpit adjustment interface can run to implement the cockpit adjustment interface display method provided in the embodiments of this application.

[0019] The vehicle-mounted terminal 110 includes a first memory and a first processor. The first memory stores a display program for the cockpit adjustment interface; the display program for the cockpit adjustment interface is called and executed by the first processor to implement the cockpit adjustment interface display method provided in this application. The first memory may include, but is not limited to, the following: Random Access Memory (RAM), Read Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), and Electrically Erasable Programmable Read-Only Memory (EEPROM).

[0020] The first processor can consist of one or more integrated circuit chips. Optionally, the first processor can be a general-purpose processor, such as a central processing unit (CPU) or a network processor (NP). Optionally, the first processor can implement the cockpit control interface display method provided in this application by running programs or code.

[0021] For example, the vehicle terminal is connected to or equipped with a display screen, and the vehicle terminal displays the cockpit adjustment interface provided in the embodiments of this application through the display screen; the display screen may be at least one of the following: central control display screen, HUD (Head-Up Display), rear entertainment screen, and passenger display screen.

[0022] Figure 2 This is a flowchart illustrating a cockpit adjustment interface display method provided in an exemplary embodiment of this application. The method can be implemented by, for example... Figure 1 The method is executed by the vehicle-mounted terminal shown. The method includes the following steps.

[0023] Step 210: Display the cockpit background image and / or foreground occlusion image in the cockpit adjustment interface. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional seat model.

[0024] The cockpit adjustment interface is a functional page within the HMI (Hardware Interface) used for visual operation and status adjustment of the vehicle seats. The cockpit adjustment interface displays the interior view of the cockpit through a 3D model rendering. Users can control the seat's forward and backward movement, rotation, and combination mode switching via UI (User Interface) controls. The cockpit adjustment interface can include at least one of the following: cockpit background (such as spatial structure, floor, dashboard), seat models (driver's seat, passenger seat, rear seats, etc.), foreground obstructions (such as door edges, center console area), and HMI controls (such as adjustment buttons, mode switching buttons, and back buttons).

[0025] For example, the cockpit adjustment interface is used to adjust the position and / or state of various components within the cockpit. For instance, the cockpit adjustment interface uses the seat as the primary interaction object, providing real-time movement, rotation, or state switching functions for the seat. The screen in the cockpit adjustment interface displays the interior view of the cockpit and shows controls or mode options related to seat adjustment. Furthermore, the cockpit adjustment interface also supports adjusting the air conditioning, including adjusting the air conditioning mode, air vent direction, and temperature. Additionally, the cockpit adjustment interface supports adjusting the cabin lighting, including modifying the lighting mode, color, and turning it on and off.

[0026] The cockpit adjustment interface in this application embodiment can also be a seat combination adjustment interface, a seat scene mode switching interface, etc. Any interface that includes a cockpit screen with a three-dimensional spatial sense and requires real-time operation of the cockpit components can be the cockpit adjustment interface in this application embodiment.

[0027] This application embodiment uses the cockpit adjustment interface for adjusting seats as an example for illustration. For instance, the cockpit adjustment interface displays a three-dimensional spatial view of the cockpit. This three-dimensional spatial view dynamically displays the seats within the cockpit, showing the user the spatial relationships within the cockpit under different seat positions, and demonstrating the dynamic process of seat position changes, allowing the user to intuitively view the changes in the overall space within the cockpit when adjusting the seats.

[0028] Since rendering the entire cockpit space in real time is too demanding, in order to both display the cockpit space in real time and reduce the rendering load, the method provided in this application pre-renders the fixed parts in the three-dimensional space as a two-dimensional image, only rendering the component models that will change, and then superimposing the component model images obtained in real time with the fixed two-dimensional images to obtain the three-dimensional space image. This ensures that the three-dimensional space image can display the state of the cockpit space in real time while reducing the rendering load of the three-dimensional space image.

[0029] For example, when the component model that changes in the cockpit adjustment interface is the seat model, the part that is fixed in the 3D space and located below the seat model (which will not obscure the seat model) is pre-rendered to obtain the cockpit background image; the part that is fixed in the 3D space and located above the seat model (which will obscure the seat model) is pre-rendered to obtain the foreground occlusion image.

[0030] For example, when the changing component models in the cockpit adjustment interface are the seat model and the air conditioning fan blade model, the part that is fixed in the 3D space and located below the seat model and the air conditioning fan blade model (without obscuring the seat model and the air conditioning fan blade model) is pre-rendered to obtain the cockpit background image; the part that is fixed in the 3D space and located above the seat model and the air conditioning fan blade model (which will obscure the seat model or the air conditioning fan blade model) is pre-rendered to obtain the foreground occlusion image.

[0031] For example, a 3D scene model of all components in the cockpit space can be pre-constructed, including at least the seat model. Following the preset display perspective of the cockpit adjustment interface, the 3D scene model of the cockpit is photographed: continuously adjusting the state of the seat model, a 3D scene image is taken for each seat state, resulting in multiple 3D scene images. Based on these multiple 3D scene images, the component models of the 3D seat models that remain unchanged and do not obscure any seat state are designated as the background models. The component models of the 3D seat models that remain unchanged and obscure any seat state are designated as the foreground models. The seat models and foreground models are deleted from the 3D scene model, retaining the background model. The background model is photographed according to the preset display perspective of the cockpit adjustment interface to obtain the cockpit background image. The seat models and background models are deleted from the 3D scene model, retaining the foreground model. The foreground model is photographed according to the preset display perspective of the cockpit adjustment interface to obtain the foreground occlusion image.

[0032] As can be seen, the cockpit background image and the foreground occlusion image are also model rendering images with a three-dimensional spatial sense. However, the cockpit background image and the foreground occlusion image are not rendered in real time, but are rendered in advance. The vehicle terminal does not need to render the background model and the foreground model in real time. It only needs to read the locally pre-stored two-dimensional cockpit background image and two-dimensional foreground occlusion image, thereby reducing the number of models that need to be rendered in the real-time rendering process of the vehicle terminal and reducing the rendering load.

[0033] The cockpit adjustment interface in this embodiment is obtained by overlaying multiple layers. Optionally, the cockpit adjustment interface includes a cockpit background image and a 3D seat model above the cockpit background image. Alternatively, the cockpit adjustment interface includes a foreground occlusion image and a 3D seat model below the foreground occlusion image. Alternatively, the cockpit adjustment interface includes a cockpit background image, a 3D seat model above the cockpit background image, and a foreground occlusion image above the 3D seat model.

[0034] Taking a cockpit adjustment interface consisting of three layers as an example, the first layer is the cockpit background image, the second layer is the 3D seat model, and the third layer is the foreground occlusion image. The cockpit adjustment interface is obtained by stacking the first to the third layers from bottom to top.

[0035] The first layer of the cockpit background image and the third layer of the foreground occlusion image are pre-rendered two-dimensional images. When the vehicle terminal loads the cockpit adjustment interface, it can directly read the locally stored cockpit background image and foreground occlusion image without performing three-dimensional rendering. It only needs to render the three-dimensional seat model, and then overlay the rendered three-dimensional seat model image with the pre-stored cockpit background image and foreground occlusion image to obtain the cockpit adjustment interface.

[0036] For example, the cockpit background image and the foreground occlusion image were created offline.

[0037] Optionally, the cabin background image may include at least one of the following: the interior space structure, the ground area, the dashboard or front cabin area, the door or side area, ambient lighting, ground shadows, seat reference position, camera perspective, etc.

[0038] The interior space structure refers to the overall spatial framework inside the cabin, which may include the floor, pillars, and the relative positions and outlines of the front and rear seats. The interior space is the physical space where the seat model is placed; by overlaying the seat model, it can be visually positioned within a real cabin environment. Ground shadows may include the projections of the seats or other cabin structures onto the ground.

[0039] When creating the cockpit background image, a preset rendering camera is used based on the target HMI display view. The parameters of the preset rendering camera may include at least one of the following: camera position; camera rotation angle; pitch angle; field of view; reference point; aspect ratio; and output resolution.

[0040] The reference point can be the center position or reference point of the preset rendering camera's observation or focusing in 3D space. Optionally, the reference point can be the center position of the seat area or a fixed point in the cockpit space. The reference point facilitates spatial alignment of the cockpit background image, foreground occlusion image, and 3D seat model.

[0041] By pre-rendering, information about the cockpit space, ground, ambient lighting, and shadows that does not require real-time changes is output as a 2D image. This 2D image has a visually three-dimensional perspective relationship, and therefore can also be called a 2D pseudo-3D background layer, i.e., the cockpit background image. Separating the complex but non-interactive background space from real-time 3D rendering reduces the number of models, materials, lighting calculations, and shadow calculations required during real-time execution.

[0042] Additionally, during the offline production phase, foreground occlusion images are generated based on camera perspectives that are the same as or match the cockpit background image.

[0043] The foreground occlusion element is used to simulate structures or occlusion relationships in front of a real-time 3D seat model within a virtual cockpit space. The foreground occlusion element is smaller than the cockpit background element. Alternatively, the foreground occlusion element may be the same size as the cockpit background element, but a portion of the foreground occlusion element may be completely transparent. For example, pixels in the foreground occlusion element other than the foreground model may be completely transparent.

[0044] The foreground occlusion can include at least one of the following: the foreground spatial structure of the cabin; the edge of the door; the edge of the ground; the center console or armrest area; the partial structure of the side panel; and other occlusion elements that need to be located in front of the 3D seat model.

[0045] The foreground occlusion feature can be configured with an alpha channel, allowing image content to be displayed only where occlusion is needed, while remaining transparent in areas where occlusion is not required. A lightweight 2D layer is used to simulate partial occlusion of the seat model within a 3D cockpit space in the final image, making the real-time 3D seat model appear to be placed within a virtual cockpit space with a sense of enclosure.

[0046] After the 3D seat model layer is rendered, a foreground occlusion layer is overlaid in front of it. This foreground occlusion layer, through a transparency channel or masking area, only covers the specific area of ​​the 3D seat that needs to be occluded. For example, when the seat model visually overlaps with the foreground structure of the virtual cockpit, the foreground occlusion layer can cover a portion of the seat, making it appear to be behind the cockpit structure. This solves the problem of lacking a foreground-background occlusion relationship when overlaying a 3D model with a cockpit background image, making the 3D seat model visually "fitted" into a virtual cockpit space, creating a more natural sense of spatial enclosure.

[0047] For example, the foreground structure of the cabin includes at least one of the following: door edge, ground edge, center console area, armrest area, and side panel partial structure. The foreground obscured image displays image content only in the area corresponding to the foreground structure of the cabin, and does not display image content in the remaining areas of the foreground obscured image.

[0048] For example, such as Figure 3The image shown is a standalone 2D cockpit background image 301. This background layer was created using a pre-rendering method and includes lighting, ground position, shadows, camera perspective, and cockpit space structure from a realistic 3D scene.

[0049] like Figure 4 The image shown is the final fusion effect of the 2D cockpit background image, the 3D seat model, and the 2D foreground occlusion image. The system overlays the real-time 3D seat model 302 onto the 2D cockpit background image 301, and overlays the 2D foreground occlusion image in front of the 3D seat model, making the seat appear to be placed in a virtual cockpit space.

[0050] Step 220: In response to the adjustment operation of the seat, display a three-dimensional seat model above the cockpit background screen, and drive the three-dimensional seat model to move and / or rotate continuously.

[0051] During the movement and / or rotation of the 3D seat model, the cabin background image and / or foreground occlusion image remain stationary, and the part of the 3D seat model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly with the movement and / or rotation of the 3D seat model.

[0052] A 3D seat model can include at least one of the following models: driver's seat model; passenger seat model; rear left seat model; rear middle seat model; rear right seat model; row of seats model; seat component models such as armrests, leg rests, and headrests.

[0053] The 3D seat model has adjustable attributes, including at least one of the following: position; rotation angle; backrest angle; leg rest status; visible / hidden status; combination relationship; animation status.

[0054] It should be noted that the "seat" in this embodiment can be understood as any cabin component related to the seat. For example, in addition to the main seat body, the seat in this embodiment may also include at least one of the following components: a small table, leg rest, foot rest, wrist rest, armrest box, storage box, seat fan, seat air conditioner, seat light, seat massage component, seat phone holder, seat adjustment lever, steering wheel, storage space related to the seat (such as a storage box or refrigerator door), additional seat components (such as a cabin mattress), seat rails, etc. Adjustment operations on the seat can be operations on any of the above components, driving the corresponding component in the three-dimensional seat model to move / rotate / change state based on the adjustment operation.

[0055] Users can adjust the seat attributes through operation. For example, users can adjust the aforementioned attributes of the seat using the UI controls in the cockpit adjustment interface. Alternatively, users can adjust the aforementioned attributes of the seat using the adjustment knobs / buttons located on the seat. The in-vehicle terminal can determine the user's adjustment command by detecting the state of the adjustment knobs / buttons.

[0056] By rendering 3D seat models in real time, the real-time interactivity of seat objects is preserved, allowing the seats in the screen to move or switch states synchronously when users adjust the seats in the cockpit adjustment interface.

[0057] The visibility of the seats is determined by the system based on the vehicle configuration. Different vehicle models have different seat layouts. The system has a preset universal seat layout template, and the system can adjust the visibility of some seats in this template according to the vehicle's seat configuration signals to match the seat layout displayed on the cockpit adjustment interface with the actual seat layout of the vehicle model.

[0058] For example, the system receives vehicle seat configuration signals and controls the display and hiding of different three-dimensional seat models or seat component models according to the seat configuration.

[0059] Seat configuration signals may include: current vehicle configuration; number of seats; seat arrangement; presence of a middle seat; presence of an independent seat; whether driver's seat rotation is supported; whether passenger seat rotation is supported; whether a large living room mode is supported; and whether a row of seats is supported.

[0060] Optionally, users can remove or install some seats themselves and synchronize the seat status through the cockpit adjustment interface. Alternatively, the system can automatically update the seat configuration based on the detected seat status.

[0061] In one optional embodiment, in response to a seat configuration switch, at least one 3D seat model is switched from a displayed state to a hidden state, and / or, at least one 3D seat model is switched from a hidden state to a displayed state. The cockpit background image and foreground occlusion image remain unchanged before and after the seat configuration switch.

[0062] For example, the seat configuration switching is triggered based on the vehicle's seat configuration signal, which indicates at least one of the following: vehicle model configuration, number of seats, seat arrangement, presence of a middle seat, whether seat rotation is supported, and whether a row of seats is supported.

[0063] For example, the adjustment operations for the seats may include at least one of the following: adjusting the fore-and-aft position of a single seat; adjusting the seat back angle; adjusting the leg rest, armrest, or headrest status; switching between seat combination modes such as driver's seat rotation, passenger seat rotation, and large living room; displaying different seat models according to different seat configurations; and reusing different seat layouts in the same cabin background.

[0064] For example, such as Figure 5 As shown, when the vehicle is configured with two independent rear seats, the left and right independent seat models are displayed, while the middle seat model is hidden. When the vehicle is configured with three seats in a row, the left, middle, and right seat models or the row seat model are displayed. When entering the driver's seat rotation mode, the model corresponding to the driver's seat rotation state is displayed or the driver's seat model is driven to rotate. When entering the passenger seat rotation mode, the model corresponding to the passenger seat rotation state is displayed or the passenger seat model is driven to rotate.

[0065] For example, after a user selects a seat adjustment or seat combination adjustment function in the cabin adjustment interface, the system obtains the corresponding seat control command. The seat control command may include: moving the seat forward and backward; rotating the seat; adjusting the backrest angle; extending or retracting the leg rest; switching seat combination modes; large living room mode; driver's seat rotation mode; and passenger's seat rotation mode.

[0066] The system updates the position, rotation angle, attitude, and visibility or animation status of the 3D seat model in real time based on seat control commands. This allows the final cockpit adjustment interface to combine the performance advantages of a 2D background with the real-time interactive advantages of a 3D seat model.

[0067] For example, in response to receiving an adjustment operation for the seat, the three-dimensional seat model is controlled to move or rotate according to the adjustment operation. During the movement or rotation of the three-dimensional seat model, the model image of the three-dimensional seat model is rendered in real time, and a series of multiple frames of dynamic images of the three-dimensional seat model are displayed on the cockpit adjustment interface.

[0068] It should be noted that during the continuous movement and / or rotation of the 3D seat model, the cockpit background and foreground occlusion images remain stationary. Optionally, during the continuous movement and / or rotation of the 3D seat model, multiple consecutive frames of the cockpit adjustment interface can be captured. By comparing these frames, it can be observed that only the 3D seat model changes in the interface; the preset 2D images (cockpit background / foreground occlusion) do not change accordingly. The cockpit background / background model and the foreground occlusion / foreground model in the interface remain unchanged.

[0069] For example, the cockpit background also includes the ground area, ambient lighting effects, and ground shadows. The ground area and ground shadows remain stationary as the 3D seat model moves and / or rotates.

[0070] Optionally, since the cockpit background and foreground occlusion images in this embodiment are pre-rendered, if the shadow of the 3D seat model is pre-rendered onto the cockpit background, the shadow portion of the 3D seat model in the cockpit adjustment interface may not change with the dynamic changes of the 3D seat model during its movement and / or rotation. If the shadow of the 3D seat model is rendered along with the 3D seat model, there is no projection relationship between the shadow of the 3D seat model and the cockpit background or foreground occlusion. For example, part of the shadow of the 3D seat model should be projected onto the side door of the cockpit. Since the door is perpendicular to the ground, the seat shadow should be deflected at the side door position; however, the method in this embodiment only renders the 3D seat model and not the side door, so the projection of the 3D seat model is directly projected onto the ground without deflection. Therefore, when the rendered shadow is directly superimposed on the cockpit background, the overlapping position of the seat shadow and the side door will be seen, and the shadow will not be deflected.

[0071] For example, this application embodiment only uses the three-dimensional seat model as an example of the component that changes in the cockpit adjustment interface. When there are other components that change in the cockpit adjustment interface, the three-dimensional model of the component can be displayed in the cockpit adjustment interface in the same way as the three-dimensional seat model.

[0072] Optionally, this method can also be used to implement at least one of the following interfaces: in-vehicle comfort control interfaces, such as control interfaces for seat heating, ventilation, massage, zero gravity, and rest modes; in-vehicle space mode display interfaces, such as display interfaces for large living room mode, cinema mode, and meeting mode; vehicle cabin status display interfaces in remote vehicle control via mobile terminal applications; device control visualization interfaces in smart homes or smart spaces; real-time three-dimensional interactive interfaces on low-computing-power terminals; and two-dimensional and three-dimensional hybrid rendering scenes in game, digital twin, virtual display, and AR (Augmented Reality) / VR (Virtual Reality) auxiliary interfaces.

[0073] In summary, the method provided in this application divides the cockpit adjustment interface into multiple layers: a cockpit background image and a 3D seat model; or a 3D seat model and a foreground occlusion image; or a cockpit background image, a 3D seat model, and a foreground occlusion image. The cockpit adjustment interface is obtained by combining a 2D image and a 3D model for rendering, so that interface rendering only needs to render the variable part of the interface: the 3D seat model, without rendering the usually fixed content of the interface: the background and / or foreground. When the user adjusts the seat, the 3D seat model in the interface moves or rotates accordingly, while the 2D cockpit background image and the foreground occlusion image remain unchanged. This provides the user with a 3D spatial operation experience while reducing the number of models that need to be rendered, thus reducing the rendering load. The 2D cockpit background image has a 3D perspective relationship, providing the user with a sense of 3D space; the foreground occlusion image layer covers the 3D seat model, providing the user with a sense of spatial enclosure. Through the occlusion relationship between the 3D seat model and the foreground occlusion image, the user is further provided with a sense of 3D space. While ensuring the 3D display effect, the 3D rendering load is reduced, the interface display frame rate is guaranteed, the memory pressure of the vehicle system is reduced, the loading time of the interface and operation response is reduced, the heat generation of the vehicle system is reduced, and the power consumption of the vehicle system is reduced.

[0074] The method provided in this application provides a two-dimensional and three-dimensional layered rendering method for use in interfaces such as seat adjustment, seat combination adjustment, and seat scene mode switching in in-vehicle HMIs. This method pre-renders non-real-time interactive content such as the vehicle interior space, ground, lighting, and shadows as the cabin background image, retains the adjustable seat as a real-time three-dimensional model layer, and overlays a two-dimensional foreground occlusion layer in front of the three-dimensional model. This reduces the amount of real-time three-dimensional computation and memory usage while achieving an in-vehicle HMI screen with a sense of spatial enclosure, occlusion relationships, and real-time seat interaction capabilities.

[0075] The method provided in this application pre-renders the cabin space, ground, lighting, and shadows—elements that do not require real-time interactive changes—as the cabin background image, thereby reducing the number of real-time rendering objects and real-time lighting and shadow calculations. Movable, adjustable, and combinable seat objects are retained as a real-time 3D model layer, thus preserving seat interactivity. A 2D foreground occlusion layer is added in front of the 3D seat model, causing the 3D seat to be partially occluded by the foreground structure, creating an enveloping effect similar to a real cabin space.

[0076] The method provided in this application embodiment enables the same set of cockpit background images and foreground occlusion images to adapt to different seat configurations, and completes the display of multiple configurations simply by showing, hiding, replacing or switching the state of the three-dimensional seat model layer.

[0077] The method provided in this application pre-renders the ground area, ambient lighting, and ground shadows in the cockpit background image and keeps the seat model stationary during interaction, thus avoiding the rendering load caused by real-time calculation of ground shadows and lighting. Simultaneously, the cockpit background provides a stable visual reference for the dynamically moving seat model, enhancing the realism of the seat being placed in the cockpit.

[0078] The method provided in this application embodiment obtains a foreground occlusion image by displaying image content only in the foreground structural area and making the rest of the area transparent, thereby simulating the front-to-back occlusion relationship between some components in the cockpit space and the seat model with extremely low resource consumption.

[0079] For example, seat adjustment controls can also be displayed on the cockpit adjustment interface, allowing users to perform adjustment operations based on these controls.

[0080] Figure 6 This is a flowchart illustrating a cockpit adjustment interface display method provided in an exemplary embodiment of this application. This method can be used for, for example... Figure 1 The vehicle-mounted terminal shown is based on... Figure 2 In the illustrated embodiment, step 210 may include step 211, and / or step 220 may include step 221.

[0081] Step 211: Display the cockpit background image and / or foreground obscured image in the cockpit adjustment interface, and overlay the seat adjustment controls on top of the foreground obscured image. The seat adjustment controls are used to trigger the adjustment operation.

[0082] For example, during Unity's real-time rendering phase, the rendering layers are organized in the following order: First layer: Cockpit background screen; The cockpit background screen is located at the bottom layer and is used to provide the basis for the cockpit space, ground, lighting and shadows.

[0083] The second layer: 3D seat model; the 3D seat model layer is located above the cockpit background screen and is used to display the movable seat model in real time according to user operation or seat configuration.

[0084] The third layer: Foreground occlusion view; the foreground occlusion view is located above the 3D seat model layer and is used to simulate the occlusion of the seat model by the foreground structure of the cockpit.

[0085] Fourth layer: Seat adjustment controls. Located at the top, the seat adjustment controls display interface elements such as mode buttons, seat adjustment buttons, temperature controls, and a back button.

[0086] The cockpit adjustment interface in this embodiment is obtained by overlaying multiple layers. Optionally, the cockpit adjustment interface includes a cockpit background image, a 3D seat model above the cockpit background image, and seat adjustment controls above the 3D seat model. Alternatively, the cockpit adjustment interface includes a foreground occlusion image, a 3D seat model below the foreground occlusion image, and seat adjustment controls above the foreground occlusion image. Or, the cockpit adjustment interface includes a cockpit background image, a 3D seat model above the cockpit background image, a foreground occlusion image above the 3D seat model, and seat adjustment controls above the foreground occlusion image.

[0087] For example, such as Figure 7 As shown, the cockpit adjustment interface consists of a cockpit background screen 303, a three-dimensional seat model 304, a foreground occlusion screen 305, and seat adjustment controls 306.

[0088] The seat adjustment controls can be overlaid on the 3D screen (the 3D screen is obtained by overlaying the cockpit background screen, the 3D seat model, and the foreground occlusion screen); the seat adjustment controls can also be displayed in a different position from the 3D screen. For example, the first area of ​​the cockpit adjustment interface is used to display the 3D screen, and the second area is used to display the cockpit adjustment interface. The first area and the second area do not overlap.

[0089] For example, the seat adjustment control includes at least one of the following controls: target seat selection control, fore-and-aft movement adjustment control, backrest angle adjustment control, and seat combination mode selection control.

[0090] Step 221: In response to the adjustment operation of the seat, display a three-dimensional seat model above the cockpit background screen, and drive the three-dimensional seat model to move and / or rotate continuously; during the movement and / or rotation of the three-dimensional seat model, the seat adjustment controls remain stationary.

[0091] For example, the seat adjustment controls, as UI controls of the interface, do not change as the seat moves and / or rotates.

[0092] In one alternative embodiment, the adjustment operation includes at least one of a fore-and-aft movement adjustment operation and a backrest angle adjustment operation.

[0093] In response to the forward and backward movement adjustment operation, the three-dimensional seat model is driven to continuously translate along the seat slide rail direction.

[0094] For example, in response to receiving a selection of the driver's seat, the fore-and-aft adjustment controls for the driver's seat are displayed; in response to dragging the fore-and-aft adjustment controls forward, the driver's seat is moved forward by a distance determined by the operation; simultaneously, the 3D seat model of the driver's seat on the cockpit adjustment interface moves forward synchronously, also by a distance determined by the operation. Optionally, the in-vehicle terminal can also synchronously detect the actual position of the driver's seat and control the position of the 3D seat model to follow the actual position of the driver's seat; in this way, if the driver's seat movement device malfunctions, the driver's seat displayed on the cockpit adjustment interface will also be unable to move, ensuring that the seat status displayed on the cockpit adjustment interface is synchronized with the actual seat status. The above example only illustrates moving the seat forward; moving the seat backward, to the left, or to the right follows the same principle.

[0095] In response to the backrest angle adjustment operation, the backrest of the 3D seat model is driven to rotate continuously relative to the seat cushion of the 3D seat model.

[0096] For example, in response to receiving a selection of the driver's seat, the driver's seat backrest angle adjustment controls are displayed; in response to dragging the backrest angle adjustment controls to tilt the seat back, the driver's seat tilts back, with the tilt angle determined by the operation distance; simultaneously, the 3D seat model of the driver's seat on the cockpit adjustment interface tilts back synchronously, with the tilt angle also determined by the operation distance. Optionally, the in-vehicle terminal can also synchronously detect the actual tilt angle of the driver's seat and control the pitch state of the 3D seat model to follow the actual state of the driver's seat; in this way, if the driver's seat pitch device malfunctions, the driver's seat displayed on the cockpit adjustment interface will also be unable to tilt, ensuring that the seat state displayed on the cockpit adjustment interface is synchronized with the actual seat state. The above is only an example of seat tilting back; the same principle applies to seat tilting forward.

[0097] In one alternative embodiment, the adjustment operation includes a seat combination mode switching operation.

[0098] In response to a seat combination mode switching operation, at least two 3D seat models are driven to move and / or rotate continuously to the target combination position. The seat combination mode includes at least one of a driver's seat rotation mode, a passenger seat rotation mode, and a large living room mode.

[0099] The driver's seat rotation mode allows you to control the driver's seat to rotate left or right to a specified angle. For example, you can control the driver's seat to rotate 90° to the right or 180° backward. Similarly, the passenger seat rotation mode allows you to control the passenger seat to rotate left or right to a specified angle.

[0100] The "Large Living Room" mode can simultaneously control the rotation of at least two seats in the cabin, rotating them to a preset angle. For example, the "Large Living Room" mode rotates the driver's and front passenger's seats 180° backward, restoring the rear seats to their original positions, so that the front and rear seats are arranged opposite each other.

[0101] For example, in response to receiving an operation to activate the large living room mode, the driver's seat and the passenger seat are controlled to rotate 180° backward; at the same time, the three-dimensional seat models of the driver's seat and the passenger seat on the cockpit adjustment interface are synchronously rotated 180° backward.

[0102] In one alternative embodiment, the number of three-dimensional seat models is at least two; the three-dimensional seat models include at least two of the following: a driver's seat model, a passenger seat model, and a rear seat model.

[0103] In response to an adjustment operation on the target seat, the corresponding 3D seat model is driven to move and / or rotate continuously. Meanwhile, other 3D seat models remain stationary.

[0104] As illustrated above, when a user needs to adjust one of the seats, they can first select that seat and then perform the adjustment operation. At this time, in the 3D seat model displayed on the cockpit adjustment interface, only the 3D seat model corresponding to that seat will move or rotate, while the other 3D seat models will remain stationary.

[0105] In summary, the method provided in this application embodiment controls the visibility of different three-dimensional seat models or component models through seat configuration signals, enabling the same set of two-dimensional background layers and two-dimensional foreground occlusion layers to be reused for different seat configurations.

[0106] The method provided in this application embodiment allows the cockpit adjustment interface to display various seat adjustment functions in real time. By driving a 3D seat model to continuously translate and rotate, the method displays the seat's forward and backward movement, pitch and rotation, and left and right rotation. It also supports the selection of multiple seat models, such as driver's seat rotation, passenger seat rotation, and a large living room mode. This provides an intuitive and vivid visual interaction method for intelligent cockpit scenarios, allowing users to preview changes in seat layout under different spatial modes in real time, enhancing user experience and scene immersion.

[0107] During the movement and / or rotation of the 3D seat model, the perspective direction of the 3D seat model remains consistent with the 3D perspective relationship presented by the cabin background image.

[0108] To achieve this effect, this application also provides a configuration method for the three-dimensional seat model and the rendering camera. Figure 8 This is a flowchart illustrating a cockpit adjustment interface display method provided in an exemplary embodiment of this application. This method can be used for, for example... Figure 1 The vehicle-mounted terminal shown is based on... Figure 2 In the illustrated embodiment, steps 201 to 202 may be included before step 210.

[0109] Step 201: Obtain the pre-rendered camera parameters corresponding to the cockpit background image.

[0110] For example, the cockpit background image and / or foreground occlusion image are two-dimensional images pre-rendered based on the 3D cockpit scene using the same pre-rendered camera parameters. The 3D cockpit scene includes the vehicle interior space structure, ground area, dashboard area, door area, ambient lighting, and ground shadows.

[0111] For example, the cockpit background image is obtained by rendering the background model using a pre-rendered camera. The foreground occlusion image is obtained by rendering the foreground model using a pre-rendered camera.

[0112] Since the cockpit background image is pre-rendered offline based on a specific camera viewpoint, while the 3D seat model layer is rendered in Unity by a real-time 3D camera, it is necessary to establish a visual alignment relationship between the two.

[0113] By obtaining the pre-rendered camera parameters corresponding to the cockpit background image, the spatial perspective relationship of the cockpit background image can be determined. Setting the pre-rendered camera parameters to the real-time camera of the 3D seat model can make the 3D seat model and the cockpit background image have the same spatial perspective relationship.

[0114] Optionally, since the cockpit background image and the foreground occlusion image are pre-rendered based on the same pre-rendered camera parameters, step 202 can also be replaced by obtaining the pre-rendered camera parameters corresponding to the foreground occlusion image.

[0115] Step 202: Determine the real-time camera parameters for displaying the 3D seat model based on the pre-rendered camera parameters.

[0116] The real-time camera parameters include at least one of the following: camera reference point, pitch angle, horizontal angle, displacement, and field of view.

[0117] The system sets real-time 3D camera parameters based on the pre-rendered camera parameters of the cockpit background image. These real-time 3D camera parameters include: camera reference point; camera pitch angle; camera horizontal angle; camera displacement; camera field of view; camera cropping range; scaling factor of the 3D seat model; and ground reference point of the 3D seat model.

[0118] In one alternative embodiment, after driving the three-dimensional seat model to move and / or rotate continuously, the method may further include: dynamically fine-tuning real-time camera parameters according to the target position of the three-dimensional seat model after movement and / or rotation; wherein, the dynamic fine-tuning includes adjusting at least one of camera reference point, pitch angle and displacement.

[0119] During seat adjustment or seat combination switching, the system can dynamically fine-tune parameters such as the reference point, pitch angle, and displacement of the real-time 3D camera based on the seat model's position and the target display effect. This ensures that the position, scale, and perspective of the 3D seat model in the cockpit adjustment interface are consistent with the ground, shadows, and cockpit structure in the cockpit background image. This resolves the perspective misalignment issue between the cockpit background image and the real-time 3D seat model layer, making the 3D seat visually positioned within the cockpit space represented by the cockpit background image.

[0120] For example, if the real-time camera is positioned directly in front of the cockpit, when the seat moves forward, the distance between the seat and the real-time camera decreases. The seat will appear enlarged in the rendered image, and this enlarged seat will not match the size of the cockpit background. Therefore, the reference point of the real-time camera can be fine-tuned. For instance, the reference point of the real-time camera can be controlled to move forward synchronously with the seat, ensuring that the seat's size remains unchanged during the forward movement, thus matching the seat with the cockpit background. Exemplarily, the fine-tuning method for the real-time 3D camera can be determined based on a preset strategy.

[0121] For example, the display position and size of the cockpit background image are tied to the display area of ​​the cockpit adjustment interface. During the dynamic fine-tuning of real-time camera parameters, the display position and size of the cockpit background image remain unchanged.

[0122] For example, during the real-time rendering phase, the cockpit background image is displayed on the cockpit adjustment interface via screen space projection.

[0123] Screen-space projection refers to binding the position, size, and perspective of the cockpit background image to screen coordinates or the camera output image, rather than treating it as a planar model in ordinary 3D space that undergoes perspective changes with camera movement. Through screen-space projection, the cockpit background image maintains a stable position and fixed perspective within the cockpit adjustment interface, preventing background layer drift, deformation, or perspective misalignment caused by real-time 3D camera parameter fine-tuning. This ensures that the cockpit background image maintains consistent visual perspective with the offline pre-rendering stage during real-time operation, providing a stable reference for subsequent 3D seat model alignment.

[0124] Subsequently, the system loads a 3D seat model based on the current seat adjustment scenario or seat configuration.

[0125] For example, such as Figure 9As shown, the cockpit background image 303 is displayed at a fixed position in screen space and does not change with the real-time camera of the 3D seat model 304. For example, the cockpit background image 303 is bound to the screen coordinates according to four anchor points, and does not change with the fine-tuning of the real-time camera. The real-time camera parameters of the 3D seat model 304 are aligned with the pre-rendered camera parameters of the cockpit background image, coinciding the reference points of the real-time camera and the pre-rendered camera.

[0126] In summary, the method provided in this application provides a fixed two-dimensional background perspective by projecting it into the screen space, and dynamically fine-tunes the three-dimensional model layer using parameters such as the three-dimensional camera reference point, pitch angle, displacement, and field of view, so that the three-dimensional seat and the two-dimensional background remain spatially consistent.

[0127] The method provided in this application aligns the parameters of the real-time camera with the parameters of the pre-rendered camera, ensuring the perspective consistency of the 3D image in the cockpit adjustment interface. By matching key parameters such as reference points, pitch angles, and field of view, it ensures that the perspective of the real-time 3D rendering is completely consistent with the perspective of the 2D pre-rendered background, thus solving the perspective misalignment problem when merging 2D images with 3D.

[0128] The method provided in this application can compensate for visual deviations caused by changes in the model's position when the seat model moves significantly by dynamically fine-tuning real-time camera parameters. Even when the seat moves to the edge of the frame or is far from the camera, the perspective relationship between the seat and the cabin background can still maintain high-precision alignment, improving visual stability.

[0129] The method provided in this application binds the cockpit background image to the screen space, decoupling it from the dynamically adjusted real-time 3D camera. This ensures that the cockpit background image is always stably displayed on the interface, without displacement or scaling due to camera adjustments, thus avoiding background drift or screen flicker.

[0130] In an alternative embodiment, the cockpit adjustment interface is further post-processed to make the cockpit adjustment interface more uniform when composed of multiple layers.

[0131] In Unity real-time rendering, the cockpit background and foreground occlusion images typically need to be processed together with the 3D seat model layer into the unified post-processing pipeline. The unified post-processing pipeline can include one or more of the following: ACES Tone Mapping, exposure, contrast, Gamma (Gamma Correction), Gain (Gain Adjustment), Bloom, color correction, and LUT (LookUp Table).

[0132] Since the cockpit background and foreground occlusion are pre-rendered offline based on the target's viewpoint, lighting, ground shadows, and spatial perspective, they already contain the target's display effect. If such 2D layers directly enter Unity's global post-processing pipeline, they may be affected again by tone mapping, exposure, contrast, gamma, gain, or LUTs, resulting in a discrepancy between the final displayed color and the pre-rendered target color.

[0133] Therefore, in this embodiment, the cockpit background image and / or foreground occlusion image are marked as layers that need to maintain the target display effect. For such layers, the system performs pre-compensation color transformation before they enter the unified post-processing pipeline.

[0134] Figure 10 This is a flowchart illustrating a cockpit adjustment interface display method provided in an exemplary embodiment of this application. This method can be used for, for example... Figure 1 The vehicle-mounted terminal shown is based on... Figure 2 In the illustrated embodiment, steps 203 to 204 may be included before step 210.

[0135] Step 203: Before displaying the cockpit background image and / or the foreground occlusion image, perform pre-compensation color transformation on the image data corresponding to the cockpit background image and the image data corresponding to the foreground occlusion image.

[0136] In this process, the direction of the pre-compensated color transformation is opposite to the direction of the unified post-processing color transformation.

[0137] For example, after overlaying the cockpit background image, the 3D seat model, and the foreground occlusion image to obtain a 3D image, a unified post-processing is required. This post-processing may alter the color, brightness, and other image parameters of the cockpit background and foreground occlusion images, resulting in distortion of the cockpit background image in the post-processed 3D image. To ensure that the cockpit background and foreground occlusion images in the post-processed 3D image maintain the target image effect, a pre-compensation color transformation needs to be performed on the cockpit background and / or foreground occlusion images before post-processing. This pre-compensation color transformation is used to offset the adjustments made to the cockpit background and / or foreground occlusion images during post-processing, ensuring that the output cockpit background and / or foreground occlusion images match the target image effect.

[0138] In one alternative embodiment, the pre-compensated color transformation is determined by substituting the target display color into the inverse transformation of the corresponding positive color transformation in the unified post-processing to obtain the pre-compensated color.

[0139] The inverse transformation includes at least one of the following: analytical inverse solution of tone mapping curve, matrix inverse transformation, reverse lookup table lookup, piecewise function fitting, and iterative solution.

[0140] The goal of pre-compensation is to make the displayed color of the 2D layer as close as possible to the preset target color after passing through a unified post-processing pipeline.

[0141] The unified post-processing pipeline is abstracted as a function F, and the target display color is represented as C. target The pre-compensation color before entering the post-processing pipeline is represented as C. pre Then the post-processed display color satisfies: C display =F(C pre ) In order to make C display Try to get as close to C as possible target System calculation: C pre =F - ¹(C target ) Among them, F - ¹ indicates the inverse or approximately inverse color transformation corresponding to the current post-processing parameters.

[0142] If the post-processing pipeline F contains an analytical ACES (Academy Color Encoding System) tone map, the system can use an analytical inverse solution to calculate the pre-compensated color; if the post-processing pipeline F contains a complex LUT or multiple color adjustment parameters, the system can use a one-dimensional LUT, a three-dimensional LUT, piecewise fitting, iterative solution, or error minimization to obtain an approximate inverse transformation.

[0143] Using the above method, after Unity's global post-processing, the final displayed colors of the two-dimensional pseudo-three-dimensional background layer and the two-dimensional foreground occlusion layer are closer to the preset target colors, thereby improving the visual fusion consistency between the two-dimensional layer and the three-dimensional seat model layer.

[0144] In one implementation, if the unified post-processing pipeline contains ACES Fitted curves, then the ACES tone mapping curves can be analytically inversely solved.

[0145] If a positive tone mapping can be represented as: y = x × (a × x + b) / [x × (c × x + d) + e] Where x represents the linear color component before entering the ACES tone mapping; y represents the color component after ACES tone mapping; and a, b, c, d, and e represent the ACES curve fitting parameters.

[0146] To obtain the pre-compensated color, x needs to be deduced from the target color y. The above formula can be rearranged into a quadratic equation: (ac×y)×x²+(bd×y)×xe×y=0 x is obtained by solving the quadratic equation and is used as the pre-compensated color component.

[0147] To prevent excessively large inverse resolution in the highlighted areas, the system can set an upper limit threshold for y. For example, to limit y to between 0 and a preset upper limit: y=clamp(y,0,y max ) Among them, y max This is a preset upper limit threshold. This method can avoid issues such as overexposure, numerical overflow, or abnormal colors during the reverse calculation process.

[0148] In another implementation, if the post-processing pipeline adopts the Hill ACES Fitted form, the forward color processing link can be divided into three stages: 1. Input matrix transformation, 2. RRT (Reference Rendering Transform) / ODT (Output Device Transform) curve processing, and 3. Output matrix transformation.

[0149] The input matrix is ​​used to convert the input color to the ACES-related color space; the RRT / ODT curve is used for reference rendering transformation and output display transformation; and the output matrix is ​​used to convert the processed color to the output display space.

[0150] During pre-compensation, the system performs reverse processing in the reverse order of the forward link: 1. First, cancel the output matrix; 2. Then, perform channel-by-channel inverse solution of the RRT / ODT curve; 3. Finally, cancel the input matrix.

[0151] This reverse link can be represented as: C pre =InputMat - ¹(RRTODT) - ¹(OutputMat) - ¹(C target ))) Among them, C target Indicates the target display color; C pre Indicates the pre-compensation color before entering the unified post-processing pipeline; OutputMat - ¹ denotes the inverse of the output matrix; RRTODT - ¹ indicates the reverse or approximately reverse transformation of the RRT / ODT curve; InputMat - ¹ denotes the inverse of the input matrix.

[0152] The matrix parameters and curve parameters can be determined based on the actual Unity rendering pipeline, ACES version, project color space configuration, and display device parameters.

[0153] In some implementations, the unified post-processing pipeline F may include not only ACES tone mapping, but also multiple processing steps such as exposure, contrast, gamma, gain, LUT, bloom, and color correction. In this case, the complete post-processing pipeline may be difficult to solve precisely using a single analytical formula.

[0154] In this situation, the system can employ an approximate reverse compensation method. Approximate reverse compensation methods include, but are not limited to: one-dimensional LUT reverse lookup; three-dimensional LUT reverse lookup; piecewise function fitting; polynomial fitting; iterative solution; error minimization solution; and parameter optimization based on the difference between the target color and the displayed color.

[0155] The objective of approximate reverse compensation is: minimize|F(C pre )-C target | Where F represents the current unified post-processing pipeline; C pre Indicates the pre-compensation color to be solved; C target Indicates the target display color; |F(C pre )-C target | indicates the error between the displayed color after post-processing and the target color.

[0156] By using the above approximation method, even if the post-processing pipeline is relatively complex, it is possible to obtain a pre-compensated color that makes the final display color close to the target display color.

[0157] For example, the above-mentioned pre-compensated color transformation can be applied to at least one of the following two-dimensional layers that need to maintain the target display effect: cockpit background image; foreground occlusion image; screen space patch in cockpit adjustment interface; function prompt layer that needs to maintain the color of the design draft; pre-rendered shadow layer, light effect layer or mask layer that needs to be integrated with the three-dimensional model for display.

[0158] The system can determine which 2D layers need to undergo pre-compensation color transformation by using layer tags, material tags, shader types, resource configuration tables, or scene configuration data.

[0159] For layers that do not require strict adherence to the target display effect, the system may not perform pre-compensation; for background layers and foreground occlusion layers with high precision requirements, the system may perform higher precision inverse compensation; for performance-sensitive layers but with low color reproduction requirements, the system may perform lightweight inverse compensation.

[0160] Step 204: Perform unified post-processing on the complete screen of the cockpit adjustment interface.

[0161] For example, the processing parameters of the unified post-processing are dynamically adjusted according to the current seat adjustment scenario. The seat adjustment scenario includes at least one of seat position adjustment, driver's seat rotation, passenger seat rotation, large living room mode, and seat combination switching. The processing parameters include at least one of exposure, contrast, gamma, gain, and tone mapping parameters.

[0162] Because the number, position, rotation angle, brightness distribution, and visual focus of seats vary across different seat adjustment scenarios, using the same post-processing parameters may result in images that are too dark, overexposed, have abnormal contrast, or exhibit visual abrupt changes in some scenes. Therefore, different post-processing parameters can be used for different seat adjustment scenarios to ensure visual consistency in the cockpit adjustment interface.

[0163] For example, when a user adjusts the fore-and-aft position or backrest angle of a single seat, the seat model in the interface is relatively small and located in the center or slightly forward of the cabin background image, with a relatively uniform distribution of light and dark in the overall image; in this case, the post-processing parameters are set to medium exposure and standard contrast to clearly display the details of the seat and the sense of space in the background, avoiding local overexposure or underexposure caused by seat movement.

[0164] For example, when the driver's seat rotates, the seat model in the image will undergo significant changes in position and angle, possibly rotating from facing forward to facing the door or rear seats. At this time, the illuminated surface of the seat model may change drastically, causing some areas of the image to darken (such as the back of the seat) and others to brighten (such as the illuminated surface). Therefore, the post-processing parameters are adjusted to lower exposure (reducing brightness) and higher contrast to prevent overexposure of the illuminated surface of the seat during rotation. Simultaneously, increasing contrast highlights the seat's outline and rotational movement, maintaining visual stability in the image during the seat's rotation.

[0165] For example, when multiple seats (such as the driver's seat, front passenger seat, and rear seats) move and rotate simultaneously, forming a large open space layout, the multiple seat models in the interface may be distributed in different areas of the cabin. This can result in uneven overall image brightness and a scattered visual focus. In this case, the post-processing parameters are adjusted to higher exposure and lower contrast to increase the overall image brightness, ensuring all seat models are clearly displayed. Simultaneously, the contrast is reduced to soften the differences in brightness between the multiple seats, making the image appear softer and more unified, and preventing overly dark areas caused by overlapping shadows from multiple seats.

[0166] For example, when switching seat combination modes, significant visual changes may occur in the interface, such as the seat back reclining sharply or the leg rest extending. Switching seat combination modes is usually accompanied by abrupt changes in screen brightness and color distribution. Therefore, it's necessary not only to adjust exposure and contrast but also to dynamically adjust gamma and gain to compensate for potential color shifts or brightness jumps during the seat combination switch, ensuring a smooth and natural transition and avoiding abrupt white or black flashes in the image.

[0167] In summary, the method provided in this application uses the Inverse ACES Shader (Inverse Academy Color Encoding System Shader) and inverse compensation parameters such as exposure, contrast, Gamma, and Gain to perform pre-compensation on the two-dimensional layer, making it closer to the target visual effect after global post-processing.

[0168] The method provided in this application embodiment can dynamically adjust and compensate all Unity post-processing parameters in real time according to different seat adjustment scenarios, so as to keep the 2D / 3D fusion effect consistent in different scenarios.

[0169] In one optional embodiment, the cockpit adjustment interface display method provided in this application includes the following steps: S1: Generate a two-dimensional pseudo-three-dimensional background layer based on the real three-dimensional cockpit scene.

[0170] For example, during the offline production stage, a pre-rendered 3D cockpit scene is generated using preset pre-rendered camera parameters, outputting a 2D pseudo-3D background layer, i.e., the cockpit background image. This 2D pseudo-3D background layer visually possesses a 3D perspective relationship. It contains complete elements of the 3D cockpit scene, including the vehicle's interior space structure, ground, dashboard, doors, ambient lighting, and ground shadows.

[0171] S2: Generate a two-dimensional foreground occlusion layer based on the same viewpoint.

[0172] For example, during the offline production phase, a two-dimensional foreground occlusion layer is obtained by rendering the foreground model based on the same or matching pre-rendered camera parameters as in S1. The two-dimensional foreground occlusion layer is used to simulate structures located in front of the real-time 3D seat model in the virtual cockpit space (such as door edges, ground edges, center console area, armrest area, etc.). The two-dimensional foreground occlusion layer contains transparency channels, displaying image content only in areas where occlusion is required.

[0173] S3: Establish the hierarchical relationship between the two-dimensional background layer, the three-dimensional seat model layer, and the two-dimensional foreground occlusion layer.

[0174] The interface layers are constructed in the following order from bottom to top: the first layer is a two-dimensional pseudo-three-dimensional background layer (providing the cabin space background); the second layer is a real-time three-dimensional seat model layer (where interactive seat models are placed); the third layer is a two-dimensional foreground occlusion layer (simulating foreground occlusion); and the fourth layer is an HMI control layer (displaying interactive elements such as buttons and controls).

[0175] S4: Renders a two-dimensional pseudo-three-dimensional background layer using screen space projection.

[0176] During the real-time rendering phase, the two-dimensional pseudo-three-dimensional background layer is displayed on the HMI screen by screen space projection.

[0177] S5: Load the real-time 3D seat model layer.

[0178] Based on the current seat adjustment scenario or seat configuration, load the corresponding real-time 3D seat model (such as driver's seat, passenger seat, rear seat model, etc.).

[0179] S6: Controls the visibility of different 3D seat models based on configuration signals.

[0180] The system receives seat configuration signals from the vehicle (such as vehicle model configuration, number of seats, arrangement, and whether rotation is supported), and controls the display and hiding of different 3D seat models or component models based on the signals. For example, when the vehicle is configured with two independent seats, the middle seat model is hidden.

[0181] S7: Align the real-time 3D camera based on the pre-rendered camera parameters.

[0182] Obtain the pre-rendered camera parameters used when generating the background layer in S1, and set the parameters of the real-time 3D camera according to the pre-rendered camera parameters so that the viewpoint of the real-time 3D camera is consistent with the viewpoint of the pre-rendered background.

[0183] S8: Drives the 3D seat model to change according to seat adjustment commands.

[0184] After receiving the seat adjustment command (such as moving forward and backward, adjusting the backrest angle, switching the seat combination mode, etc.) issued by the user through the HMI control, the system updates the position, rotation angle, posture, and visibility or animation status of the corresponding 3D seat model in real time.

[0185] The 3D seat model is rendered based on the pre-rendered camera parameters set in S7 and displayed in real time on the cockpit adjustment interface.

[0186] S9: Overlay a two-dimensional foreground occlusion layer to simulate the feeling of being enveloped in a cockpit.

[0187] After the 3D seat model layer is rendered, a 2D foreground occlusion layer generated in S2 is overlaid on top of it. The 2D foreground occlusion layer covers the 3D seat model only in the localized areas that need to be occluded, through transparency channels or masking areas, so that the 3D seat model is located behind part of the cabin structure, creating a sense of spatial enclosure.

[0188] S10: Perform pre-compensated color transformation on 2D layers that need to maintain the target display effect.

[0189] Since the pre-rendered 2D layer enters the unified post-processing pipeline along with the real-time 3D model in the final image, post-processing will change its original target color. Therefore, by calculating the inverse transformation of the post-processing pipeline (such as ACES curve inverse solution, matrix inverse transformation, LUT reverse lookup, etc.), the 2D layer is pre-compensated for color, so that its final display color after post-processing is as close as possible to the preset target color, thereby ensuring color consistency between the 2D layer and the 3D model.

[0190] Optional, analytical inverse solution based on ACES Fitted curves.

[0191] Optional, reverse compensation based on the Hill ACES Fitted link.

[0192] Optionally, perform approximate reverse compensation on complex post-processing pipelines.

[0193] In summary, the method provided in this application pre-renders non-real-time interactive elements such as cockpit space, ground, ambient lighting, and shadows as a two-dimensional pseudo-three-dimensional background layer, reducing the amount of calculation required for rendering three-dimensional models, materials, lighting, and shadows during the real-time operation phase.

[0194] Compared with the pure two-dimensional image solution, the method provided in this application embodiment retains the adjustable seat as a real-time three-dimensional model, so that the seat can still be moved, rotated, shown and hidden and combined according to user operation.

[0195] The method provided in this application embodiment, through a layered structure of a two-dimensional background layer, a three-dimensional seat model layer, and a two-dimensional foreground occlusion layer, can simulate the front and rear occlusion relationship in a real cabin space, so that the seat is no longer simply pasted on the background image, but has the visual effect of being wrapped by the cabin space.

[0196] The method provided in this application provides a fixed two-dimensional background layer by projecting it into the screen space and dynamically aligning the three-dimensional seat model using parameters such as real-time three-dimensional camera reference point, pitch angle, and displacement. This solution can reduce perspective misalignment, proportional misalignment, and ground position misalignment between the two-dimensional background and the three-dimensional seat.

[0197] The method provided in this application embodiment controls the visibility of different three-dimensional seat models through seat configuration signals, so that the same set of two-dimensional background layer and two-dimensional foreground occlusion layer can adapt to different numbers of seats, different seat layouts and different seat combination modes, thereby reducing the production cost of multiple vehicle models and multiple configuration resources.

[0198] The method provided in this application embodiment, compared to creating a complete 3D scene or a complete 2D state map for each seat configuration, only needs to reuse the background layer and the foreground occlusion layer, and switch the 3D seat model as needed, which helps to reduce the occupation of texture resources, model resources and package size.

[0199] The method provided in this application, through inverse compensation of ACES, exposure, contrast, Gamma, and Gain, can offset the brightness, contrast, and color shifts caused by Unity's global post-processing to the 2D pre-rendered image, making the final display closer to the design goal.

[0200] The method provided in this application not only performs inverse color compensation on the two-dimensional layer, but also adjusts the Unity global post-processing parameters in real time according to different seat adjustment scenarios, so that the brightness, contrast, color and Bloom performance remain consistent in different scenarios such as normal seat adjustment, driver's seat rotation, passenger seat rotation, large living room mode, and seat combination switching, avoiding color cast, overexposure, underexposure or switching jumps caused by fixed post-processing parameters.

[0201] The method provided in this application embodiment can visually obtain a spatial sense and occlusion relationship close to a complete 3D cockpit, while avoiding the high performance overhead caused by real-time rendering of a complete 3D cockpit. It is suitable for application in embedded display environments such as in-vehicle central control screens and rear screens.

[0202] The method provided in this application embodiment decouples the background, foreground, and seat model. When adapting to new car models or new seat configurations, the existing two-dimensional background layer, two-dimensional foreground occlusion layer, and rendering logic can be reused first. Only the three-dimensional seat model, configuration table, camera alignment parameters, and scene post-processing parameters need to be adjusted to complete the adaptation.

[0203] In one optional embodiment, the cockpit adjustment interface display method provided in this application includes the following steps: The cockpit adjustment interface displays the cockpit background image and / or the foreground occlusion image. The cockpit background image presents the cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional variable component model. In response to adjustment operations on the three-dimensional variable parts, a model of the three-dimensional variable parts is displayed above the cockpit background screen, and the spatial state changes of the three-dimensional variable parts model are driven. During the spatial state change of the three-dimensional variable component model, the cockpit background image and / or foreground occlusion image remain stationary, and the part of the three-dimensional variable component model that overlaps with the cockpit foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly with the spatial state change of the three-dimensional variable component model.

[0204] That is, the three-dimensional seat model in the embodiments of this application can be replaced by a three-dimensional variable component model. The three-dimensional variable component can refer to any component in the cabin whose spatial state can be changed. For example, the three-dimensional variable component can be one or more of the following: seat, air conditioner, lights, steering wheel, control handle, window, and door handle.

[0205] When the three-dimensional variable component is an air conditioner, the cockpit background image and / or foreground occlusion image are displayed in the cockpit adjustment interface. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional air conditioner model. In response to adjustments made to the air conditioning, a 3D air conditioning model is displayed above the cabin background screen, along with the fan blades that drive the 3D air conditioning model to rotate. During the rotation of the 3D air conditioning model, the cabin background image and / or foreground occlusion image remain stationary, and the part of the 3D air conditioning model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly as the 3D air conditioning model rotates.

[0206] That is, the three-dimensional seat model in the above embodiment can be replaced with a three-dimensional air conditioning model to realize the real-time display of the spatial changes of the three-dimensional air conditioning model in the cabin adjustment interface.

[0207] When the three-dimensional variable component is a lighting fixture, the cockpit background image and / or foreground occlusion image are displayed in the cockpit adjustment interface. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional lighting fixture model. In response to the adjustment operation of the lighting, a three-dimensional lighting model is displayed above the cockpit background screen, and the lighting of the three-dimensional lighting model is changed, or the position of the three-dimensional lighting model is changed, or the rotation of the three-dimensional lighting model is driven. During the process of light changes / position changes / rotation of the 3D lighting model, the cockpit background image and / or foreground occlusion image remain stationary, and the part of the 3D lighting model that overlaps with the cockpit foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly with the light changes / position changes / rotation of the 3D lighting model.

[0208] That is, the three-dimensional seat model in the above embodiment can be replaced with a three-dimensional lighting model to realize the real-time display of the spatial changes of the three-dimensional lighting model in the cockpit adjustment interface.

[0209] In summary, the method provided in this application divides the cockpit adjustment interface into multiple layers: a cockpit background image and a 3D variable component model; or a 3D variable component model and a foreground occlusion image; or a cockpit background image, a 3D variable component model, and a foreground occlusion image. The cockpit adjustment interface is obtained by combining a 2D image and a 3D model for rendering, so that interface rendering only needs to render the variable part of the interface: the 3D variable component model, without rendering the usually fixed content of the interface: the background and / or foreground. When the user adjusts the 3D variable component, the 3D variable component model in the interface can move or rotate accordingly, while the 2D cockpit background image and the foreground occlusion image remain unchanged. This provides the user with a 3D spatial operation experience while reducing the number of models that need to be rendered, thus reducing the rendering load. The 2D cockpit background image has a 3D perspective relationship, providing the user with a sense of 3D space; the foreground occlusion image layer covers the 3D variable component model, providing the user with a sense of spatial enclosure. Through the occlusion relationship between the 3D variable component model and the foreground occlusion image, the user is further provided with a sense of 3D space. While ensuring the 3D display effect, the 3D rendering load is reduced, the interface display frame rate is guaranteed, the memory pressure of the vehicle system is reduced, the loading time of the interface and operation response is reduced, the heat generation of the vehicle system is reduced, and the power consumption of the vehicle system is reduced.

[0210] The exemplary embodiments of this application have been described in detail above. It should be understood that those skilled in the art can make detailed modifications and variations based on the concept of this application without creative effort. Therefore, any technical solutions that can be obtained by those skilled in the art based on the concept of this application and through logical analysis, theoretical deduction, or limited experimentation on the basis of related technologies are intended to fall within the protection scope defined by this application.

[0211] Figure 11 This is a schematic diagram of the structure of a cockpit adjustment interface display device provided in an exemplary embodiment of this application. The device includes: Display module 1002 is used to display a cockpit background image and / or a foreground occlusion image in the cockpit adjustment interface. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship. The foreground occlusion image presents a cockpit foreground structure located in front of the three-dimensional seat model. The interaction module 1001 is used to receive adjustment operations for the seat; The display module 1002 is used to display a three-dimensional seat model above the cockpit background screen in response to the adjustment operation of the seat, and to drive the three-dimensional seat model to move and / or rotate continuously. During the movement and / or rotation of the 3D seat model, the cabin background image and / or the foreground occlusion image remain stationary, and the portion of the 3D seat model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly as the 3D seat model moves and / or rotates.

[0212] In one optional embodiment, the cockpit background image also includes a ground area, ambient lighting effects, and ground shadows; During the movement and / or rotation of the three-dimensional seat model, the ground area and the ground shadow remain stationary.

[0213] In one optional embodiment, the cockpit foreground structure includes at least one of the following: door edge, ground edge, central control area, armrest area, and side panel partial structure; The foreground occlusion screen displays image content only in the area corresponding to the foreground structure of the cockpit, and does not display image content in the remaining areas of the foreground occlusion screen.

[0214] In an optional embodiment, the display module 1002 is used to overlay a seat adjustment control on top of the foreground obstructed image, the seat adjustment control being used to trigger the adjustment operation; During the movement and / or rotation of the three-dimensional seat model, the seat adjustment controls remain stationary.

[0215] In one optional embodiment, the adjustment operation includes at least one of a fore-and-aft movement adjustment operation and a backrest angle adjustment operation; The interaction module 1001 is used to receive the forward and backward movement adjustment operation; The display module 1002 is used to drive the three-dimensional seat model to continuously translate along the seat slide rail direction in response to the forward and backward movement adjustment operation; The interaction module 1001 is used to receive the backrest angle adjustment operation; The display module 1002 is used to drive the backrest of the three-dimensional seat model to rotate continuously relative to the seat cushion of the three-dimensional seat model in response to the backrest angle adjustment operation.

[0216] In one optional embodiment, the adjustment operation includes a seat combination mode switching operation; The interaction module 1001 is used to receive the seat combination mode switching operation; The display module 1002 is used to drive at least two of the three-dimensional seat models to move and / or rotate to the target combination position in response to the seat combination mode switching operation. The seat combination modes include at least one of the following: driver's seat rotation mode, passenger seat rotation mode, and large living room mode.

[0217] In one optional embodiment, the number of the three-dimensional seat models is at least two; the three-dimensional seat models include at least two of the following: a driver's seat model, a passenger seat model, and a rear seat model; The interaction module 1001 is used to receive adjustment operations for the target seat; The display module 1002 is used to drive the three-dimensional seat model corresponding to the target seat to move and / or rotate continuously in response to the adjustment operation of the target seat; Among them, the three-dimensional seat models other than the three-dimensional seat model corresponding to the target seat remain stationary.

[0218] In an optional embodiment, the display module 1002 is configured to switch at least one of the three-dimensional seat models from a displayed state to a hidden state in response to a seat configuration switch, and / or switch at least one of the three-dimensional seat models from a hidden state to a displayed state; Before and after the seat configuration is switched, the cockpit background image and the foreground obscured image remain unchanged.

[0219] In one alternative embodiment, the seat configuration switching is triggered based on a vehicle seat configuration signal; The seat configuration signal is used to indicate at least one of the following: vehicle model configuration, number of seats, seat arrangement, presence of a middle seat, whether seat rotation is supported, and whether a row of seats is supported.

[0220] In one alternative embodiment, during the movement and / or rotation of the three-dimensional seat model, the perspective direction of the three-dimensional seat model remains consistent with the three-dimensional perspective relationship presented by the cabin background image.

[0221] In an optional embodiment, the display module 1002 is used to obtain pre-rendered camera parameters corresponding to the cockpit background image; The display module 1002 is used to determine the real-time camera parameters for displaying the three-dimensional seat model based on the pre-rendered camera parameters. The real-time camera parameters include at least one of the following: camera reference point, pitch angle, horizontal angle, displacement, and field of view.

[0222] In an optional embodiment, the display module 1002 is used to dynamically fine-tune the real-time camera parameters according to the target position after the three-dimensional seat model has moved and / or rotated; The dynamic fine-tuning includes adjusting at least one of the camera reference point, the pitch angle, and the displacement.

[0223] In one optional embodiment, the display position and display size of the cockpit background image are tied to the display area of ​​the cockpit adjustment interface; During the process of dynamically fine-tuning the real-time camera parameters, the display position and display size of the cockpit background image remain unchanged.

[0224] In one optional embodiment, the display module 1002 is used to perform unified post-processing on the complete screen of the cockpit adjustment interface; The display module 1002 is used to perform pre-compensation color transformation on the image data corresponding to the cockpit background image and the image data corresponding to the foreground occlusion image before displaying the cockpit background image and / or the foreground occlusion image. The direction of the pre-compensated color transformation is opposite to the direction of the unified post-processing color transformation.

[0225] In one alternative embodiment, the pre-compensated color transformation is determined in the following manner: Substitute the target display color into the inverse transformation of the corresponding positive color transformation in the unified post-processing to obtain the pre-compensated color. The inverse transformation includes at least one of the following: analytical inverse solution of tone mapping curve, matrix inverse transformation, reverse lookup table lookup, piecewise function fitting, and iterative solution.

[0226] In an optional embodiment, the display module 1002 is used to dynamically adjust the processing parameters of the unified post-processing according to the current seat adjustment scenario; The seat adjustment scenarios include at least one of the following: seat position adjustment, driver's seat rotation, passenger seat rotation, large living room mode, and seat combination switching; The processing parameters include at least one of exposure, contrast, gamma, gain, and tone mapping parameters.

[0227] In one optional embodiment, the cockpit background image and / or the foreground occlusion image are two-dimensional images pre-rendered based on the three-dimensional cockpit scene according to the same pre-rendered camera parameters. The three-dimensional cockpit scene includes the vehicle interior space structure, ground area, dashboard area, door area, ambient lighting, and ground shadow.

[0228] It should be noted that the cockpit adjustment interface display device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the cockpit adjustment interface display device and the cockpit adjustment interface display method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0229] Figure 12 This is a schematic diagram of the structure of a vehicle-mounted terminal according to an embodiment of this application.

[0230] Typically, the vehicle terminal 1100 includes: a main control module 1101, a CAN interface 1102, a hard-wired input interface 1103, and a hard-wired output interface 1104. The main control module 1101 is connected to the CAN interface 1102, the hard-wired input interface 1103, and the hard-wired output interface 1104, respectively.

[0231] The main control module 1101 typically includes a processor and memory. The processor may include one or more processing cores, such as an 11-core processor or an 8-core processor. The processor can be implemented using at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the vehicle's display screen. In some embodiments, the processor may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning. The memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, a non-transitory computer-readable storage medium in the memory is used to store at least one piece of program code, which is executed by a processor to implement the cockpit adjustment interface display method provided in the method embodiments of this application.

[0232] The CAN interface 1102 may include a powertrain CAN interface, a motor CAN interface, and a diagnostic CAN interface. The powertrain CAN interface is used to communicate with the vehicle's powertrain module, the motor CAN interface is used to communicate with the vehicle's motor controller, and the diagnostic CAN interface is used to communicate with diagnostic equipment.

[0233] The hard-wired input interface 1103 is used to receive hard-wired control signals. The hard-wired output interface 1104 is used to send control commands to the vehicle's electronic control components, causing the vehicle's electronic control components to perform corresponding actions. The vehicle's electronic control components include a power management system, a motor controller, an on-board charger, and a body control system.

[0234] The main control module 1101 can communicate with the vehicle's powertrain module, motor controller, and diagnostic equipment via the CAN interface 1102, and generate control commands based on the hard-wired control signals received by the hard-wired input interface 1103, so as to send the control commands to the vehicle's electronic control components via the hard-wired output interface 1104.

[0235] Those skilled in the art will understand that Figure 12 The structure shown does not constitute a limitation on the vehicle terminal 1100, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0236] This application also provides a computer-readable storage medium storing at least one instruction, at least one program, code set, or instruction set. When the at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor of a computer device, the cockpit adjustment interface display method provided in the above-described method embodiments is implemented.

[0237] This application also provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the cockpit adjustment interface display method provided in the above-described method embodiments.

[0238] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0239] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent switching, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for displaying a cockpit adjustment interface, characterized in that, The method includes: The cockpit adjustment interface displays a cockpit background image and / or a foreground occlusion image. The cockpit background image presents a cockpit space with a three-dimensional perspective relationship; the foreground occlusion image presents the cockpit foreground structure located in front of the three-dimensional seat model. In response to an adjustment operation on the seat, a three-dimensional seat model is displayed above the cockpit background screen, and the three-dimensional seat model is driven to move and / or rotate continuously; During the movement and / or rotation of the 3D seat model, the cabin background image and / or the foreground occlusion image remain stationary, and the portion of the 3D seat model that overlaps with the cabin foreground structure is continuously occluded by the foreground occlusion image. The occluded area changes accordingly as the 3D seat model moves and / or rotates.

2. The method according to claim 1, characterized in that, The cockpit background image also shows the ground area, ambient lighting effects, and ground shadows; During the movement and / or rotation of the three-dimensional seat model, the ground area and the ground shadow remain stationary.

3. The method according to claim 1, characterized in that, The cockpit foreground structure includes at least one of the following: door edge, ground edge, central control area, armrest area, and side panel partial structure; The foreground occlusion screen displays image content only in the area corresponding to the foreground structure of the cockpit, and does not display image content in the remaining areas of the foreground occlusion screen.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: A seat adjustment control is overlaid on top of the foreground obscured image, and the seat adjustment control is used to trigger the adjustment operation; During the movement and / or rotation of the three-dimensional seat model, the seat adjustment controls remain stationary.

5. The method according to any one of claims 1 to 3, characterized in that, The adjustment operation includes at least one of forward and backward movement adjustment operation and backrest angle adjustment operation; The method of displaying a three-dimensional seat model above the cockpit background screen in response to an adjustment operation on the seat, and driving the three-dimensional seat model to move and / or rotate continuously, includes: In response to the forward and backward movement adjustment operation, the three-dimensional seat model is driven to continuously translate along the seat slide rail direction; In response to the backrest angle adjustment operation, the backrest of the three-dimensional seat model is driven to rotate continuously relative to the seat cushion of the three-dimensional seat model.

6. The method according to any one of claims 1 to 3, characterized in that, The adjustment operation includes the operation of switching seat combination modes; The method of displaying a three-dimensional seat model above the cockpit background screen in response to an adjustment operation on the seat, and driving the three-dimensional seat model to move and / or rotate continuously, includes: In response to the seat combination mode switching operation, at least two of the three-dimensional seat models are driven to move and / or rotate continuously to the target combination position; The seat combination modes include at least one of the following: driver's seat rotation mode, passenger seat rotation mode, and large living room mode.

7. The method according to any one of claims 1 to 3, characterized in that, The number of the three-dimensional seat models is at least two; the three-dimensional seat models include at least two of the following: driver's seat model, passenger seat model, and rear seat model; The method of displaying a three-dimensional seat model above the cockpit background screen in response to an adjustment operation on the seat, and driving the three-dimensional seat model to move and / or rotate continuously, includes: In response to an adjustment operation on the target seat, the three-dimensional seat model corresponding to the target seat is driven to move and / or rotate continuously; Among them, the three-dimensional seat models other than the three-dimensional seat model corresponding to the target seat remain stationary.

8. The method according to claim 7, characterized in that, The method further includes: In response to a seat configuration switch, at least one of the three-dimensional seat models is switched from a displayed state to a hidden state, and / or at least one of the three-dimensional seat models is switched from a hidden state to a displayed state; Before and after the seat configuration is switched, the cockpit background image and the foreground obscured image remain unchanged.

9. The method according to claim 8, characterized in that, The seat configuration switching is triggered based on the vehicle's seat configuration signal; The seat configuration signal is used to indicate at least one of the following: vehicle model configuration, number of seats, seat arrangement, presence of a middle seat, whether seat rotation is supported, and whether a row of seats is supported.

10. The method according to any one of claims 1 to 3, characterized in that, During the movement and / or rotation of the three-dimensional seat model, the perspective direction of the three-dimensional seat model remains consistent with the three-dimensional perspective relationship presented by the cabin background image.

11. The method according to claim 10, characterized in that, The method further includes: Obtain the pre-rendered camera parameters corresponding to the cockpit background image; Based on the pre-rendered camera parameters, determine the real-time camera parameters used to display the 3D seat model; The real-time camera parameters include at least one of the following: camera reference point, pitch angle, horizontal angle, displacement, and field of view.

12. The method according to claim 11, characterized in that, The method further includes: The real-time camera parameters are dynamically fine-tuned based on the target position of the three-dimensional seat model after movement and / or rotation. The dynamic fine-tuning includes adjusting at least one of the camera reference point, the pitch angle, and the displacement.

13. The method according to claim 12, characterized in that, The display position and size of the cockpit background image are tied to the display area of ​​the cockpit adjustment interface; During the process of dynamically fine-tuning the real-time camera parameters, the display position and display size of the cockpit background image remain unchanged.

14. The method according to any one of claims 1 to 3, characterized in that, The method further includes: Before displaying the cockpit background image and / or the foreground occlusion image, a pre-compensation color transformation is performed on the image data corresponding to the cockpit background image and the image data corresponding to the foreground occlusion image; Perform unified post-processing on the complete screen of the cockpit adjustment interface; The direction of the pre-compensated color transformation is opposite to the direction of the unified post-processing color transformation.

15. The method according to claim 14, characterized in that, The pre-compensated color transformation is determined in the following way: Substitute the target display color into the inverse transformation of the corresponding positive color transformation in the unified post-processing to obtain the pre-compensated color. The inverse transformation includes at least one of the following: analytical inverse solution of tone mapping curve, matrix inverse transformation, reverse lookup table lookup, piecewise function fitting, and iterative solution.

16. The method according to claim 14, characterized in that, The method further includes: The processing parameters of the unified post-processing are dynamically adjusted according to the current seat adjustment scenario. The seat adjustment scenarios include at least one of the following: seat position adjustment, driver's seat rotation, passenger seat rotation, large living room mode, and seat combination switching; The processing parameters include at least one of exposure, contrast, gamma, gain, and tone mapping parameters.

17. The method according to any one of claims 1 to 3, characterized in that, The cockpit background image and / or the foreground occlusion image are two-dimensional images pre-rendered based on the three-dimensional cockpit scene according to the same pre-rendered camera parameters; The three-dimensional cockpit scene includes the vehicle interior space structure, ground area, dashboard area, door area, ambient lighting, and ground shadow.

18. A display device for a cockpit adjustment interface, characterized in that, The device includes a module for implementing the display method of the cockpit adjustment interface as described in any one of claims 1 to 17.

19. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one program, which is loaded and executed by the processor to implement the cockpit adjustment interface display method as described in any one of claims 1 to 17.

20. A computer-readable storage medium, characterized in that, The readable storage medium stores at least one program, which is loaded and executed by a processor to implement the cockpit adjustment interface display method as described in any one of claims 1 to 17.

21. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium, a processor of a computer device reading the computer instructions from the computer-readable storage medium, and the processor executing the computer instructions to cause the computer device to perform the cockpit adjustment interface display method as described in any one of claims 1 to 17.

Images