Picture rendering method, vehicle, device, and program product

By rendering consistent data between the first and second window processes of the vehicle's central control screen, the problem of visual consistency and flexibility when displaying multiple application software screens on the vehicle's central control screen is solved, the hardware performance requirements are reduced, and the freedom of design and development is increased.

CN119621214BActive Publication Date: 2026-03-27ZHEJIANG GEELY HLDG GRP CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-22
Publication Date
2026-03-27

AI Technical Summary

Technical Problem

In existing technologies, when displaying multiple application software screens, it is difficult to ensure visual consistency and flexibility of the vehicle's central control screen, which also leads to problems such as high hardware performance requirements and low development freedom.

Method used

By interacting and rendering consistent data between the first and second window processes, the visual consistency between the second window and the first window is ensured, avoiding multiple applications from being concentrated in one process. A software protocol framework is used to achieve collaborative linkage.

Benefits of technology

It achieves visual consistency across multiple window processes, reduces hardware performance requirements, increases design and development freedom, and lowers development costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119621214B_ABST
    Figure CN119621214B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of data processing, in particular to a picture rendering method, a vehicle, equipment and a program product. The method comprises the following steps: acquiring rendering consistency data of a first window process and a second window process; and performing picture rendering based on the rendering consistency data, so as to ensure the visual consistency between a second window picture rendered by the second window process and a first window picture rendered by the first window process. The application can realize the consistency and flexibility of multiple window processes during rendering, and at the same time, can reduce the performance requirement and improve the degree of freedom of design and development.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to a picture rendering method, a vehicle, a device and a program product. BACKGROUND

[0002] With the development of technology, the trend of intelligence on vehicle cabin function and delicacy on design is increasingly obvious. The center control screen in the vehicle cabin is a key human-machine interface (HMI) component for connecting people and vehicles for human-computer interaction. As a display screen, the center control screen in the vehicle cabin is an important window for human-computer interaction. On the one hand, it covers all vehicle parts to provide vehicle function to users; on the other hand, it also ensures that the entire vehicle system itself has sufficient competitiveness in the fields of operation fluency, interface aesthetics, interactive friendliness, and research and development landing cost. At present, based on the rich application software, the human-computer interaction interface on the vehicle may need to display multiple window pictures at the same time to meet the needs of users.

[0003] In the prior art, in order to present a complete and unified visual effect to the user through the display screen, when facing the picture display requirements of multiple application software, one way is to display multiple different application software based on one process, but this way will cause the process to be "bloated", which improves the hardware performance requirements and cost requirements; another way is that different application software runs in an independent context, in order to ensure the consistency of picture rendering effect, the development process of each application software needs to be constrained based on a pre-specified design language, but this way reduces the degree of freedom of design and development, and it is difficult to meet more and more application requirements. SUMMARY

[0004] Based on the defects and deficiencies of the above-mentioned prior art, the present application provides a picture rendering method, a vehicle, a device and a program product, which can realize the consistency and flexibility of multiple window process rendering, at the same time, reduce the performance requirements, and improve the degree of freedom of design and development.

[0005] According to a first aspect of an embodiment of the present application, a picture rendering method is provided, comprising: obtaining rendering consistency data of a first window process and a second window process; based on the rendering consistency data, performing picture rendering to ensure the visual consistency of a second window picture rendered by the second window process and a first window picture rendered by the first window process.

[0006] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the rendering consistency data of the first window process and the second window process is obtained, including: the second window process sends a rendering consistency request to the first window process; the first window process sends the rendering consistency data to the second window process based on the rendering consistency request; and the picture rendering is performed based on the rendering consistency data, including: the second window process performs picture rendering based on the rendering consistency data.

[0007] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the second window process sends a rendering consistency request to the first window process, including: switching the second window process in the background dormant state to the foreground active state; and the second window process sends a rendering consistency request to the first window process in the foreground active state.

[0008] According to the picture rendering method provided in the first aspect of the embodiment of the present application, after the first window process sends the rendering consistency data to the second window process based on the rendering consistency request, the first window process in the foreground active state is further switched to the background dormant state.

[0009] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the second window process sends a rendering consistency request to the first window process, including: the second window process in the foreground active state sends a rendering consistency request to the first window process in the foreground active state.

[0010] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the second window process sends a rendering consistency request to the first window process, including: based on the action period of the picture rendering of the second window process, the second window process periodically sends a rendering consistency request to the first window process.

[0011] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the rendering consistency data includes the related information of the rendering element that guarantees the visual consistency of the first window picture and the second window picture.

[0012] According to the picture rendering method provided in the first aspect of the embodiment of the present application, the rendering consistency request includes the identification information of the second window process.

[0013] According to the second aspect of the embodiment of the present application, a vehicle is provided, including a display screen; the display screen is used to display the second window picture and the first window picture rendered by the picture rendering method according to any one of the first aspect.

[0014] According to a third aspect of the embodiments of the present application, an electronic device is provided, comprising a memory and a processor; the memory is connected with the processor, and is configured to store a program; the processor is configured to realize the picture rendering method according to the first aspect by running the program in the memory.

[0015] According to a fourth aspect of the embodiments of the present application, a computer program product is provided, comprising computer program instructions; the computer program instructions enable a processor to execute the picture rendering method according to the first aspect when the computer program instructions are run by the processor. Optionally, the computer program can be stored in a readable storage medium or cloud of a computer device; the processor of the computer device reads the computer program from the readable storage medium or cloud.

[0016] In the embodiments of the present application, the rendering consistency data of the first window process and the second window process is acquired; and the picture rendering is performed based on the rendering consistency data, so as to ensure the visual consistency of the second window picture rendered by the second window process and the first window picture rendered by the first window process. In this process, the plurality of application software does not need to be concentrated in one process, but the rendering consistency data is interacted between the first window process and the second window process, so as to flexibly allocate the plurality of window processes according to the actual business needs, thereby avoiding the high performance requirement of the processing resources when the plurality of application software is concentrated in one process. Meanwhile, when the first window process and the second window process perform the picture rendering, the visual consistency of the second window picture and the first window picture is ensured by the rendering consistency data, instead of limiting the design language of the application software, thereby improving the degree of freedom of the technical design and development, reducing the development cost; and the rich and varied application software can be dynamically accessed to the display process through different window processes, thereby providing more convenient conditions for the upgrade, iteration and maintenance of the application software. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of the provided drawings.

[0018] Figure 1 A flowchart of a picture rendering method provided by the embodiments of the present application is shown in the figure;

[0019] Figure 2 A flowchart of a picture rendering method in the scene of switching back and forth between the foreground window process and the background window process provided by the embodiments of the present application is shown in the figure;

[0020] Figure 3One of the example schematic diagrams of the header filling provided by the embodiment of the present application;

[0021] Figure 4 One of the example schematic diagrams of the header filling provided by the embodiment of the present application;

[0022] Figure 5 One of the example schematic diagrams of the data part filling provided by the embodiment of the present application;

[0023] Figure 6 The flowchart of the picture rendering method in the scenario of the multiple window processes co-screening provided by the embodiment of the present application;

[0024] Figure 7 One of the example schematic diagrams of the header filling provided by the embodiment of the present application;

[0025] Figure 8 One of the example schematic diagrams of the header filling provided by the embodiment of the present application;

[0026] Figure 9 One of the example schematic diagrams of the data part filling provided by the embodiment of the present application;

[0027] Figure 10 The block diagram of the picture rendering device provided by the embodiment of the present application;

[0028] Figure 11 The structural schematic diagram of the electronic device provided by the embodiment of the present application. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0030] Summary

[0031] With the development of technology, how the display screen displays the pictures of multiple application software becomes an important issue. Especially for the automotive industry, whether the content design in the central control screen of the vehicle is exquisite, visual, intuitive and easy to use directly affects whether this vehicle model can stand out in the fierce market competition and achieve good market performance. As we all know, a vehicle from design and development to production and manufacturing is extremely complex, and there are many intelligent parts involved. The car machine central control screen in the vehicle cabin is an important window for human-computer interaction. On the one hand, it covers all the car machine functions provided by these automotive parts to the user; on the other hand, it also ensures that the entire car machine system itself has sufficient competitiveness in the fields of operation fluency, interface aesthetics, interactive friendliness, research and development landing cost, etc.

[0032] In traditional car machine central control screens, there are generally only vehicle basic state, air conditioning setting, music box, radio and other functions, the functions are relatively few, and the visual display effect is relatively single. With the development of intelligence and the improvement of user demand, one of the significant changes of the new car machine central control screen is that it has very rich application software, and these application software has not been limited to displaying two-dimensional pictures. Many application software uses real-time three-dimensional (3-dimensional, 3D) rendering technology to present pictures to users, in order to meet the functions and further improve the visual quality. For example, vehicle setting software uses 3D car model and dynamic effect to real-time feedback the current state information of the vehicle to the user; intelligent driving software uses three-dimensional reconstruction technology to show the road condition data perceived by each sensor to the user in a visual form on the instrument; three-dimensional real scene navigation map shows the environmental information around the vehicle to the user based on 3D real-time rendering technology.

[0033] For multiple pictures displayed on the same screen, especially for 3D real-time rendering pictures, application software based on real-time rendering technology often comes from different development teams, which is difficult to maintain uniformity in design style and interaction logic. If different application software on a car machine system has different interactive visual definitions, it will break the immersion and consistency of the application software. In order to present a complete and unified visual effect to the user, the prior art provides a scheme of placing all software applications to be run in one process. The prior art also provides a scheme based on design language, that is, formulating the corresponding interactive visual specification by design language before developing all application software, and then each development team develops its own software according to this specification.

[0034] However, in order to keep the consistency of real-time rendering effect, all application software is made in one process in one scene, which leads to the problem of process "bloat". If different application software runs in its own independent context, different processes will have their own program execution path, which cannot guarantee the consistency of the final rendering effect. In the face of multiple application software, only by designing language predefined specifications to constrain the development process of each software, although it improves the coupling degree of design modules and technical modules, it reduces the degree of freedom of design and development, and is not conducive to the platform expansion of the car machine system.

[0035] Exemplary method

[0036] Based on the above problems, the picture rendering method provided by the present application is implemented on any device with data processing function. Optionally, the device is a vehicle central screen hardware platform. The central screen hardware platform is equipped with a processing chip, which can be Qualcomm 8155, 8295 or other chips of the same type and equal computing power. Since the picture rendering method provided by the present application is based on multiple window processes, the problem of process "bloat" is avoided. Therefore, the method can reasonably classify the computing resources of the processing chip. Therefore, the performance requirement of the processing chip is relatively low, thereby saving the hardware cost of the vehicle. Optionally, the operating system that can be used by the vehicle central screen hardware platform includes but is not limited to mobile terminal operating systems such as Android, iOS and Linux.

[0037] In one embodiment, as shown in Figure 1 The flow steps of the picture rendering method include:

[0038] Step 101, obtaining the rendering consistency data of the first window process and the second window process.

[0039] In this embodiment, the window process refers to a process in a graphical user interface (GUI) environment, and the window process can create and manage a window displayed on a screen. These processes are responsible for handling interactions with the user, such as mouse clicks, keyboard inputs, virtual key inputs, etc., and updating the window content accordingly. The first window process and the second window process refer to any two different window processes. It should be noted that a processing device can include two or more window processes, and the first window process and the second window process are any two of all window processes. For example, four windows A, B, C, and D need to be displayed on a vehicle center screen, and each window corresponds to a window process. Then, the first window process and the second window process can be any two of the window processes. Further, the multiple window processes can be associated in any manner, such as a tree structure, according to actual conditions and rendering consistency requirements, and the first window process and the second window process can be any two window processes with an association.

[0040] In this embodiment, the first window process and the second window process can correspond to two different software applications that need to be based on window display pictures, or they can be any two processes in a multi-process software that need to be based on window display pictures. Optionally, the application software corresponding to the first window process and the second window process is 3D application software. Each window process corresponds to a rendering window, the first window process corresponds to the first rendering window, and the second window process corresponds to the second rendering window. When the application software is 3D application software, the picture displayed on the corresponding rendering window is a 3D picture. Each rendering window corresponds to a system interface, based on which the life cycle of the window process is controlled, such as entering the start, stop, hibernate, active, and other states; based on the system interface, the display mode of the rendering window, such as the position and size, can also be controlled.

[0041] In this embodiment, when the first window process and the second window process perform picture rendering, in order to ensure the visual consistency of the first window picture and the second window picture, it is necessary to ensure that part of the rendering elements in the first window picture and the second window picture are consistent, and the rendering consistency data is defined as the data corresponding to the consistent rendering elements.

[0042] Step 102, performing picture rendering based on the rendering consistency data to ensure the visual consistency of the second window picture rendered by the second window process and the first window picture rendered by the first window process.

[0043] In this embodiment, the first window process and the second window process perform picture rendering based on the rendering consistency data, so as to ensure the visual consistency of the second window picture rendered by the second window process and the first window picture rendered by the first window process. For example, the rendering consistency data includes vehicle model data, and the first window process and the second window process perform picture rendering based on the rendering consistency data, so that the vehicle model in the first window picture finally rendered by the first window process is visually identical to the vehicle model in the second window picture finally rendered by the second window process, thereby ensuring the visual consistency of the first window picture and the second window picture.

[0044] In one embodiment, the communication function between the first window process and the second window process can be implemented by using any communication technology suitable for the method, such as Ethernet technology based on IEEE 802.3 standard, Bluetooth technology, local area network technology, etc. To ensure normal communication between the first window process and the second window process, a standardized software protocol framework based on collaborative linkage of rendering elements is defined. A rendering element refers to a component of a rendering picture, for example, a vehicle model in a rendering picture, a building individual in a background, etc. Multiple rendering elements together constitute a complete rendering picture.

[0045] In this embodiment, taking the 3D pictures displayed in the first window and the second window as an example, the first window process and the second window process correspond to different 3D software applications respectively, the rendering element is a 3D element, and the software protocol framework includes a header and a data part. The header includes the specification definition of the following items: version, header length data length, check code, application identifier, message type, element item length, and key. The data part structure includes the specification definition of the contents of each item in the 3D element list. Specifically, the header structure is defined as follows:

[0046] The header structure is defined as follows:

[0047] (1) Version: bit sequence 1, length 2 bytes (B), indicating the current version number of the software protocol framework;

[0048] (2) Header length: bit sequence 2, length 1B, indicating the size of the header content, in bytes (B);

[0049] (3) Data length: bit sequence 3, length 2B, indicating the size of the data part content, in bytes (B);

[0050] (4) Check code: bit sequence 4, length 2B, used to judge the correctness and integrity of the data packet, and the header and the data part are checked;

[0051] (5) Application identifier: bit sequence 5, length 4B, which can uniquely identify a number of 3D software applications;

[0052] (6) Message type: bit sequence 6, length 1B, 0 represents a request message, and 1 represents a response message;

[0053] (7) Element item length: bit sequence 7, length 4B, representing the length of each item in the 3D element list;

[0054] (8) Key: bit sequence 8, length 4B, used for encryption and decryption of data content.

[0055] For the data part structure, the 3D element list is mainly defined, and the bit sequence of the 3D element list is 9. The content of each item in the 3D element list is as follows:

[0056] (1) Element category: bit sequence 1, length 2B; optionally, different element categories can be represented by different identifiers, for example, 1 represents a camera, 2 represents a scene, 3 represents a vehicle model, 4 represents a voice image, 5 represents a theme color, etc. According to actual conditions and needs, the element categories described in this embodiment can be increased or modified.

[0057] (2) Element unique identity (Identity document, ID): bit sequence 2, length 2B; in the interaction process of the window process, a number that can uniquely identify the 3D element.

[0058] (3) Current state matrix: bit sequence 3, length 32B; a 4*4 affine matrix stored according to the row priority principle, used to represent the displacement, scaling, rotation, shear, mirroring, etc. of the 3D element in the world coordinate system, it should be noted that the size 4*4 of the current state matrix is only an example size, and other matrix sizes can also be used according to actual conditions and needs.

[0059] (4) Target state matrix: bit sequence 4, length 32B; a 4*4 affine matrix stored according to the row priority principle, used to represent the displacement, scaling, rotation, shear, mirroring, etc. of the 3D element in the world coordinate system before the start of the next animation period, it should be noted that the size 4*4 of the target state matrix is only an example size, and other matrix sizes can also be used according to actual conditions and needs.

[0060] (5) Spatial interpolation algorithm: bit sequence 5, length 1B; representing the intermediate transition algorithm used by the 3D element from the current state to the target state, different spatial interpolation algorithms can be represented by different identifiers, for example, 1 represents the nearest neighbor interpolation method, 2 represents the bilinear interpolation method, 3 represents the cubic interpolation method, and 4 represents the inverse distance weighted interpolation method. According to actual conditions and needs, the spatial interpolation algorithms described in this embodiment can be increased or modified.

[0061] (6) Current color: bit sequence 6, length 4B; a 1*4 matrix stored in the order of red, green, blue, and transparency. Used to represent the current color of the 3D element.

[0062] (7) Target color: bit sequence 7, length 4B; a 1*4 matrix stored in the order of red, green, blue, and transparency. Used to represent the color of the 3D element before the start of the next animation period.

[0063] (8) Color interpolation algorithm: bit sequence 8, length 1B; represents the intermediate transition algorithm used by the 3D element from the current color to the target color: different color interpolation algorithms can be represented by different identifiers, for example, 1 represents the nearest neighbor interpolation method, 2 represents the bilinear interpolation method, 3 represents the cubic interpolation method, 4 represents the inverse distance weighted interpolation method, and 5 represents the interpolation method based on the color ratio color difference law. According to actual conditions and needs, the color interpolation algorithms described in this embodiment can be increased or modified.

[0064] (9) Redundant bits: bit sequence 10; padding bits to align the data packet to 8B, facilitating data transmission.

[0065] In an embodiment, obtaining the rendering consistency data of the first window process and the second window process includes: the second window process sends a rendering consistency request to the first window process; and the first window process sends the rendering consistency data to the second window process based on the rendering consistency request. Performing picture rendering based on the rendering consistency data includes: the second window process performs picture rendering based on the rendering consistency data.

[0066] In this embodiment, the second window process is a process waiting to obtain the rendering consistency data, and the first window process is a process providing the rendering consistency data. In order to ensure the visual consistency of the second window process and the first window process, when the second window process needs to perform picture rendering, the second window process first sends a rendering consistency request to the first window process, and requests the rendering consistency data from the first window process based on the rendering consistency request. The rendering consistency data is obtained after the first window process fills in the information of the consistency-related rendering elements. After the first window process feeds back the rendering consistency data to the second window process in response to the rendering consistency request, the second window process performs picture rendering based on the rendering consistency data, thereby ensuring the visual consistency of the first window picture and the second window picture.

[0067] In an embodiment, the second window process sends a rendering consistency request to the first window process, including: switching the second window process from a background dormant state to a foreground active state; and the second window process sends a rendering consistency request to the first window process in the foreground active state.

[0068] In the embodiment, for any foreground window process, its life cycle is in an active state, and for any background window process, its life cycle is in a dormant state. The first window process is a window process in a foreground active state, and the second window process is a window process in a background dormant state. When the second window needs to be adjusted to a foreground display screen, the second window process needs to be switched to a foreground active state first, and then the second window process sends a rendering consistency request to the first window process in a foreground active state, so that the second window process can obtain rendering consistency data from the first window process in a foreground active state, thereby ensuring that the second window screen rendered by the second window process maintains consistency with the first window screen.

[0069] In one embodiment, after the first window process sends the rendering consistency data to the second window process based on the rendering consistency request, the first window process in a foreground active state is further switched to a background dormant state.

[0070] In the embodiment, if the first window needs to be adjusted to a background dormant state while the second window needs to be displayed in the foreground, the first window process is switched to a background dormant state after the first window process sends the rendering consistency data to the second window process. That is, in combination with the above embodiment and the present embodiment, an implementation of switching between foreground and background processes is provided.

[0071] In one embodiment, for a scenario of switching between foreground and background window processes, taking the switching of a window process in a foreground active state from a first window process to a second window process as an example, as shown in FIG. 8, the implementation process of the screen rendering method is as follows: Figure 2

[0072] Step 201: Switching, through a system interface, the second window process from a background dormant state to a foreground active state;

[0073] Step 202: The second window process sends a rendering consistency request to the first window process;

[0074] Step 203: After the first window process receives the rendering consistency request sent by the second window process, the first window process fills in the information of each rendering element related to rendering consistency based on the software protocol framework provided above to obtain rendering consistency data, and feeds back the rendering consistency data to the second window process;

[0075] Step 204: Switching, through a system interface, the first window process from a foreground active state to a background dormant state;

[0076] ​Step 205, after receiving the rendering consistency data fed back by the first window process, the second window process decides the behavior of keeping the rendering effect consistent locally according to the information of each rendering element in the rendering consistency data.

[0077] In an example embodiment, taking the vehicle central screen as the processing device, the first window process as the desktop window process, and the second window process as the vehicle setting window process, the process of switching the second window process to the foreground while switching the first window process to the background is specifically shown as follows: on the basis of the 3D lens in the desktop window process being in the current active state, the transition into the vehicle setting window process is realized, and the transition special effect of the 3D lens in the desktop window process and the vehicle setting window process guarantees the visual consistency and realizes seamless connection.

[0078] In the embodiment, the implementation process of the picture rendering method is as follows:

[0079] Step 1, the vehicle setting window process is switched from the background dormant state to the foreground active state through the system interface, that is, the background vehicle setting window process is opened.

[0080] Step 2, the vehicle setting window process sends a rendering consistency request to the desktop window process; optionally, the rendering consistency request is based on the software protocol framework provided in the above embodiment, the application identifier part of the header structure is filled with the vehicle setting window process identifier, and the other parts of the header structure are filled according to the actual situation and needs, and an example is shown as follows: Figure 3 An example of a filled header is shown; the rendering consistency request is based on the software protocol framework provided in the above embodiment to complete communication.

[0081] Step 3, after receiving the rendering consistency request sent by the vehicle setting window process, the desktop window process fills the information of each rendering element related to rendering consistency locally based on the software protocol framework provided above, obtains the rendering consistency data, and feeds back the rendering consistency data to the vehicle setting window process; optionally, the rendering consistency data is based on the software protocol framework provided in the above embodiment, the application identifier part of the header structure is filled with the desktop window process identifier, and the other parts of the header structure are filled according to the actual situation and needs, and an example is shown as follows: Figure 4 An example of a filled header is shown; the rendering consistency data is based on the software protocol framework provided in the above embodiment to complete communication. Figure 5 An example of a filled header is shown; the rendering consistency data is based on the software protocol framework provided in the above embodiment to complete communication.

[0082] Step four, through the system interface, switching the desktop window process from the foreground active state to the background dormant state, that is, the vehicle setting window covers the desktop window;

[0083] Step five, after receiving the rendering consistency data fed back by the desktop window process, the vehicle setting window process decides the behavior of maintaining the consistency of the rendering effect according to the information of each rendering element in the rendering consistency data, that is, according to the lens, car model and scene information fed back by the desktop window process, the motion state of the lens, car model and scene of the vehicle setting window process is connected, so as to achieve the purpose that the 3D lens can be cross-process transition and the rendering effect is not inconsistent.

[0084] In one embodiment, the second window process sends a rendering consistency request to the first window process, including: the second window process in the foreground active state sends a rendering consistency request to the first window process in the foreground active state.

[0085] In this embodiment, multiple windows can be active on one display screen at the same time, that is, in the scene of multiple window processes sharing a screen, the windows that are in the foreground at the same time all need to ensure visual consistency. The first window process and the second window process are window processes that are in the foreground active state at the same time. In order to ensure the visual consistency of the first window process and the second window process, the second window process can send a rendering consistency request to the first window process during the running of the first window process and the second window process, so that the second window process obtains the rendering consistency data provided by the first window process, and the first window process and the second window process both perform picture rendering based on the rendering consistency data, thereby ensuring the visual consistency of the first window and the second window.

[0086] In one embodiment, the second window process sends a rendering consistency request to the first window process, including: based on the action cycle of picture rendering of the second window process, the second window process periodically sends a rendering consistency request to the first window process.

[0087] In this embodiment, for the first window process and the second window process that are in the foreground active state at the same time, in order to ensure that the first window picture and the second window picture maintain visual consistency regardless of how they change, based on the action cycle of picture rendering of the second window process, the second window process periodically sends a rendering consistency request to the first window process, ensuring that the picture rendered by the second window process in each action cycle maintains visual consistency with the first window picture, further improving the effect of consistency.

[0088] In one embodiment, for the scene of multiple window processes sharing a screen, taking the window processes in the foreground active state including the first window process and the second window process as an example, as shown in FIG. 1, the first window process and the second window process are in the foreground active state at the same time, and the first window process and the second window process are in the foreground active state at the same time. Figure 6As shown, the implementation process of the picture rendering method is as follows:

[0089] In step 601, the second window process sends a rendering consistency request to the first window process based on the animation period of the actual special effect.

[0090] In step 602, after receiving the rendering consistency request sent by the second window process, the first window process fills the information of each rendering element related to rendering consistency locally based on the software protocol framework provided above to obtain rendering consistency data, and feeds back the rendering consistency data to the second window process.

[0091] In step 603, after receiving the rendering consistency data fed back by the first window process, the second window process decides the behavior of maintaining the rendering effect consistency locally according to the information of each rendering element in the rendering consistency data.

[0092] In an exemplary embodiment, taking the vehicle central screen as the processing device, the first window process is the time desktop window process, and the second window process is the real scene road window process. The real-time environment 3D special effect across the time desktop window process and the real scene road window process is implemented as follows:

[0093] First, the real scene road window process sends a rendering consistency request to the time desktop window process based on the animation period of the actual special effect. Exemplarily, the animation period of the real scene road window process is 0.5 seconds. Optionally, the rendering consistency request is based on the software protocol framework provided in the above embodiment, the application identifier part of the header structure is filled with the identifier of the real scene road window process, and the other parts of the header structure are filled according to the actual situation and needs, exemplarily, Figure 7 A data instance after the header is filled is shown. The rendering consistency request is communicated based on the software protocol framework provided in the above embodiment.

[0094] Then, after receiving the rendering consistency request sent by the real scene road window process, the time desktop window process fills the information of each rendering element related to rendering consistency locally based on the software protocol framework provided above to obtain rendering consistency data, and feeds back the rendering consistency data to the real scene road window process. Optionally, the rendering consistency data is based on the software protocol framework provided in the above embodiment, the application identifier part of the header structure is filled with the identifier of the time desktop window process, and the other parts of the header structure are filled according to the actual situation and needs, exemplarily, Figure 8 A header filled instance is shown. In the data part, scene ID, current matrix, target matrix, current color, target color and other information are filled, exemplarily, Figure 9An instance of the data part after being filled is shown; and the rendering consistency data is communicated based on the software protocol framework provided in the above embodiments.

[0095] Finally, after receiving the rendering consistency data fed back by the time-travel desktop window process, the real-scene road condition window process decides the behavior of keeping the rendering effect consistent according to the information of each rendering element in the rendering consistency data, that is, according to the scene information fed back by the time-travel desktop window process, the motion state of the scene of the real-scene road condition window process is connected, so as to achieve the purpose that the scenes across the processes also have consistency in the rendering effect.

[0096] In one embodiment, the rendering consistency data includes the related information of the rendering element for ensuring the visual consistency of the first window picture and the second window picture.

[0097] In this embodiment, the related information of the rendering element includes but is not limited to the element category, the element ID, the current state, the target state, the current color, the target color, the adopted space interpolation algorithm and the adopted color interpolation algorithm. Based on the above embodiments provided in this application, the rendering consistency data can be filled with the corresponding content in the data part based on the software protocol framework provided in the above embodiments, so as to realize the interactive rendering consistency data between the first window process and the second window process.

[0098] In one embodiment, the rendering consistency request includes the identification information of the second window process.

[0099] In this embodiment, the window process is configured with the one-to-one identification information, so as to ensure the normal communication and data security between the window processes. In the implementation solutions provided in the above embodiments, the rendering consistency request includes the identification information of the second window process, so as to ensure the safe transmission of the rendering consistency request.

[0100] In the embodiments of the present application, the rendering consistency data of the first window process and the second window process is acquired; and picture rendering is performed based on the rendering consistency data to ensure the visual consistency of the second window picture rendered by the second window process and the first window picture rendered by the first window process. In this process, the multiple application software does not need to be concentrated in one process, but the rendering consistency data is interacted between the first window process and the second window process to flexibly allocate multiple window processes according to actual business needs, thereby avoiding the high performance requirement of processing resources when multiple application software is concentrated in one process. Meanwhile, when the first window process and the second window process perform picture rendering, the visual consistency of the second window picture and the first window picture is ensured by the rendering consistency data, instead of limiting the design language of the application software, thereby improving the degree of freedom of technical design and development, and reducing the development cost; and various application software can be dynamically accessed to the display process through different window processes, thereby providing more convenient conditions for the upgrade, iteration and maintenance of the application software.

[0101] Further, the number of application processes in each scene can be flexibly allocated according to actual business needs, thereby avoiding all software applications from being concentrated in one application process to meet a certain visual effect, relieving the pressure of system resource load, improving the degree of freedom of technical development, and reducing the development cost; meanwhile, the rendering effect of each window process can be kept consistent based on the interaction between two processes. For the application software between different window processes, a window process intercommunication pipeline is opened, and based on the pipeline technology and related communication protocols, different window processes can intervene in each other's program execution path, and the consistency of the final rendering effect is achieved through such inter-process cooperation. Without the need to constrain the development process of each software application through the specification predefined by the design language, various application software is dynamically accessed from the system software framework level, thereby not only ensuring the consistency of the rendering effect, but also reducing the coupling degree of the design module and the technical module, improving the degree of freedom of design and development, thereby improving the flexibility of the system framework, and reducing the upgrade, iteration and maintenance cost of the software in the later stage.

[0102] Exemplary vehicle

[0103] Correspondingly, the embodiments of the present application also provide a vehicle, which comprises a display screen; and the display screen is used to display the second window picture and the first window picture rendered by the picture rendering method provided in any of the above embodiments.

[0104] The vehicle provided in this embodiment belongs to the same concept as the image rendering method provided in the above embodiments of this application. It can apply the image rendering method provided in any of the above embodiments of this application and has the corresponding functional modules and beneficial effects of the application method. Technical details not described in detail in this embodiment can be found in the specific processing content of the image rendering method provided in the above embodiments of this application, and will not be repeated here.

[0105] Exemplary apparatus

[0106] Accordingly, embodiments of this application also provide a screen rendering apparatus, such as... Figure 10 As shown, the device may include:

[0107] The acquisition module 1001 is used to acquire rendering consistency data between the first window process and the second window process;

[0108] The rendering module 1002 is used to render the screen based on rendering consistency data to ensure visual consistency between the second window screen rendered by the second window process and the first window screen rendered by the first window process.

[0109] In one embodiment, the acquisition module 1001 is used to send a rendering consistency request from the second window process to the first window process; the first window process sends rendering consistency data to the second window process based on the rendering consistency request.

[0110] Rendering module 1002 is used by the second window process to render the screen based on rendering consistency data.

[0111] In one embodiment, the acquisition module 1001 is used to switch the second window process, which is in a background dormant state, to a foreground active state; the second window process sends a rendering consistency request to the first window process, which is in a foreground active state.

[0112] In one embodiment, the acquisition module 1001 is used to switch the first window process, which is in the foreground active state, to the background dormant state after the first window process sends rendering consistency data to the second window process based on the rendering consistency request.

[0113] In one embodiment, the acquisition module 1001 is used to send a rendering consistency request to the first window process, which is in the foreground active state, from the second window process, which is in the foreground active state.

[0114] In one embodiment, the acquisition module 1001 is used to periodically send rendering consistency requests to the first window process based on the action cycle of the second window process's screen rendering.

[0115] In one embodiment, the rendering consistency data includes information about rendering elements that ensure visual consistency of the first window frame and the second window frame.

[0116] In one embodiment, the rendering consistency request includes identification information of the second window process.

[0117] The picture rendering apparatus provided by the embodiment belongs to the same application concept as the picture rendering method provided by the embodiments of the present application, can execute the picture rendering method provided by any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of the execution method. Technical details not described in the embodiment can be referred to the specific processing content of the picture rendering method provided by the embodiments of the present application, which will not be described here.

[0118] Exemplary electronic device

[0119] The embodiments of the present application further provide an electronic device, as shown in the figure, the electronic device comprises a memory 1100 and a processor 1101. Figure 11 The memory 1100 is connected with the processor 1101, and is used for storing programs.

[0120] The memory 1100 is connected with the processor 1101, and is used for storing programs.

[0121] The processor 1101 is used for realizing the picture rendering method in the above embodiments by running the programs stored in the memory 1100.

[0122] Specifically, the above electronic device can further comprise a communication interface 1102, an input device 1103, an output device 1104 and a bus 1105.

[0123] The processor 1101, the memory 1100, the communication interface 1102, the input device 1103 and the output device 1104 are connected with each other through the bus.

[0124] The bus 1105 can include a path for transmitting information between various components of the computer system.

[0125] The processor 1101 can be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or can be an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the program execution of the present application scheme. It can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a ready-to-use programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.

[0126] The processor 1101 can include a main processor, and can further include a baseband chip, a modem, etc.

[0127] The memory 1100 stores programs for implementing the technical solutions of the present application, and can also store an operating system and other key services. Specifically, the programs can include program codes, and the program codes include computer operation instructions. More specifically, the memory 1100 can include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk memory, a flash, etc.

[0128] The input device 1103 can include a device that receives data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor, etc.

[0129] The output device 1104 can include a device that allows information to be output to a user, such as a display screen, a printer, a speaker, etc.

[0130] The communication interface 1102 can include a device using any transceiver to communicate with other devices or communication networks, such as an Ethernet, a radio access network (RAN), a wireless local area network (WLAN), etc.

[0131] The processor 1101 executes the programs stored in the memory 1100, and calls other devices, which can be used to implement each step of the picture rendering method provided by the above-mentioned embodiments of the present application.

[0132] Exemplary computer program product and storage medium

[0133] In addition to the above methods and devices, the embodiments of the present application can also be a computer program product, which includes computer program instructions that, when executed by a processor, cause the processor to perform the steps in the picture rendering method described in the embodiments of the present application.

[0134] The above computer program product can be specifically implemented by hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied as a computer storage medium, and in another optional embodiment, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc.

[0135] The computer program product can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server.

[0136] In addition, the embodiments of the present application can also be storage media, which stores computer programs, and the computer programs are executed by processors to perform the steps of the picture rendering method described in the embodiments of the present application.

[0137] For each method embodiment described above, in order to simply describe, it is expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the action sequence described, because according to the present application, some steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0138] It should be noted that each of the embodiments in the specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The same and similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, it is described relatively simply, and the relevant parts can be referred to the part of the method embodiment.

[0139] The steps in the method of each embodiment of the present application can be adjusted, combined and reduced in sequence according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0140] The modules and sub-modules in the device and terminal provided by each embodiment of the present application can be combined, divided and reduced according to actual needs.

[0141] It should be understood that the disclosed terminal, device and method can be implemented in other ways. For example, the terminal embodiments described above are merely illustrative. For example, the division of modules or sub-modules is merely a logical function division. In actual implementation, another division manner can be used. For example, a plurality of sub-modules or modules can be combined or integrated into another module, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed modules can be indirect coupling or communication connection through some interfaces, devices or modules, and can be electrical, mechanical or other forms.

[0142] The modules or sub-modules described as separate components can or can not be physically separate, and the components of the modules or sub-modules can or can not be physical modules or sub-modules, i.e. can be located in one place or distributed on a plurality of network modules or sub-modules. Some or all of the modules or sub-modules can be selected according to actual needs to achieve the purpose of the embodiment.

[0143] In addition, the functional modules or sub-modules in each embodiment of the present application can be integrated into a processing module, or each module or sub-module can exist physically, or two or more modules or sub-modules can be integrated into one module. The integrated module or sub-module can be realized in the form of hardware or software functional module or sub-module.

[0144] The skilled person can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in general terms in the above description. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0145] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein can be directly implemented by hardware, software units executed by a processor, or a combination of both. The software units can be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0146] Finally, it should be noted that, in this document, the term "only" is used simply to set off from one entity or action to another in order to avoid the use of the term "and / or" or the like for the sake of clarity. In no way should the term "only" be interpreted as implying that there is an implied exclusion of any referenced entity or action. Moreover, the terms "comprising", "including", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the recited element.

[0147] The above description of disclosed embodiments provides enabling teaching for making or using the application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein can be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for rendering images, characterized in that, include: Obtain rendering consistency data for the first window process and the second window process; the rendering consistency data is the data corresponding to consistent rendering elements, and the consistent rendering elements are the same rendering elements in the rendering screens corresponding to the first window process and the second window process. The rendering elements are components that constitute the rendered screen; the first window process and the second window process correspond to different software applications; The first window process is rendered based on the rendering consistency data to obtain the first window image. The second window process is then rendered based on the rendering consistency data to obtain the second window image, so as to ensure visual consistency between the second window image rendered by the second window process and the first window image rendered by the first window process.

2. The image rendering method according to claim 1, characterized in that, The step of obtaining rendering consistency data between the first window process and the second window process includes: The second window process sends a rendering consistency request to the first window process; The first window process sends the rendering consistency data to the second window process based on the rendering consistency request; The rendering of the image based on the rendering consistency data includes: The second window process renders the screen based on the rendering consistency data.

3. The image rendering method according to claim 2, characterized in that, The second window process sends a rendering consistency request to the first window process, including: Switch the second window process, which is in a background dormant state, to a foreground active state; The second window process sends a rendering consistency request to the first window process, which is in the foreground active state.

4. The image rendering method according to claim 3, characterized in that, After the first window process sends the rendering consistency data to the second window process based on the rendering consistency request, the process further includes: Switch the first window process, which is active in the foreground, to a background dormant state.

5. The image rendering method according to claim 2, characterized in that, The second window process sends a rendering consistency request to the first window process, including: The second window process, which is active in the foreground, sends a rendering consistency request to the first window process, which is also active in the foreground.

6. The image rendering method according to claim 2, characterized in that, The second window process sends a rendering consistency request to the first window process, including: Based on the rendering cycle of the second window process, the second window process periodically sends rendering consistency requests to the first window process.

7. The image rendering method according to any one of claims 2-6, characterized in that, The rendering consistency request includes the identification information of the second window process.

8. A vehicle, characterized in that, The vehicle includes a display screen; The display screen is used to display the second window image and the first window image rendered by the image rendering method as described in any one of claims 1-7.

9. An electronic device, characterized in that, include: Memory and processor; The memory is connected to the processor and is used to store programs; The processor is used to implement the screen rendering method as described in any one of claims 1-7 by running the program in the memory.

10. A computer program product, characterized in that, Includes computer program instructions; When the computer program instructions are executed by the processor, the processor causes the processor to perform the screen rendering method as described in any one of claims 1-7.

Citation Information

Patent Citations

  • User interface rendering method and device of application program, medium and electronic equipment

    CN110347464A

  • Cross-process interface for non-compatible frameworks

    CN111936967A