Display method and electronic equipment

Abstract

The invention discloses a display method and electronic equipment, and relates to the technical field of Internet of Vehicles. The method comprises the steps that the electronic equipment displays a first interface, the first interface is a first picture of a first application, and a first target is displayed in the center of the first picture of the first application. The electronic equipment responds to the first instruction and displays a second interface dynamically changed from the first interface, the second interface is a split-screen interface of a second picture of the first application and a first picture of the second application, and the second picture of the first application is a partial picture of the first picture of the first application; the first target is displayed in the center of the second picture of the first application. The first picture and the second picture of the first application can be the 3D picture rendered by the ADAS, and the first picture of the second application can be the live-action picture acquired by the camera, so that split-screen display of the 3D picture and the live-action picture can be realized, and the first target (such as a 3D image of a vehicle) is still in the center of the split-screen 3D picture, so that the first target can be ensured not to be shielded, and the user experience is improved. And the display effect is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle networking technology, and in particular to a display method and an electronic device. Background Art

[0002] At present, in the driving and parking scenarios, the central control screen of the vehicle may display a three-dimensional (3D) picture (or interface) rendered by the advanced driver assistance system (ADAS) and a real scene picture collected by the camera. In the current display method, the above two pictures are displayed by switching the screen, and the display effect is poor. Summary of the invention

[0003] The present application provides a display method and an electronic device, which can display a 3D image and a real-scene image in a split screen to improve the display effect.

[0004] In order to achieve the above objectives, this application adopts the following technical solutions:

[0005] In a first aspect, a display method is provided, which is applied to an electronic device with a display screen, and the method includes: displaying a first interface, wherein the first interface is a first screen of a first application, and a first target is displayed in the center of the first screen of the first application; in response to a first instruction, displaying a second interface that dynamically changes from the first interface; wherein the second interface is a split-screen interface of the second screen of the first application and the first screen of the second application, the second screen of the first application is a partial screen of the first screen of the first application, and the first target is displayed in the center of the second screen of the first application.

[0006] For example, the first screen and the second screen of the first application can be 3D pictures rendered by ADAS, and the first screen of the second application can be a real-scene picture captured by a camera. In this way, the 3D picture and the real-scene picture can be displayed in split-screen on a display screen with limited space. When the first target (such as the 3D image of the vehicle) is displayed in the center of the 3D picture before the split-screen display, after the split-screen display, the first target remains displayed in the center of the 3D picture after the split-screen display, which can ensure that the central area of ​​the 3D picture is not blocked, thereby improving the display effect.

[0007] In a possible design, in the process of displaying the first interface dynamically changing to the second interface, the method further includes: displaying at least one frame of a third interface, the third interface being a split-screen interface of a third screen of the first application and a second screen of the second application, the third screen of the first application being a partial screen of the first screen of the first application, the first target being displayed at the center of the third screen of the first application, and the second screen of the second application being a partial screen of the first screen of the second application. Optionally, the second screen of the first application, the third screen of the first application, etc. can all be screens that are cropped from the first screen of the first application. The second screen of the second application can be a screen that is cropped from the first screen of the second application.

[0008] Based on this design, in the process from displaying the first screen of the first application to displaying the split-screen interface of the second screen of the first application and the first screen of the second application, multiple frames of the split-screen interface of the third screen of the first application and the second screen of the second application are displayed, and the third screen of the first application is a partial screen of the first screen of the first application, and the second screen of the second application is a partial screen of the first screen of the second application. The split-screen display process can present a smooth animation effect, and when displaying multiple frames of the third screen of the first application, the first target is still in the center of the third screen of each first application. In this way, during the entire animation process, the first target can always remain in the center of the 3D screen and will not be blocked, thereby achieving a one-shot animation effect.

[0009] In one possible design, after displaying the second interface dynamically changed from the first interface in response to the first instruction, the method further includes: receiving a second instruction; and displaying the first interface dynamically changed from the second interface in response to the second instruction. Based on this design, the electronic device can also restore from displaying the second interface to displaying the first interface, achieving the effect of restoring from a split-screen interface to a full-screen interface.

[0010] In a possible design, in the process of displaying the first interface that changes dynamically from the second interface, the method further includes: displaying at least one frame of the third interface. Based on this design, in the process of the electronic device restoring from the split-screen interface to the full-screen interface, at least one frame of the split-screen interface can also be displayed, so that the process of restoring from the split-screen interface to the full-screen interface can also present a smooth animation effect, ensuring that during the entire animation process, the first target always remains in the center of the 3D screen and will not be blocked, achieving a one-shot animation effect.

[0011] In one possible design, the sizes of the third screens of the first application included in different third interfaces are different; and / or the sizes of the second screens of the second application included in different third interfaces are different. Based on this design, the sizes of the third screens of the first application included in different third interfaces are different, and when displaying multiple frames of the third screen of the first application, an animation effect of "banner pull-out" can be presented. The sizes of the second screens of the second application included in different third interfaces are different, and when displaying multiple frames of the second screen of the second application, an animation effect of "banner pull-in" can be presented.

[0012] In one possible design, before displaying at least one frame of the third interface, the method further includes: rendering the data of the first screen of the first application through the first control (or rendering the data of the first screen of the first application into the memory corresponding to the first control), and rendering the data of the first screen of the second application through the second control (or rendering the data of the first screen of the second application into the memory corresponding to the second control), and the data of the first screen of the first application and the data of the second screen of the second application are used to generate the third interface and the second interface. Exemplarily, the type of the first control and / or the second control can be SurfaceView.

[0013] Optionally, before displaying the first screen of the first application or before displaying the first frame of the third interface in at least one frame, the data of the first screen of the first application can be rendered through the first control. Before displaying the first frame of the third interface in at least one frame, the data of the first screen of the second application can be rendered through the second control.

[0014] Based on this design, before displaying the third screen of the first application, the data of the first screen of the first application is rendered based on the first control, and the data of the first screen of the first application can be used to generate the third screen of the first application. In this way, for different third screens of the first application, the rendered screen data is unchanged, and they are all data of the first screen of the first application. In this way, when the electronic device displays each frame of the third screen of the first application, it is not necessary to re-render the required screen data, which can save system overhead and improve development efficiency. For example, the first screen and the third screen of the first application can be 3D screens, and the 3D engine only needs to render the data of the size of the first screen of the first application, that is, the area size of the 3D screen actually rendered by the 3D engine is unchanged. In this way, the 3D engine does not need to re-render the data of the 3D screen, which can reduce performance consumption and avoid the flash screen problem that may be caused by re-rendering the data of the 3D screen. In addition, if the area size of the rendered 3D screen changes, it is necessary to adapt different rendering engines. In this way, since the area size of the rendered 3D screen will not change, there is no need to adapt different rendering engines, which can improve development efficiency.

[0015] Similarly, before displaying the third screen of the first application, the data of the first screen of the second application is rendered based on the second control, and the data of the first screen of the second application can be used to generate the second screen of the second application. In this way, for different second screens of the second application, the rendered screen data is unchanged, and they are all data of the first screen of the second application. In this way, when the electronic device displays each frame of the second screen of the second application, it is not necessary to re-render the required screen data, which can also save system overhead and improve development efficiency. For example, the first screen and the second screen of the second application can be real-scene screens. In this way, it is sufficient to render the data of the size of the first screen of the second application once, and the real-scene screen does not need to be rebuilt, that is, there is no need to repeatedly render the real-scene screen, which can greatly reduce performance consumption and avoid the flash screen problem that may be caused by the reconstruction of the screen. In addition, if the area size of the rendered real-scene screen changes, it is necessary to adapt different APA controllers, vehicle video stream channels, etc. In this way, the area size of the rendered real-scene screen will not change, and there is no need to adapt different APA controllers, vehicle video stream channels, etc., which can also greatly improve development efficiency.

[0016] In one possible design, before displaying each frame of the third interface in at least one frame of the third interface, the method further includes: generating the third screen of the first application based on the data of the first screen of the first application and the parameters of the first layout corresponding to the third screen of the first application included in each frame of the third interface, the parameters of the first layout indicating the display effect of the data of the first screen of the first application on the display screen. Optionally, the data of the first screen of the first application may be displayed entirely or partially on the display screen. Generating the second screen of the second application based on the data of the first screen of the second application and the parameters of the second layout corresponding to the second screen of the second application included in each frame of the third interface, the parameters of the second layout indicating the display effect of the data of the first screen of the second application on the display screen. Optionally, the data of the second screen of the second application may be displayed entirely or partially on the display screen. Synthesizing each frame of the third interface based on the third screen of the first application and the second screen of the second application.

[0017] Based on this design, the third screen of each frame of the first application can be generated according to the data of the first screen of the rendered first application and the layout parameters corresponding to the third screen of each frame of the first application, and the second screen of each frame of the second application can be generated according to the data of the first screen of the rendered second application and the layout parameters corresponding to the second screen of each frame of the second application, thereby generating a third interface. The purpose of constantly changing the size of the picture (such as 3D picture, real-scene picture) displayed on the display screen can be achieved, and the picture can be ensured not to be scaled or stretched, thereby achieving a smooth animation effect. And there is no need to modify the size of the actual rendered picture, so that the 3D picture and the real-scene picture do not need to be re-rendered, which can reduce performance consumption and improve development efficiency.

[0018] In one possible design, before displaying the second interface, the method also includes: generating the second screen of the first application based on the data of the first screen of the first application and the parameters of the first layout corresponding to the second screen of the first application, the parameters of the first layout indicating the display effect of the data of the first screen of the first application on the display screen; generating the first screen of the second application based on the data of the first screen of the second application and the parameters of the second layout corresponding to the first screen of the second application, the parameters of the second layout indicating the display effect of the data of the first screen of the second application on the display screen; and synthesizing the second interface based on the second screen of the first application and the first screen of the second application.

[0019] Based on this design, the second screen of the first application can be generated according to the data of the first screen of the first application rendered and the parameters of the layout corresponding to the second screen of the first application, and the first screen of the second application can be generated according to the data of the first screen of the second application rendered and the parameters of the layout corresponding to the first screen of the second application, and then the second interface is generated. The purpose of split-screen display of the second screen of the first application and the first screen of the second application can be achieved, and it can also ensure that the screen will not be scaled or stretched. And there is no need to modify the size of the actual rendered screen, so that both the 3D screen and the real-scene screen do not need to be re-rendered, which can reduce performance consumption and improve development efficiency.

[0020] In one possible design, the parameters of the first layout are determined according to the animation parameters of the first screen configuration of the first application, and the parameters of the second layout are determined according to the animation parameters of the first screen configuration of the second application; the animation parameters of the first screen configuration of the first application and / or the animation parameters of the first screen configuration of the second application indicate a plurality of starting position, ending position, moving duration, moving direction, moving distance, and moving speed. Based on this design, the layout parameters corresponding to the third screen of the first application and the second screen of the first application in each frame are determined based on the animation parameters of the first screen configuration of the first application, and then the screen of each frame of the first application in the animation process can be generated; the layout parameters corresponding to the second screen of the second application and the first screen of the second application in each frame are determined based on the animation parameters of the first screen configuration of the second application, and then the screen of each frame of the second application in the animation process can be generated. Finally, each frame interface of the animation process generated above is displayed, and a smooth animation effect can be achieved.

[0021] In one possible design, the moving direction and moving duration indicated by the animation parameters of the first screen configuration of the first application are respectively the same as the moving direction and moving duration indicated by the animation parameters of the first screen configuration of the second application; and / or, the ratio between the moving distance indicated by the animation parameters of the first screen configuration of the first application and the moving distance indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface; and / or, the ratio between the moving speed indicated by the animation parameters of the first screen configuration of the first application and the moving speed indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface.

[0022] Based on this design, the moving direction indicated by the animation parameters of the first screen configuration of the first application is the same as the moving direction indicated by the animation parameters of the first screen configuration of the second application, so that the screen of the first application and the screen of the second application can move in one direction to achieve the effect of banner movement. The moving duration indicated by the animation parameters of the first screen configuration of the first application is the same as the moving duration indicated by the animation parameters of the first screen configuration of the second application, so that the screen of the first application and the screen of the second application can be animated together, making the animation more synchronized. The ratio between the moving distance indicated by the animation parameters of the first screen configuration of the first application and the moving distance indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface, so that the effect of the screen of the first application and the screen of the second application can be displayed according to the split-screen ratio when the screen is split. And / or, the ratio between the moving speed indicated by the animation parameters of the first screen configuration of the first application and the moving speed indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface. In this way, a one-shot display effect can be achieved.

[0023] In one possible design, the first screen of the second application is displayed in a layer above the second screen of the first application; the second screen of the second application is displayed in a layer above the third screen of the first application. Based on this design, the screen of the second application is always displayed on the upper layer of the screen of the first application, which can ensure that the screen of the second application can cover a part of the screen of the first application, so that the screens of the two applications can be better connected, reducing the probability of a gap between the two screens. In addition, since the ratio of the moving speed of the screen of the first application to the moving speed of the screen of the second application is the same as the ratio when the screen is split, when the screen of the first application moves out of a part of the display screen, the screen of the second application can cover a part of the screen of the first application, so that the first target can always be in the center of the screen of the first application, achieving a one-shot display effect.

[0024] In one possible design, the first application is an advanced driver assistance system (ADAS) application, and the second application is a camera application.

[0025] In one possible design, the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface is 1:2.

[0026] In a second aspect, an electronic device is provided, which has the function of implementing the method described in the first aspect and any of the designs thereof. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In a possible example, the electronic device includes a display unit (or display module) and a processing unit (or processing module); the display unit is used to display a first interface, the first interface is a first screen of a first application, and the center of the first screen of the first application displays a first target; the processing unit is used to respond to a first instruction and display a second interface dynamically changed from the first interface through the display unit; wherein the second interface is a split-screen interface of the second screen of the first application and the first screen of the second application, the second screen of the first application is a partial screen of the first screen of the first application, and the first target is displayed in the center of the second screen of the first application.

[0027] In one possible design, the display unit, while dynamically changing from displaying the first interface to the second interface, is also used to display at least one frame of a third interface, where the third interface is a split-screen interface of a third screen of the first application and a second screen of the second application, the third screen of the first application is a partial screen of the first screen of the first application, the first target is displayed at the center of the third screen of the first application, and the second screen of the second application is a partial screen of the first screen of the second application.

[0028] In one possible design, the processing unit is further used to receive a second instruction; and in response to the second instruction, display the first interface that dynamically changes from the second interface.

[0029] In one possible design, the display unit is used to display at least one frame of the third interface during the process of displaying the first interface that dynamically changes from the second interface.

[0030] In one possible design, the sizes of the third screens of the first application included in different third interfaces are different; and / or the sizes of the second screens of the second application included in different third interfaces are different.

[0031] In one possible design, the processing unit is also used to render data of the first screen of the first application through the first control, and to render data of the first screen of the second application through the second control. The data of the first screen of the first application and the data of the second screen of the second application are used to generate a third interface and a second interface.

[0032] In one possible design, the processing unit is further used to generate the third screen of the first application based on the data of the first screen of the first application and the parameters of the first layout corresponding to the third screen of the first application included in each frame of the third interface, and the parameters of the first layout indicate the display effect of the data of the first screen of the first application on the display screen; the processing unit is further used to generate the second screen of the second application based on the data of the first screen of the second application and the parameters of the second layout corresponding to the second screen of the second application included in each frame of the third interface, and the parameters of the second layout indicate the display effect of the data of the first screen of the second application on the display screen; the processing unit is also used to synthesize each frame of the third interface based on the third screen of the first application and the second screen of the second application.

[0033] In one possible design, the processing unit is further used to generate the second screen of the first application based on the data of the first screen of the first application and the parameters of the first layout corresponding to the second screen of the first application, and the parameters of the first layout indicate the display effect of the data of the first screen of the first application on the display screen; the processing unit is further used to generate the first screen of the second application based on the data of the first screen of the second application and the parameters of the second layout corresponding to the first screen of the second application, and the parameters of the second layout indicate the display effect of the data of the first screen of the second application on the display screen; the processing unit is further used to synthesize the second interface based on the second screen of the first application and the first screen of the second application.

[0034] In one possible design, the parameters of the first layout are determined according to the animation parameters of the first screen configuration of the first application, and the parameters of the second layout are determined according to the animation parameters of the first screen configuration of the second application; the animation parameters of the first screen configuration of the first application and / or the animation parameters of the first screen configuration of the second application indicate multiple ones of the starting position, ending position, moving duration, moving direction, moving distance, and moving speed.

[0035] In one possible design, the moving direction and moving duration indicated by the animation parameters of the first screen configuration of the first application are respectively the same as the moving direction and moving duration indicated by the animation parameters of the first screen configuration of the second application; and / or, the ratio between the moving distance indicated by the animation parameters of the first screen configuration of the first application and the moving distance indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface; and / or, the ratio between the moving speed indicated by the animation parameters of the first screen configuration of the first application and the moving speed indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface.

[0036] In one possible design, the first screen of the second application is displayed in a layer above the second screen of the first application; the second screen of the second application is displayed in a layer above the third screen of the first application.

[0037] In one possible design, the first application is an advanced driver assistance system (ADAS) application, and the second application is a camera application.

[0038] In one possible design, the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface is 1:2.

[0039] In a third aspect, an electronic device is provided, comprising: a processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and the processor reads the computer instructions from the memory so that the electronic device executes the method as described in the first aspect and any one of the designs thereof. Optionally, the memory may be coupled to the processor or may be independent of the memory.

[0040] In one possible design, the electronic device further includes a communication interface, which can be used for the electronic device to communicate with other devices. Exemplarily, the communication interface can be a transceiver, an input / output interface, an interface circuit, an output circuit, an input circuit, a pin or a related circuit, etc.

[0041] In a fourth aspect, a vehicle is provided, comprising: a processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, the processor reading the computer instructions from the memory so that the vehicle executes the method as described in the first aspect and any one of the designs thereof. Optionally, the memory may be coupled to the processor or may be independent of the memory.

[0042] In a fifth aspect, a vehicle-mounted system is provided, including a vehicle-mounted module and a display screen, wherein the vehicle-mounted module is used to cooperate with the display to execute the method described in the first aspect and any one of the designs thereof.

[0043] In a sixth aspect, a vehicle-mounted module is provided, comprising: a processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, the processor reading the computer instructions from the memory, so that the vehicle-mounted module executes the method as described in the first aspect and any one of the designs thereof. Optionally, the memory may be coupled to the processor or may be independent of the memory.

[0044] In a seventh aspect, a computer-readable storage medium is provided, the computer-readable storage medium comprising a computer program, and when the computer program runs on an electronic device, the electronic device executes the method described in the first aspect and any one of the designs thereof.

[0045] In an eighth aspect, a computer program product is provided, the computer program product comprising: a computer program or instructions, when the computer program or instructions are run on a computer, the computer executes the method described in the first aspect and any one of the designs thereof.

[0046] According to a ninth aspect, a circuit system is provided, the circuit system comprising a processing circuit, wherein the processing circuit is configured to execute the method described in any one of the designs of the first aspect.

[0047] In the tenth aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor, and when the at least one processor executes the instructions, the at least one processor executes a method as described in any one of the designs in the first aspect above.

[0048] It should be noted that the technical effects brought about by any design in the above-mentioned second to tenth aspects can refer to the technical effects brought about by the corresponding design in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 A schematic diagram of a 3D image provided in an embodiment of the present application;

[0050] Figure 2 A schematic diagram of an existing scene for displaying a 3D image and a real scene image;

[0051] Figure 3 It is another existing scene schematic diagram for displaying 3D images and real scene images;

[0052] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0053] Figure 5a A schematic diagram of the structure of another electronic device provided in an embodiment of the present application;

[0054] Figure 5b A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0055] Figure 5c A schematic diagram of a process of completing 3D image display by an electronic device provided in an embodiment of the present application;

[0056] Figure 6 A schematic diagram of another 3D image provided in an embodiment of the present application;

[0057] Figure 7 A schematic diagram of a split-screen interface provided in an embodiment of the present application;

[0058] Figure 8 A schematic diagram of an interface of a reminder message provided in an embodiment of the present application;

[0059] Figure 9a A schematic diagram of a process of displaying a 3D image provided by an embodiment of the present application;

[0060] Figure 9b A schematic diagram of another process of displaying a 3D image provided in an embodiment of the present application;

[0061] Fig.9c A schematic diagram of another process of displaying a 3D image provided in an embodiment of the present application;

[0062] Fig.10a A schematic diagram of an interface for setting animation parameters provided in an embodiment of the present application;

[0063] Fig.10b A schematic diagram of a screen direction provided in an embodiment of the present application;

[0064] Fig.11 Schematic diagrams of some cropped images provided in the embodiments of the present application;

[0065] Fig.12 A schematic diagram of a scenario in which a real scene image blocks a 3D image provided in an embodiment of the present application;

[0066] Fig.13 A schematic diagram of the structure of another electronic device provided in an embodiment of the present application;

[0067] Fig.14 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] The technical solution provided by the embodiments of the present application is described in detail below in conjunction with the accompanying drawings.

[0069] The terms "including" and "having" and any variations thereof mentioned in the description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0070] It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0071] In the description of this application, unless otherwise specified, the meaning of "plurality" refers to two or more. "And / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0072] As an important part of intelligent driving technology, ADAS can sense the surrounding environment of the vehicle through various types of sensors, such as but not limited to cameras, laser radars, etc., and render 3D images based on the sensed surrounding environment, and present the 3D images on the vehicle's central control screen to assist the vehicle in intelligent and safe driving. Due to its powerful perception capabilities, ADAS is widely used in various intelligent driving scenarios, such as but not limited to driving scenarios, driving and parking scenarios, etc.

[0073] The 3D picture rendered by the ADAS may include one or more 3D images, which may include but are not limited to a 3D image of the vehicle itself and a 3D image of one or more objects in the vehicle's surroundings. Figure 1 FIG. 1 shows a schematic diagram of a 3D image provided by an embodiment of the present application. Figure 1 As shown, the 3D picture 100 includes a 3D image 101 of the vehicle and 3D images of objects in the environment surrounding the vehicle, such as but not limited to 3D images 102 of one or more other vehicles ( Figure 1 3), a 3D image 103 of a road line ( Figure 1 5 are shown), a 3D image 104 of a pedestrian, and Figure 1 One or more of 3D images of road signs not shown, 3D images of animals, 3D images of roadblocks, etc.

[0074] In the integrated driving and parking scenario, in order to improve parking safety and provide users with a better parking experience, the 3D images rendered by ADAS and the real-life images captured by the camera may be displayed on the vehicle's central control screen.

[0075] In an existing display method, the above two images are displayed successively by switching the screen. Figure 2A schematic diagram of a display interface is shown. Figure 2 As shown in (1), a 3D image 200 can be displayed on the central control screen of the vehicle. The 3D image 200 includes a 3D image 201 of the vehicle and 3D images of various objects in the environment around the vehicle, such as 3D images 202 of other vehicles ( Figure 2 (1) shows 7) and 3D images 203 of parking spaces ( Figure 2 (1) shows 8) etc.

[0076] Then, the central control screen of the vehicle receives an operation for displaying the real scene captured by the camera, such as the user's Figure 1 In response to a click operation on the 3D image 203 of a parking space shown in (1), the central control screen of the vehicle can jump to Figure 2 The real scene picture 210 shown in (2) includes one or more images of objects (such as but not limited to people, objects, etc.) captured by the camera.

[0077] In the above implementation, the 3D image rendered by ADAS and the real-scene image captured by the camera cannot be displayed on the vehicle's central control screen at the same time, resulting in poor display effect and poor user experience.

[0078] Another existing display method is to display the real scene captured by the camera in the form of a floating window on the 3D picture rendered by the ADAS. Figure 3 Another display interface schematic diagram is shown. Figure 3 As shown, the real scene image 210 is suspended and displayed on the 3D image 200. In this implementation, the content of the 3D image will be blocked, the display effect is also poor, and the user experience is not good. In addition, since the content of the 3D image (such as the central area) is blocked, it may not be possible to improve the safety of parking.

[0079] Based on this, an embodiment of the present application provides a display method that can display the 3D images rendered by ADAS and the real-scene images captured by the camera in a split-screen manner on a display screen with limited space, so that the 3D images rendered by ADAS and the real-scene images captured by the camera can be displayed on the display screen more efficiently and reasonably. While improving the display effect, it can also improve the driving safety of the vehicle and ensure the user experience.

[0080] The technical solution provided by the embodiment of the present application can be applied to various scenarios where two or more images need to be displayed simultaneously, including but not limited to displaying the 3D image rendered by ADAS and the real scene image captured by the camera in the driving and parking scene; and displaying the video playback image and the full scene image captured by the camera in the smart home scene.

[0081] The technical solution provided in the embodiment of the present application can be applied to the electronic device 100, or to a system including the electronic device 100.

[0082] Exemplarily, the electronic device 100 may be a smart cockpit, a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device, etc.

[0083] In some embodiments, the electronic device 100 may be a fixed device or a portable device. The operating system installed in the electronic device 100 includes but is not limited to Or other operating systems. This application does not limit the specific type of the electronic device 100 or the installed operating system.

[0084] For example, Figure 4 A schematic structural diagram of an electronic device 100 provided in an embodiment of the present application is shown.

[0085] like Figure 4 As described, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a camera 191, a display screen 192, etc.

[0086] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0087] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0088] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0089] In some embodiments, processor 110 may include one or more interfaces.

[0090] The charging management module 140 is used to receive charging input from a charger. While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device 100 through the power management module 141 .

[0091] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display screen 192, the camera 191, and the wireless communication module 160.

[0092] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0093] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 can be set in the same device as at least some modules of the processor 110.

[0095] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module.

[0096] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0097] The electronic device 100 implements the display function through a GPU, a display screen 192, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 192 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0098] The display screen 192 is used to display images, videos, etc. The display screen 192 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 192, where N is a positive integer greater than 1. In some embodiments of the present application, the display screen 192 can be used to display 3D images rendered by ADAS, real-life images captured by cameras, etc.

[0099] The electronic device 100 can realize the shooting function through ISP, camera 191, video codec, GPU, display screen 192 and application processor.

[0100] The camera 191 is used to capture static images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 191, where N is a positive integer greater than 1. In some embodiments of the present application, the camera 191 may be used to capture real-life images. In other embodiments of the present application, the camera 191 may also be used to sense the surrounding environment of the electronic device 100 or other devices (such as vehicles).

[0101] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0102] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0103] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170 and the application processor.

[0104] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. In some embodiments of the present application, the audio module 170 can be used to receive instructions input by the user.

[0105] The sensor module 180 may include various types of sensors, such as but not limited to one or more of a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, a radar, a laser radar, an inertial measurement unit (IMU), etc. In some embodiments of the present application, the sensor module 180 may be used to sense the surrounding environment.

[0106] The key 190 includes a power button, a volume button, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100. In some embodiments of the present application, the key 190 may also be used to receive instructions input by the user.

[0107] In some embodiments, the electronic device 100 may also include (or be configured with) an ADAS module (not shown in the figure). The ADAS module may be used to sense the surrounding environment of the electronic device 100 or other devices (such as vehicles) and render 3D images.

[0108] In some examples, the ADAS module can sense the surrounding environment of the electronic device or other devices through various types of sensors. Optionally, the various types of sensors can be sensors included in the sensor module 180, as well as cameras 191, etc., or can be additionally configured sensors. When the various types of sensors are sensors included in the sensor module 180, as well as cameras 191, etc., the sensor module 180 and / or the camera 191 can be integrated into the ADAS module, or can be set independently of the ADAS module. In some examples, the ADAS module can also render 3D images through a processor, such as but not limited to the processor 100, or an additionally configured processor.

[0109] In other embodiments, the ADAS module may also be provided in other devices (such as vehicles), and the ADAS module may be used to sense the surrounding environment of the electronic device 100 or other devices and render 3D images. The electronic device 100 may receive the 3D images rendered by the ADAS module from the other device. Optionally, the electronic device 100 may be installed on the other device or may not be installed on the other device.

[0110] The above is merely an example of the structure of the electronic device 100 in the embodiment of the present application, but does not constitute a limitation on the structure and form of the electronic device 100. The embodiment of the present application does not limit the structure and form of the electronic device 100. Figure 5a FIG. 2 shows another exemplary structure of the electronic device 100 according to an embodiment of the present application. Figure 5a As shown, the electronic device 100 includes a processor 501, a memory 502, and a display screen 503. The implementation of the processor 501, the memory 502, and the display screen 503 can refer to Figure 4 The related implementations of the processor, memory, and display are shown.

[0111] It is to be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device may include Figure 4 , Figure 5a More or fewer components are shown, or some components are combined, or some components are separated, or different component arrangements are arranged. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0112] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture, etc. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0113] Figure 5b A schematic diagram of the software structure of an electronic device 100 is provided for an embodiment of the present invention.

[0114] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system may include four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0115] The application layer can include a series of application packages.

[0116] like Figure 5bAs shown, the application package may include applications such as gallery, map, ADAS application, music, navigation, Bluetooth, camera application (or camera application), etc.

[0117] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0118] like Figure 5b As shown, the application framework layer may include a window manager service (WMS), a content provider, a view system, a notification manager, a surface composition (SurfaceFlinger) service, and the like.

[0119] WMS can be used to manage the graphical user interface (GUI) resources used on the screen of the electronic device 100, which may specifically include: window creation and destruction, window display and hiding, window layout, focus management, input method and wallpaper management, etc.

[0120] Content providers are used to store and retrieve data and make it accessible to applications.

[0121] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views.

[0122] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0123] The SurfaceFlinger service can be used to render one or more layers, synthesize one or more layers into a frame of image, and transmit the image to the display screen for display.

[0124] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0125] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0126] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0127] The system library can include multiple functional modules, such as surface manager, media library, 3D engine, 2D graphics engine (such as SGL), etc.

[0128] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0129] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0130] The 3D engine can be used to implement rendering of 3D images, etc.

[0131] A 2D graphics engine is a drawing engine for 2D drawings.

[0132] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, sensor driver, and hardware composer (HWC).

[0133] HWC is a module of the HAL layer for layer synthesis and display, providing hardware support for the SurfaceFlinger service.

[0134] Understandably, Figure 5b The software structure of the electronic device 100 shown is only an example. In actual applications, it may include more or fewer modules, and the layers to which each module belongs may also be different. For example, the HWC may also be located in the application framework layer, etc., which is not limited in the present embodiment.

[0135] The following takes the electronic device 100 displaying a 3D image rendered by an ADAS as an example to introduce the process of the electronic device 100 completing the 3D image display. Figure 5c A schematic diagram of a process of completing 3D image display by an electronic device 100 provided in an embodiment of the present application is shown.

[0136] The ADAS application first applies for a surface view (SurfaceView) from the SurfaceFlinger service through WMS. SurfaceView corresponds to a screen buffer that can be used to save image data. It can be understood that SurfaceView is a general control dedicated to displaying video streams, 3D images, etc. The embodiment of the present application takes SurfaceView as an example. In actual applications, other controls can also be used, such as TextureView or other types of controls. The embodiment of the present application does not limit this. The ADAS application then passes the SurfaceView to the 3D engine. Correspondingly, after the 3D engine receives the SurfaceView, it renders the SurfaceView, that is, renders the data of the 3D picture into the memory corresponding to the SurfaceView. After the 3D engine completes the rendering, it sends the SurfaceView to the ADAS application, such as the rendering thread of the ADAS application.

[0137] Then the ADAS application defines the parameters of the frame layout (FrameLayout), where the parameters of FrameLayout indicate the display effect of the 3D image data on the display screen (such as but not limited to the display area and display size on the display screen). For example, the parameters of FrameLayout can control the size of the window used to display the 3D image, and then control the display effect of the 3D image on the display screen. It can be understood that the embodiment of the present application takes FrameLayout as an example. In actual applications, other layout methods can also be used, such as: relative layout (RelativeLayout), linear layout (LinearLayout) or other types of layouts, and the embodiment of the present application does not make specific restrictions on this.

[0138] Furthermore, the ADAS application can send the parameters of SurfaceView and FrameLayout rendered by the 3D engine to SurfaceFlinger, HWC, etc. through the rendering thread. SurfaceFlinger, HWC, etc. synthesize the image and finally transmit the synthesized image to the display screen for display.

[0139] The technical solutions involved in the following embodiments can all be implemented in Figure 4 , Figure 5a , Figure 5b The invention is implemented in the device of the structure shown.

[0140] The embodiment of the present application provides a display method, and an electronic device can efficiently and reasonably display two pictures through a split screen of a display screen, thereby improving the display effect. It can be understood that when an electronic device displays two pictures in a split screen, "split screen" can refer to the electronic device dividing the display screen into two display areas, and the two display areas are used to display the two pictures respectively. Optionally, the two display areas can be arranged left and right, that is, the two pictures can be displayed in a left-right split screen manner, or the two display areas can also be arranged up and down, that is, the two pictures can be displayed in a top-down split screen manner. Of course, the two display areas can also be arranged in other ways, and this application does not specifically limit this.

[0141] Of course, when the electronic device displays more than two images in split screen, "split screen" may refer to the electronic device dividing the display screen into multiple display areas, which are respectively used to display the multiple images. The embodiment of the present application does not limit the arrangement of the multiple display areas.

[0142] Optionally, in an embodiment of the present application, the two pictures displayed by the electronic device in split screen can be pictures of different types or pictures of the same type. In some implementations, two pictures from different sources can be pictures of different types, and two pictures from the same source can be pictures of the same type. For example, the 3D picture rendered by ADAS and the real-life picture captured by the camera can be pictures of different types. The real-life pictures captured by the camera can be pictures of the same type. Optionally, the content contained in the two pictures displayed simultaneously by the electronic device can be the same or different.

[0143] In some scenarios, such as but not limited to driving and parking scenarios, the 3D images rendered by ADAS are generated by the ADAS controller (such as a 3D engine). The real-life images captured by the camera, such as but not limited to the real-life images captured by a single camera, the surround view spliced ​​by multiple cameras, etc., are generated by the auto parking assist (APA) system controller.

[0144] In some embodiments, the two images displayed in split screen on the electronic device may be generated by the electronic device. In other embodiments, they may also be generated by other devices, and the electronic device then obtains them from the other devices, which is not limited in this application.

[0145] In some embodiments, the size ratio of the two display areas into which the display screen is divided may be preset. For example, the size ratio of the two display areas may be 1:N, where N is greater than 0. In other words, the display ratio of the two images displayed on the split screen on the display screen may be 1:N.

[0146] In other embodiments, the size ratio of the two display areas into which the display screen is divided can also be set by the user according to actual needs. For example, the user can set the size ratio of the two display areas through the electronic device, and in response to the user's setting, the electronic device sets the size ratio of the two display areas accordingly.

[0147] In some embodiments, the size ratio of the two display areas into which the display screen is divided may be fixed or constant. That is, at any time, the size ratio of the two display areas is the same. For example, at different times, the size ratio of the two display areas is 1:2.

[0148] In other embodiments, the size ratio of the two display areas into which the display screen is divided may be variable. That is, at different times, the size ratio of the two display areas may be different. For example, at a certain time, the size ratio of the two display areas is 1:2, and at another time, the size ratio of the two display areas may be 1:1.

[0149] In this embodiment, the change in the size ratio of the two display areas may be triggered by a user, such as the user modifies the size ratio of the two display areas.

[0150] Of course, the change in the size ratio of the two display areas can also be automatically triggered by the electronic device, such as when the electronic device modifies the size ratio of the two display areas. For example: in this example, when the electronic device determines that the two pictures to be displayed on the two display areas are pictures of the same type, the electronic device determines that the size ratio of the two display areas is a first ratio. When the electronic device determines that the two pictures to be displayed on the two display areas are pictures of different types, the electronic device determines that the size ratio of the two display areas is a second ratio, and the second ratio is different from the first ratio. In this way, the electronic device modifies the size ratio of the two display areas.

[0151] Below, taking the electronic device as the central control screen of a vehicle as an example, the two split-screen images displayed on the central control screen include a 3D image rendered by ADAS (hereinafter referred to as the 3D image) and a real-scene image captured by a camera (hereinafter referred to as the real-scene image). The 3D image and the real-scene image are split into left and right screens as an example to introduce the technical solution provided in the embodiment of the present application.

[0152] In some scenarios, such as but not limited to the driving-parking scenario, the vehicle can render a 3D image through ADAS while driving, and then display the 3D image on the vehicle's central control screen. For an introduction to the 3D image rendered by ADAS, please refer to the above. Taking the driving-parking scenario as an example, the vehicle's central control screen can display the following: Figure 2The 3D screen 200 shown in (1) (i.e., the first interface, i.e., the first screen of the first application).

[0153] In some embodiments, the 3D image can be displayed in full screen on the vehicle's central control screen, such as Figure 2 In other embodiments, the 3D image 200 may be displayed on the vehicle's central control screen in other ways, such as the 3D image may occupy part of the display area of ​​the vehicle's central control screen. Figure 6 (1) shows another 3D screen interface diagram provided by the embodiment of the present application. Figure 6 As shown in (1), the 3D image 600 may only occupy the display area of ​​the middle part of the vehicle's central control screen. Of course, the 3D image may also only occupy the display area of ​​other parts of the vehicle's central control screen.

[0154] In some embodiments, the 3D picture includes a 3D image of a target object (i.e., a first target), and the target object may be one of the objects sensed by the ADAS. For example, taking the ADAS as an example of sensing the surrounding environment of the vehicle, the target object may include but is not limited to the vehicle and one of the objects in the surrounding environment of the vehicle. For another example, taking the ADAS as an example of sensing the surrounding environment of an electronic device, the target object may include but is not limited to the electronic device and one of the objects in the surrounding environment of the electronic device.

[0155] Optionally, in addition to the 3D image of the target object, the 3D picture may also include 3D images of one or more objects other than the target object.

[0156] In some embodiments, the 3D image of the target object can be displayed at the center of the 3D screen. Figure 2 As shown in (1), the 3D image 201 of the vehicle is displayed at the center of the 3D screen 200. Figure 6 As shown in (1), the 3D image 601 of the vehicle is displayed at the center of the 3D screen 600. In this way, by setting the 3D image of the target object at the center of the 3D screen, it is convenient for the user to observe the environment around the target object, such as the environment around the vehicle, and driving safety can be improved.

[0157] In other examples, the 3D image of the target object may also be displayed at other locations of the 3D screen. Figure 6 (2) shows another 3D screen interface diagram provided by the embodiment of the present application. Figure 6As shown in (2), the 3D image 611 of the vehicle can be displayed at a position slightly to the left of the 3D screen 610. In this way, setting the 3D image of the target object at a position slightly to the left of the 3D screen can facilitate the user to observe the environmental conditions on the right side of the target object, such as the environmental conditions on the right side of the vehicle, and can also improve driving safety. Of course, the 3D image of the target object can also be displayed at other positions of the 3D screen except the left side, such as the right side, the position slightly above the center, the position slightly below the center, etc. The present application does not impose any specific restrictions on the position of the 3D image of the target object in the 3D screen.

[0158] Optionally, the specific position of the 3D image of the target object displayed on the 3D screen may be preset, or may be set by the user according to actual needs, such as by the user through an electronic device.

[0159] In some embodiments, the position of the 3D image of the same target object in the 3D screen may be fixed or unchanged. That is, the position of the 3D image of the same target object in different 3D screens is the same, such as the center position. For example, the 3D image of target object 1 is at the center of 3D screen 1 and also at the center of 3D screen 2. 3D screen 1 and 3D screen 2 may be 3D screens rendered at different times.

[0160] Similarly, the positions of the 3D images of different target objects in the 3D picture may also be fixed or unchanged. For example, the 3D image of target object 1 is located at the center of 3D picture 1, and the 3D image of target object 2 is also located at the center of 3D picture 2.

[0161] In other embodiments, the position of the 3D image of the same target object in the 3D picture may be variable. That is, the position of the 3D image of the same target object in different 3D pictures may be different. For example, the 3D image of target object 1 is at the center of 3D picture 1, and the 3D image of target object 1 is at the left side of 3D picture 2. 3D picture 1 and 3D picture 2 may be 3D pictures generated by rendering at different times.

[0162] Similarly, the positions of 3D images of different target objects in the 3D picture may also be variable, for example, the 3D image of target object 1 is located at the center of 3D picture 1, and the 3D image of target object 2 is located at the right side of 3D picture 2.

[0163] In this embodiment, as a possible implementation, it can be determined according to the scene at which position of the 3D screen the 3D image of the target object is specifically displayed. In different scenes, the 3D image of the target object can be displayed at different positions of the 3D screen. Take the target object as the vehicle itself as an example. For example, if the current scene is overtaking to the right, changing lanes to the right, etc., the 3D image of the vehicle itself can be displayed at a position slightly to the left of the 3D screen, which can facilitate the user to observe the environmental conditions on the right side of the vehicle and improve driving safety. For another example, if the current scene is overtaking to the left, changing lanes to the left, etc., the 3D image of the vehicle itself can be displayed at a position slightly to the right of the 3D screen, which can facilitate the user to observe the environmental conditions on the left side of the vehicle and improve driving safety. For another example, if the current scene is normal driving, turning, parking, etc., the 3D image of the vehicle itself can be displayed at the center of the 3D screen, which can facilitate the user to observe the environmental conditions around the vehicle and improve driving safety.

[0164] Of course, in other implementations, it is also possible to determine the position of the 3D screen where the 3D image of the target object is displayed based on other factors, such as the type of the target object. For example, if the target object is an object with mobile properties, such as a vehicle, an AI device, etc., the 3D images of these target objects can be displayed at the center of the 3D screen, which makes it easy to observe the environmental conditions around the target object. If the target object is an object without mobile properties, such as a television, a desktop computer, etc., the 3D images of these target objects can be displayed at other positions in the 3D screen except the center position, such as various positions above, to the left, to the right, etc.

[0165] After the vehicle's central control screen displays the above 3D image, further, after the vehicle's central control screen obtains an instruction (i.e., a first instruction) for triggering the split-screen display of the 3D image and the real scene image, in response to the instruction, the vehicle's central control screen can display the 3D image and the real scene image in a split-screen manner. For example, Figure 7 (1) shows a schematic diagram of a split screen interface provided by an embodiment of the present application. Figure 7 In the split screen interface 700 (i.e., the second interface) shown in (1), the 3D image 710 (i.e., the second image of the first application) and the real scene image 720 (i.e., the first image of the second application) are displayed in split screen. In this way, the 3D image and the real scene image can be displayed in split screen to improve the display effect.

[0166] Understandably, Figure 7 The split screen interface 700 shown in (1) is based on the example that when the 3D image and the real scene image are displayed in a left-right split screen mode, the 3D image is displayed on the left side of the split screen interface. In other embodiments, when the 3D image and the real scene image are displayed in a left-right split screen mode, the 3D image can also be displayed on the right side of the real scene image. For example, Figure 7 (2) shows a schematic diagram of another split screen interface provided by the embodiment of the present application. Figure 7 In the split-screen interface 730 shown in (2), the 3D image 740 and the real scene image 750 are displayed in split screens, wherein the 3D image 740 is displayed on the right side of the real scene image 750.

[0167] It can be understood that in the embodiments of the present application, Figure 7 In the split-screen interface shown, the display ratio of the 3D image and the real scene image is taken as 1:2 as an example. The display ratio of the 3D image and the real scene image can also be other ratios, and this application does not make any specific restrictions on this.

[0168] In some embodiments, in a Figure 7 In the split-screen interface shown, the relative position of the 3D image of the target object included in the 3D picture relative to the 3D picture, and, when displaying a video such as Figure 7 The 3D image displayed before the split screen interface shown in the figure (such as Figure 2 When the 3D picture 200 shown in (1) is displayed, the relative position of the 3D image of the target object in the previously displayed 3D picture is the same.

[0169] For example, if the 3D image of the target object (such as the 3D image 201 of the vehicle) is displayed on Figure 2 The target object (such as the 3D image 201 of the vehicle) is still displayed at the center position of the 3D image 200 shown in (1). Figure 7 In the split-screen interface shown in FIG, the center position of the 3D images (such as 3D images 710, 3D images 740, etc.) included in the split-screen interface is maintained. In this way, the relative position of the 3D image of the target object in the 3D image is kept unchanged, that is, the 3D image of the target object is not blocked, and the user can also observe the environment around the target object in the split-screen display interface, thereby improving the user experience.

[0170] In some embodiments, in order to enable the central control screen of the vehicle to display such as Figure 7 The real scene picture 720 shown in (1) is Figure 7 Before the vehicle's central control screen displays the real scene image, the camera may first collect information such as the real scene image 750 shown in (2). Figure 7 The real scene shown.

[0171] In some embodiments, Figure 7 The real scene picture 720 shown in (1) Figure 7 The real scene picture 750 shown in (2) can be a real scene picture collected by a camera during the parking process of the vehicle in the driving and parking integrated scene ( Figure 7In this way, while improving the display effect, the 3D image and the real scene image are simultaneously displayed on the vehicle's central control screen, allowing the user to more accurately understand the environmental conditions around the vehicle, which is conducive to improving the accuracy and safety of parking.

[0172] In some embodiments, the above instructions for triggering the split-screen display of the 3D image and the real scene image may be executed by the user. For example, the instructions may be various voice operations, gesture operations, key operations, etc. executed by the user. Figure 2 As a specific implementation of the 3D image 200 shown in (1), the instruction can be an operation for the user to select a 3D image of a parking space included in the 3D image 200, such as Figure 2 The 3D image 203 of the parking space shown in (1) can be clicked, etc. Optionally, the operation of selecting the 3D image of the parking space can also be various voice operations, gesture operations, key operations, etc.

[0173] Optionally, in this specific implementation, since the parking space selection operation is performed by the user, in order to avoid user misoperation and the like, the accuracy and safety of parking are improved. Figure 2 After the 3D image of the parking space included in the 3D picture 200 shown in (1) is operated, such as clicking the 3D image 203 of the parking space included in the 3D picture 200, in response to the operation, a display such as Figure 7 Before the split screen interface shown in FIG. 1 is displayed, the central control screen of the vehicle may also output a reminder message (such as a reminder message displayed on the display screen, a reminder message broadcasted by voice, etc.) to confirm with the user whether to start parking. For example, the reminder message may be such as Figure 8 The reminder message 800 shown in (1).

[0174] Optionally, the central control screen of the vehicle may also display one or more of a confirmation button 801, a cancel button 802, etc. The central control screen of the vehicle detects the confirmation of the parking operation, such as the user Figure 8 In response to the click operation of the confirmation button 801 shown in (1), the central control screen of the vehicle displays a message such as Figure 7 The vehicle's central control screen detects the cancellation of the parking operation. Figure 8 In response to the click operation of the cancel button 802 shown in (1), the central control screen of the vehicle may not display the information such as Figure 7 The split-screen interface shown.

[0175] Optionally, the central control screen of the vehicle may also output a reminder message to confirm to the user whether to park in the selected parking space. For example, the reminder message may be such as Figure 8The reminder message 810 shown in (2) of the vehicle. Optionally, the vehicle's central control screen may also display one or more of a confirmation button 811, a cancel button 812, etc. The vehicle's central control screen detects a confirmation operation, such as the user's Figure 8 In response to the click operation of the confirmation button 811 shown in (2), the central control screen of the vehicle displays a message such as Figure 7 The vehicle's central control screen detects the cancellation of the parking operation. Figure 8 In response to the click operation of the cancel button 812 shown in (2), the central control screen of the vehicle may not display the information such as Figure 7 The split-screen interface shown.

[0176] Optionally, the central control screen of the vehicle can use different reminder messages to confirm whether to start parking and whether to park in the selected parking space. The above-mentioned different reminder messages can be output simultaneously or successively. Alternatively, the central control screen of the vehicle can also directly output a reminder message (such as directly outputting Figure 8 The reminder message 810 shown in (2) in the figure, etc.) asks the user to confirm whether to start parking and whether to park in the selected parking space at present. This application does not make any specific restrictions on this.

[0177] Optional, such as Figure 8 The reminder message shown can be displayed on the vehicle's central control screen in a full-screen interface. Alternatively, it can also be displayed in the form of a pop-up window suspended on other interfaces. For example, the other interface may include but is not limited to such as Figure 2 3D picture 200 shown in (1) etc. Alternatively, it can also be displayed in the form of a notification message in a drop-down notification bar of the vehicle's central control screen, etc., and the present embodiment of the application does not impose any limitation on this.

[0178] In other embodiments, the above instructions for triggering the split-screen display of the 3D image and the real scene image may be automatically generated by other devices (such as a vehicle) or the central control screen of the vehicle. Figure 2 As a specific implementation, the 3D image 200 shown in (1) of the vehicle is displayed on the central control screen such as Figure 2 When the 3D image 200 shown in (1) is displayed, if the vehicle or the central control screen of the vehicle determines that there is a 3D image of an empty parking space in the 3D image 200, the vehicle or the central control screen of the vehicle may generate an instruction for triggering the split-screen display of the 3D image and the real scene image. As another specific implementation, when the vehicle or the central control screen of the vehicle determines that the speed of the vehicle is lower than or equal to a preset speed threshold, the vehicle or the central control screen of the vehicle may generate an instruction for triggering the split-screen display of the 3D image and the real scene image.

[0179] Optionally, when another device generates an instruction for triggering the split-screen display of the 3D image and the real scene image, the other device may send the instruction to the central control screen of the vehicle so that the central control screen of the vehicle displays the 3D image and the real scene image according to the instruction. Figure 7 The split-screen interface shown.

[0180] Optionally, in this embodiment, the central control screen of the vehicle displays information such as Figure 7 Before the split screen interface shown, the vehicle or the central control screen of the vehicle can also automatically perform the parking space selection operation described above, that is, the vehicle or the central control screen of the vehicle automatically selects the parking space to be parked. Figure 2 Any vacant parking space or a parking space that meets a preset condition included in the 3D image 200 shown in (1) above. For example, the preset condition may include the closest to the vehicle or the easiest to park.

[0181] Optionally, after selecting a parking space on the vehicle or the vehicle's central control screen, you can also Figure 2 The 3D image 200 shown in (1) indicates the selected parking space, so that the user can know which parking space is currently to be parked.

[0182] Optionally, the vehicle or the central control screen of the vehicle may perform the parking space selection operation before generating an instruction for triggering the split-screen display of the 3D image and the real scene image. Alternatively, the parking space selection operation may be performed after generating an instruction for triggering the split-screen display of the 3D image and the real scene image, and the embodiment of the present application does not specifically limit this.

[0183] Optionally, in this embodiment, after the vehicle or the central control screen of the vehicle selects the parking space to be parked, it can also output such as Figure 8 The reminder message shown is to remind the user whether to start parking, whether to confirm to park in the currently selected parking space, etc.

[0184] It can be understood that in the embodiment of the present application, when the vehicle is parked in a parking space, the vehicle can be parked automatically or by the user, and the embodiment of the present application does not limit this.

[0185] It can be understood that the specific implementation under this embodiment takes the integrated driving and parking scenario as an example. In other scenarios, other devices or electronic devices can also automatically generate instructions for triggering the split-screen display of 3D images and real-scene images.

[0186] In some embodiments, the data of the 3D screen and the data of the real-scene screen can be rendered through different controls. For example, control 1 (i.e., the first control) can be used to render the data of the 3D screen, and control 2 (i.e., the second control) can be used to render the data of the real-scene screen. Among them, control 1 can be the application to which the 3D screen belongs, that is, the control of the ADAS application, and control 2 can be the application to which the real-scene screen belongs, that is, the control of the camera application. Exemplarily, the control can be such as the SurfaceView described above. In this way, the rendering effect can be improved by using a SurfaceView dedicated to displaying video streams and 3D images to render the data of the 3D screen and the data of the real-scene screen.

[0187] In some embodiments, the 3D picture and the real scene picture after rendering can be displayed through different layouts. Among them, the parameters of the layout of the 3D picture (i.e., the first layout) can be used to control the display effect of the 3D picture on the display screen. The parameters of the layout of the real scene picture (i.e., the second layout) can be used to control the display effect of the real scene picture on the display screen. For example, the parameters of layout 1 can be used to control the display effect of the 3D picture on the display screen, and the parameters of layout 2 can be used to control the display effect of the real scene picture on the display screen. Among them, the parameters of layout 1 can be the application to which the 3D picture belongs, that is, the ADAS application definition (or configuration), and the parameters of layout 2 can be the application to which the real scene picture belongs, that is, the camera application definition. Exemplarily, the layout can be such as the FrameLayout described above. The above layout may also be referred to as a parent control, etc.

[0188] For example, Figure 2 Take the 3D picture 200 shown in (1) as an example. Figure 9a As shown, the 3D engine can apply control 1 to the ADAS application Figure 2 The 3D image 200 shown in (1) is rendered, and the 3D image after rendering can be as shown in Figure 9a As shown in (1). Then the ADAS application configures the parameters of layout 1. If the parameters of layout 1 define that the 3D image after rendering is displayed on the display screen, specifically, the parameters of layout 1 indicate that the display effect of the 3D image on the display screen can be as follows: Figure 9a As shown in (2). Further, the layer synthesizer (such as SurfaceFlinger service, HWC, etc.) synthesizes the rendered 3D image according to the parameters of layout 1, and then transmits the synthesized image to the display screen for display. For example, the 3D image displayed on the central control screen of the vehicle can be as follows Figure 9a 3D picture 200 shown in (3).

[0189] For example, Figure 7 Take the 3D picture 710 shown in (1) as an example. Figure 9bAs shown, the 3D engine can render the data of the 3D screen through the control 1 applied by the ADAS application. The 3D screen after rendering can be Figure 9b Then, the ADAS application configures the parameters of layout 1. Figure 9b As shown in (2), if the parameters of layout 1 define that after the 3D image is rendered, only area 1 is displayed on the display screen, and area 2 is not displayed on the display screen. Further, the layer synthesizer synthesizes the 3D image after the rendering according to the parameters of layout 1, and then transmits the synthesized image to the display screen for display. For example, Figure 9b As shown in (3), only Figure 9b The area 1 of the 3D image after rendering shown in (1) can be displayed on the display screen.

[0190] Understandably, Figure 9b The fact that area 1 of the 3D image shown in (3) can be displayed on the display screen does not mean that all the content of area 1 can be seen by the user, because part of the content of area 1 may be visible to other interfaces (such as Figure 7 In the case of the real scene picture 720) shown in (1) being blocked, the embodiment of the present application shown in Figure 7 The 3D picture 710 shown in (1) is taken as an example. That is, Figure 7 The 3D image 710 shown in (1) is Figure 9b A portion of region 1 shown in (3) in FIG. 1 . Similarly, Figure 7 The 3D picture 740 shown in (2) can also be a 3D picture 740 according to the parameters of layout 1 such as Figure 2 The 3D picture 200 shown in (1) is a portion of the 3D picture that can be displayed on the display screen after being cropped.

[0191] That is, the split screen interface shown in the embodiment of the present application (such as but not limited to Figure 7 The 3D pictures included in the split-screen interface shown in the figure are all part of the 3D pictures that can be displayed on the display screen. The 3D pictures that can be displayed on the display screen are pictures that are obtained by cropping the 3D pictures before the split-screen display according to the layout corresponding to the 3D pictures.

[0192] It is understood that the "cropping" described in the embodiments of the present application may refer to the display effect of a picture on the display screen being equivalent to the picture obtained by cropping another picture, and does not necessarily mean that a cropping operation is performed on the picture. For example: by configuring the parameters of the layout corresponding to the picture (such as FrameLayout), an effect equivalent to the aforementioned cropping can be achieved.

[0193] For example, if the central control screen of a vehicle includes 1920 pixels (pix, P) horizontally and 1080P vertically, the full-screen 3D image rendered by the 3D engine can be as follows: Fig.9c As shown in (1), the full-screen 3D image includes 1920P horizontally and 1080P vertically. With the lower left corner of the vehicle's central control screen as the coordinate origin O, the width as the X axis, and the height as the Y axis, establish a Fig.9c The coordinate system shown in (2) in the figure. If the ADAS application configures the parameters of layout 1 as “ Fig.9c The display position of the 3D image shown in (1) on the vehicle's central control screen is (-380P, 1920P-380P)", then Fig.9c As shown in (3), the rendering is completed Fig.9c In the 3D picture shown in (1), the 3D picture composed of the 380P to 1920P horizontally and the 1P to 1080P vertically can be displayed on the central control screen of the vehicle, while the 3D picture composed of the 1P to 379P horizontally and the 1P to 1080P vertically is not displayed on the central control screen of the vehicle.

[0194] like Fig.9c The 3D image displayed on the central control screen of the vehicle shown in (3) is equivalent to the 3D image displayed on the full screen (such as Figure 2 Thus, by configuring the layout parameters corresponding to the 3D picture, an effect equivalent to cutting the 3D picture is achieved.

[0195] It can also be understood that in the embodiment of the present application, when displaying Figure 2 The 3D image 200 shown in (1) and Figure 7 When the split-screen interface shown contains 3D images, the area size of the 3D images actually rendered by the 3D engine is the same, such as Figure 2 The area size of the full-screen 3D picture shown in (1). That is, the area size of the rendered 3D picture will not change, so the 3D picture does not need to be rebuilt, and the 3D engine does not need to re-render the 3D picture, which can reduce performance consumption and avoid screen flashing problems that may be caused by rebuilding the 3D picture. In addition, if the area size of the rendered 3D picture changes, it is necessary to adapt to different rendering engines. In this way, since the area size of the rendered 3D picture will not change, there is no need to adapt to different rendering engines, which can improve development efficiency.

[0196] Likewise, Figure 7 The real scene picture 720 shown in (1) is Figure 7The real scene picture 750 shown in (2) can also be rendered, laid out and displayed in a manner such as described above. It can be understood that after the vehicle's central control screen displays the rendered real scene picture according to the layout of the real scene picture, the real scene picture displayed on the display screen can be visible to the user, that is, the real scene picture will not be blocked by other interfaces.

[0197] The following is an introduction to the process of the vehicle's central control screen changing from displaying only 3D images to a split-screen interface displaying the 3D images and real-life images.

[0198] In some embodiments, the central control screen of the vehicle dynamically changes from displaying only the 3D image to displaying a split-screen interface of the 3D image and the real-life image. In some implementations, the central control screen of the vehicle can realize the process from displaying only the 3D image to displaying the split-screen interface of the 3D image and the real-life image in a split-screen manner by configuring animations (or transition animations, etc.) for the 3D image and the real-life image. In other words, the process from displaying the 3D image to displaying the split-screen interface of the 3D image and the real-life image in a split-screen manner is an animation process.

[0199] It is understood that in the embodiments of the present application, animation may refer to achieving animation effects by dynamically modifying the properties of an object. For example, the properties of an object may include but are not limited to displacement, scaling, rotation, and transparency. An object may be a control of various types, such as including but not limited to a view, SurfaceView, FrameLayout, etc.

[0200] Exemplarily, the animation may include but is not limited to attribute animation (such as ObjectAnimator), etc. Exemplarily, the aforementioned animation includes one or more parameters of the direction, distance, speed, duration, start time, end time, start position, end position, etc. of the picture movement. The central control screen of the vehicle can realize the animation effect of the picture through the parameters (i.e., animation parameters) included in the animation configured for the picture.

[0201] Optionally, in an embodiment of the present application, some parameters included in the animation can be directly configured in the animation, or determined based on the parameters already configured in the animation. For example, when only parameters such as the starting position of the screen, the ending position of the screen, and the duration of movement are configured in the animation, the direction, speed, and distance of the screen movement can all be calculated based on the configured starting position of the screen, the ending position of the screen, the duration of movement, etc.

[0202] Optionally, the values ​​of the above one or more parameters may be pre-set by the vehicle's central control screen, or may be set by the user. Of course, in the case where the vehicle's central control screen is set with a default value, the user may also modify the default value. For example, Fig.10aAs shown, the vehicle's central control screen can display a setting interface 1000, wherein the setting interface 1000 includes parameter options corresponding to one or more pictures (such as but not limited to 3D pictures and / or real-life pictures, etc.), such as one or more of a starting position, an ending position, a moving direction, a moving duration, etc. The user can set the values ​​of the corresponding parameters through these parameter options.

[0203] Understandably, Fig.10a The parameter options shown are merely exemplary illustrations made to facilitate understanding of the embodiments of the present application. In actual applications, more or fewer animation parameter options may be included, and the present application does not impose any limitations on this.

[0204] In some embodiments, the animation configured for the 3D screen and the animation configured for the real-scene screen can be the same animation, for example: the animation configured for the 3D screen and the real-scene screen are both ObjectAnimator1. In this way, the 3D screen and the real-scene screen are configured with the same animation, so that the animations of the 3D screen and the real-scene screen can run in one process, which can make the animations more synchronized and improve the animation effect. In other embodiments, the animation configured for the 3D screen and the animation configured for the real-scene screen can be different animations, for example: the animation configured for the 3D screen is ObjectAnimator2, and the animation configured for the real-scene screen is ObjectAnimator3.

[0205] In some embodiments, the values ​​of some parameters included in the animation of the 3D picture configuration are different from the values ​​of corresponding parameters included in the animation of the real-scene picture configuration. Exemplarily, the aforementioned parameters with different values ​​may include, but are not limited to, one or more of the distance, speed, starting position, and ending position of the picture movement. In this way, the distance, starting position, and ending position of the 3D picture and the real-scene picture are different, so that the 3D picture and the real-scene picture can be displayed in split screen, thereby improving the effect of split-screen display. The speeds at which the 3D picture and the real-scene picture move are different, so that when the 3D picture and the real-scene picture move different distances, the 3D picture and the real-scene picture can be animated together, such as: starting the animation together, ending the animation together, etc., to improve the animation effect.

[0206] In some embodiments, the values ​​of some parameters included in the animation of the 3D screen configuration are the same as the values ​​of corresponding parameters included in the animation of the real scene screen configuration. Exemplarily, the aforementioned parameters with the same values ​​may include, but are not limited to, one or more of the direction, duration, start time, and end time of the screen movement.

[0207] For example, the direction of the picture movement may include, but is not limited to, one or more of: from left to right (referred to as right) and from right to left (referred to as left) along the horizontal direction of the screen, from top to bottom (referred to as down) and from bottom to top (referred to as up) along the vertical direction of the screen. For example, Fig.10b A schematic diagram of a screen direction provided by an embodiment of the present application is shown. Fig.10b As shown, the top left corner of the screen is taken as the origin O, the X-axis is the horizontal direction of the screen, and the direction along the horizontal direction of the screen is the direction along the X-axis. The Y-axis is the vertical direction of the screen, and the direction along the vertical direction of the screen is the direction along the Y-axis.

[0208] In some implementations, the direction in which the 3D image moves and the direction in which the real scene image moves are related to the effect of the split-screen display of the 3D image and the real scene image, for example, if the 3D image and the real scene image are split left and right, the direction in which the 3D image moves and the direction in which the real scene image moves can both be left or right. For another example, if the 3D image and the real scene image are split top and bottom, the direction in which the 3D image moves and the direction in which the real scene image moves can both be upward or downward.

[0209] In this way, the directions of movement of the 3D picture and the real-scene picture are the same, so the 3D picture and the real-scene picture can be animated in one direction, and the start time, end time, duration, etc. of the movement of the 3D picture and the real-scene picture are the same, so the 3D picture and the real-scene picture can start and end animation together, etc., thereby improving the animation effect.

[0210] In some embodiments, the moving distance contained in the animation of the 3D picture configuration (hereinafter referred to as the moving distance of the 3D picture) and the moving distance contained in the animation of the real-scene picture configuration (hereinafter referred to as the moving distance of the real-scene picture) are related to the ratio of the split-screen display of the 3D picture and the real-scene picture, or the moving distance of the 3D picture and the moving distance of the real-scene picture can be determined according to the ratio of the split-screen display of the 3D picture and the real-scene picture.

[0211] In this embodiment, as a specific implementation, the ratio of the moving distance of the 3D picture to the moving distance of the real scene picture is the same as the ratio of the split-screen display of the 3D picture and the real scene picture.

[0212] In some embodiments, the ratio of the speed of the 3D image moving to the speed of the real scene image moving is the same as the ratio of the 3D image and the real scene image being displayed in split screens. In this way, a one-shot animation effect can be achieved.

[0213] In some embodiments, the animation configured in the 3D screen can be bound to (or acted on) the layout corresponding to the 3D screen (such as layout 1), and the animation configured in the real-scene screen can be bound to the layout corresponding to the real-scene screen (such as layout 2). In this way, the animation is bound to the layout used to control the screen display effect, rather than binding the animation to the control used to render the screen data. By continuously changing the parameters of the layout through the animation, the purpose of continuously changing the size of the screen displayed on the display screen can be achieved, and the screen can also be ensured that the effect of scaling and stretching will not occur. In addition, there is no need to modify the size of the rendered screen, so that both the 3D screen and the real-scene screen do not need to be re-rendered, which can reduce performance consumption and improve development efficiency.

[0214] For example, if both the 3D image and the real scene image are configured with animation 1, the starting position, ending position and time of the 3D image movement are set in animation 1, and the starting position, ending position and time of the real scene image movement are also set, and the split screen of the 3D image and the real scene image is 1:2, the time for the 3D image to move is the same as the time for the real scene image to move, and the speed of the real scene image to move is twice the speed of the real scene image to move.

[0215] The ADAS application applies for SurfaceView1, and then sends the applied SurfaceView1 to the 3D engine. The 3D engine renders the full-screen 3D image in SurfaceView1, and sends the rendered SurfaceView1 to the ADAS application. Then the ADAS application sets the parameters of FrameLayout1 corresponding to each frame of the 3D image from the starting position to the ending position according to the starting position, ending position and time of the 3D image movement set in animation 1, and sends the rendered SurfaceView1 and FrameLayout1 to the synthesizer (such as SurfaceFlinger service, HWC, etc.).

[0216] At the same time, the camera application applies for SurfaceView2, and then sends the applied SurfaceView2 to the real scene rendering module (such as APA controller), and the real scene rendering module displays the size shown in the split screen (such as Figure 7 The real scene of the two-thirds screen size is rendered in SurfaceView2, and the rendered SurfaceView2 is sent to the camera application. Then the camera application sets the parameters of FrameLayout2 corresponding to each frame of the real scene from the starting position to the ending position according to the starting position, ending position and time of the real scene movement set in animation 1, and sends the rendered SurfaceView2 and FrameLayout2 to the synthesizer.

[0217] Correspondingly, after the synthesizer receives the SurfaceView1 and FrameLayout1 corresponding to each frame of the 3D picture, it generates each frame of the 3D picture (i.e., the third picture of the first application) according to the SurfaceView1 and FrameLayout1 corresponding to each frame of the 3D picture. Similarly, after the synthesizer receives the SurfaceView2 and FrameLayout2 corresponding to each frame of the real-scene picture, it generates each frame of the real-scene picture (i.e., the second picture of the second application) according to the SurfaceView2 and FrameLayout2 corresponding to each frame of the real-scene picture. Then, the synthesizer synthesizes each frame of the 3D picture and each corresponding frame of the real-scene picture, generates each frame of the split-screen interface (i.e., the third interface) during the animation process, and finally outputs each frame of the split-screen interface to the vehicle's central control screen for display, thereby realizing the animation effects of the 3D picture and the real-scene picture.

[0218] Combine the following Figure 2 The 3D image 200 shown in (1) and Figure 7 The split screen interface 700 shown in (1) is used to change the vehicle's central control screen from only displaying Figure 2 3D picture 200 shown in (1) to display Figure 7 The process of the split-screen interface 700 shown in (1) is described below.

[0219] In some embodiments, the vehicle's central control screen is Figure 2 The 3D picture 200 shown in (1) is configured with animation 1, Figure 7 The real scene picture 720 shown in (1) is also configured with animation 1.

[0220] Combination Figure 7 In the split screen interface 700 shown in (1), the split screen display ratio of the 3D image 710 and the real scene image 720 is 1:2, and Fig.9c In the orientation shown, Fig.9c The vehicle central control screen shown in (2) is in the positive direction of the X axis to the right and the positive direction of the Y axis to the upward. Figure 2 The 3D image 200 shown in (1) moves from the 0th pixel point of the display screen to the xth pixel point to the left, where x is greater than 0. That is, the 3D image 200 included in the animation 1 Figure 2 The starting position of the 3D image 200 shown in (1) is the 0th pixel point, the ending position is the xth pixel point, and the moving direction is leftward.

[0221] Animation 1 is used to Figure 7The real scene 720 shown in (1) is translated from the 1920th pixel of the display screen to the (1920th - 2xth)th pixel, where x is greater than 0. In other words, the animation 1 contains Figure 7 The starting position of the real scene image 720 shown in (1) is the 1920th pixel point, the ending position is the (1920th - 2xth)th pixel point, and the moving direction is leftward.

[0222] It can be understood that in the embodiment of the present application, the width of the vehicle's central control screen is taken as 1920 pixels.

[0223] In some embodiments, Figure 2 The moving time of the 3D image 200 shown in (1) and Figure 7 The moving time of the real scene picture 720 shown in (1) can be 500 milliseconds, that is, the moving time of the two is the same. Figure 2 The moving time of the 3D image shown in (1) is 500 milliseconds. Figure 7 The moving time length of the real scene picture 720 shown in (1) is the same as the above value, which is also 500 milliseconds. Of course, the moving time length can also be other time lengths, and the embodiment of the present application does not limit this.

[0224] Combined with the above, Figure 7 The moving distance of the real scene image 720 shown in (1) is Figure 2 The moving distance of the 3D image 200 shown in (1) is twice as long as the moving distance of the 3D image 200 shown in (1), and the moving time of the two is the same. Therefore, Figure 7 The moving speed of the real scene picture 720 shown in (1) can be Figure 2 In this way, the 3D image and the real scene image can start animation together and stop animation together, achieving a one-shot display effect.

[0225] It can be understood that in the embodiment of the present application, the 3D image and the real scene image move at a constant speed as an example. In other examples, the 3D image and the real scene image can also move at variable speeds, and the embodiment of the present application does not limit this.

[0226] In some embodiments, the vehicle's central control screen displays a Figure 2 3D picture 200 shown in (1) to present such as Figure 7 During the split screen interface 710 shown in (1) of FIG. 2 , that is, during the animation process, one or more cropped frames may be displayed on the central control screen of the vehicle. The cropped frames may include one or more frames of the 3D frame 200 shown in (1) of FIG. 2 cut out according to the layout parameters. The cropped frames may also be such as Figure 2 The partial picture of the 3D picture 200 shown in (1) in FIG. Optionally, the layout parameters such as Figure 7 The real scene picture 720 shown in (1) is a frame or multiple frames of pictures cut out, and the cut out pictures are such as Figure 7 Part of the real scene picture 720 shown in (1).

[0227] For example, Fig.11 Some examples of cropping pictures provided by the embodiments of the present application are shown. Fig.11 As shown, during the animation process, the vehicle's central control screen can also display one or more split-screen interfaces. For the display process of these multiple split-screen interfaces, please refer to the above description. Fig.11 The split screen interface 1100 shown in (1) is as follows: Fig.11 The split screen interface 1110 shown in (2) Fig.11 The split screen interface 1120 shown in (3) Fig.11 The split screen interface 1130 shown in (4) Fig.11 The split screen interface 1140 shown in (5) is as follows, Fig.11 The split screen interface 1140 shown in (6) etc.

[0228] It can be understood that this one or more split-screen interfaces (such as Fig.11 Medium (1) to Fig.11 The split screen interface shown in (6) is displayed in sequence during the movement of the 3D image and the real scene image.

[0229] It is understandable. Fig.11 The split-screen interface shown is only an exemplary illustration for facilitating understanding of the embodiment of the present application. In actual application, during the animation process, the vehicle's central control screen may display more or fewer split-screen interfaces, and the embodiment of the present application does not limit this.

[0230] In some embodiments, such as Fig.11 Medium (1) to Fig.11 The 3D images, real scene images, etc. included in the split screen interface shown in (6) are the cropped images. Fig.11 The 3D image 1101 shown in (1) Fig.11 The 3D image 1111 shown in (2) Fig.11 The 3D image 1121 shown in (3) Fig.11 The 3D image 1131 shown in (4) Fig.11 The 3D image 1141 shown in (5) Fig.11 The 3D images 1151 shown in (6) are all for Figure 2 The 3D picture 200 shown in (1) is a cropped picture. Optionally, Fig.11 The different 3D images shown are different, for example, including but not limited to differences in image size, displayed content, etc.

[0231] Fig.11 The real scene picture 1102 shown in (1) Fig.11 The 3D image 1112 shown in (2) Fig.11 The 3D image 1122 shown in (3) Fig.11 The 3D image 1132 shown in (4) Fig.11 The 3D image 1142 shown in (5) Fig.11 The 3D images 1152 shown in (6) are all for Figure 7 The real scene picture 720 shown in (1) is a cropped picture. Optionally, Fig.11 The different real scenes shown are different, such as: but not limited to: different screen sizes, displayed content, etc. In this way, during the animation process, such as Fig.11 As shown in the real scene picture, the real scene picture can realize the animation effect of "banner pulling in".

[0232] In some embodiments, in combination with the above, the vehicle displays Fig.11 Medium (1) to Fig.11 When the 3D image shown in (6) is displayed, Fig.11 Medium (1) to Fig.11 When the real scene is shown in (6), the vehicle's central control screen can also be rendered through different controls Fig.11 Medium (1) to Fig.11 The data of the 3D image shown in (6) and Fig.11 Medium (1) to Fig.11 The data of the real scene shown in (6) can also be achieved through different layout controls Fig.11 Medium (1) to Fig.11 The 3D image shown in (6) and Fig.11 Medium (1) to Fig.11 The display effect of the real scene shown in (6).

[0233] As shown in Fig.11 Medium (1) to Fig.11 When the 3D image shown in (6) is displayed, the 3D engine can also use control 1 to Fig.11 Medium (1) to Fig.11 The 3D image data corresponding to the 3D image shown in (6) is rendered, and the 3D image after rendering can be Figure 9a Then the ADAS application defines the parameters of layout 1 according to the animation configured in the 3D screen, and implements the control of the following parameters according to the parameters of layout 1: Figure 2The 3D image 200 shown in (1) is cut to achieve the effect of Fig.11 Medium (1) to Fig.11 The effect of the 3D picture shown in (6).

[0234] Understandably, Fig.11 Medium (1) to Fig.11 The 3D pictures shown in (6) (such as 3D picture 1101, 3D picture 1111, 3D picture 1121, 3D picture 1131, 3D picture 1141, 3D picture 1151, etc.) are only a part of the 3D pictures that can be displayed on the display screen according to the above layout 1.

[0235] It is also understandable that in the display Figure 2 The 3D image 200 described in (1) Fig.11 Medium (1) to Fig.11 3D images shown in (6) (such as 3D images 1101, 3D images 1111, 3D images 1121, 3D images 1131, 3D images 1141, 3D images 1151, etc.), Figure 7 When the 3D image 710 shown in (1) is used, the area size of the 3D image actually rendered by the 3D engine is also the same, that is, the area size of the rendered 3D image will not change, such as the 3D image rendered is the entire area of ​​the 3D image 200 as described in (1) of 2. Optionally, such as Fig.11 The 3D images during the animation process shown and the Figure 7 The data of the 3D picture rendered by the 3D engine corresponding to the 3D picture at the end of the animation shown can be rendered when the 3D picture before the split-screen interface is displayed (such as the 3D picture shown in (1) in the figure), or it can be rendered when the first frame of the 3D picture is displayed during the animation. The embodiment of the present application does not limit this.

[0236] In this way, during the entire animation process, the 3D screen does not need to be rebuilt, which can greatly reduce performance consumption and avoid screen flashing problems caused by rebuilding the 3D screen. In addition, if the size of the area of ​​the rendered 3D screen changes, a different rendering engine needs to be adapted. In this way, the size of the area of ​​the rendered 3D screen will not change, so there is no need to adapt to different rendering engines, which can also greatly improve development efficiency.

[0237] Similarly, in the display Fig.11 Medium (1) to Fig.11 When the real scene shown in (6) is displayed, the vehicle's central control screen can also use control 2 to Figure 7 The entire area of ​​the real scene image 720 described in (1) is rendered, and then the camera application defines the parameters of the layout 2 according to the animation configured in the real scene image, and implements the layout 2 according to the layout 2. Figure 7The real scene shown in the figure is cut to achieve the effect of Fig.11 Medium (1) to Fig.11 The effect of the real scene shown in (6).

[0238] Understandably, Fig.11 Medium (1) to Fig.11 The real scene pictures shown in (6) (such as real scene picture 1102, real scene picture 1112, real scene picture 1122, real scene picture 1132, real scene picture 1142, real scene picture 1152, etc.) are the real scene pictures that can be displayed on the display screen according to the above-mentioned layout 1.

[0239] It can also be understood that in the embodiment of the present application, Fig.11 Medium (1) to Fig.11 The real scene pictures shown in (6) (such as real scene picture 1102, real scene picture 1112, real scene picture 1122, real scene picture 1132, real scene picture 1142, real scene picture 1152, etc.), Figure 7 When the real-scene picture 720 is shown in (1), the area size of the actual rendered real-scene picture is also the same, that is, the area size of the rendered real-scene picture will not change, such as the rendered real-scene pictures are all the areas of the real-scene picture 720 as described in (1) in 7. In this way, during the entire animation process, it is sufficient to render the data of the real-scene picture once, and the real-scene picture does not need to be rebuilt, that is, there is no need to repeatedly render the real-scene picture, which can greatly reduce performance consumption and avoid screen flashing problems that may be caused by rebuilding the picture. In addition, if the area size of the rendered real-scene picture changes, it is necessary to adapt to different APA controllers, vehicle-mounted video stream channels, etc. In this way, the area size of the rendered real-scene picture will not change, and there is no need to adapt to different APA controllers, vehicle-mounted video stream channels, etc., which can also greatly improve development efficiency.

[0240] In some embodiments, during the animation process, the relative position of the 3D image of the target object in the 3D screen visible to the user can always remain at the original position. In some examples, the original position may refer to the relative position of the 3D image of the target object in the 3D screen visible to the user displayed before the split-screen interface is displayed. Exemplarily, the original position may include but is not limited to the center position of the 3D screen visible to the user, the position above the center, the position below the center, etc.

[0241] It can be understood that in the embodiment of the present application, during the animation process, each frame of the 3D picture visible to the user may be a portion of the picture after the original 3D picture is cut according to the layout corresponding to the 3D picture, and the original 3D picture may refer to the 3D picture displayed before the split-screen interface is displayed. Each frame of the 3D picture visible to the user may also be a portion of the picture after the 3D picture displayed before the frame is cut according to the layout corresponding to the 3D picture.

[0242] Combination Figure 2 In the 3D image 200 shown in (1), the 3D image of the target object is taken as the 3D image 201 of the vehicle. If the 3D image 201 of the vehicle is displayed on Figure 2 The center position of the 3D image 200 shown in (1) is shown in FIG. 1 . In the animation process, the 3D image is displayed from Figure 2 The display effect of the 3D image 201 shown in (1) is presented Figure 7 During the display effect of the 3D picture 710 shown in (1), the 3D image 201 of the vehicle can always be located at the center of the 3D picture visible to the user. Fig.11 Taking the split screen interfaces shown in FIG. 1 as an example, the 3D image 201 of the vehicle is always located at Fig.11 The 3D image 1101 shown in (1) Fig.11 The 3D image 1111 shown in (2) Fig.11 The 3D image 1121 shown in (3) Fig.11 The 3D image 1131 shown in (4) Fig.11 The 3D image 1141 shown in (5) Fig.11 The center position of the 3D image 1151 etc. shown in (6).

[0243] In some embodiments, the vehicle's central control screen can display the real scene in a layer above the 3D picture to block part of the cropped 3D picture. In this way, the relative position of the 3D image of the target object in the 3D picture visible to the user can be ensured to always remain in the original position.

[0244] As a specific example, taking the target object as the vehicle, and the original position of the 3D image of the vehicle as the center position of the 3D image visible to the user, as Fig.12 As shown, the real scene image 720 can block part of the display area of ​​the 3D image obtained according to the layout, such as the area with a width of x pixels on the right, and the 3D image 201 of the vehicle can remain in the 3D image visible to the user, that is, Fig.12 The center position of the 3D picture 710 is shown.

[0245] In some embodiments, the size of the area of ​​the 3D image obtained according to the layout that is blocked by the real scene image can be determined according to the size of the original 3D image that is cropped. In some specific implementations, the size of the area of ​​the 3D image that is blocked by the real scene image can be the same as the size of the original 3D image that is cropped. Figure 2 The 3D image 200 shown in (1) is moved to the left by x pixels to obtain Fig.12 The 3D image obtained according to the layout shown in , that is, the original 3D image is cropped out of an area with a width of x pixels, then Fig.12 The real scene picture 720 shown in can also cover the area of ​​the cropped 3D picture with a width of x pixels.

[0246] It can be understood that this embodiment is based on Figure 7 Taking the split screen interface 700 shown in (1) as an example, during the animation process, one or more split screen interfaces displayed on the central control screen of the vehicle, such as Fig.11 In each split-screen interface shown, the real scene image can also be displayed in a layer above the 3D image to cover part of the cropped 3D image area, ensuring that the relative position of the 3D image of the target object in the 3D image visible to the user always remains in the original position, such as but not limited to the center position, etc. In this way, throughout the animation, the 3D image of the target object can always be in the center position of the 3D image visible to the user, allowing the user to always observe the environmental conditions around the target object, such as the environmental conditions around the vehicle, etc., while improving the display effect, it can also improve driving safety.

[0247] In some embodiments, when the moving duration included in the animations configured for the 3D image and the real scene image is the same, the ratio of the moving speed of the 3D image and the real scene image is set to be the same as the ratio of the split-screen display of the 3D image and the real scene image, and the real scene image is displayed in the layer above the 3D image, so as to achieve the purpose described in the above embodiment that the size of the area of ​​the 3D image after being cut off by the real scene image is the same as the size of the original 3D image cut off, thereby achieving the purpose of ensuring that the relative position of the 3D image of the target object in the 3D image visible to the user always remains in the original position. A one-shot display effect can be achieved, and it can also be ensured that the 3D image of the target object (such as the 3D image of the vehicle itself) is always in the center of the 3D image visible to the user.

[0248] Among them, the vehicle's central control screen has changed from only displaying information such as Figure 2 3D picture 200 shown in (1) to display Figure 7 The process of changing the split screen interface 730 shown in (2) can refer to the above-mentioned vehicle central control screen from only displaying such as Figure 2 3D picture 200 shown in (1) to display Figure 7 Related implementation of the process of the split-screen interface 700 shown in (1).

[0249] In some scenarios, the vehicle's central control screen can display a full-screen interface after displaying the split-screen interface. For example, the full-screen interface can be a full-screen interface of any screen included in the split-screen interface, such as but not limited to a full-screen interface of a 3D screen, a full-screen interface of a real-life screen, etc. Figure 7 Taking the split-screen interface shown in the figure as an example, the full-screen interface displayed on the vehicle's central control screen can be such as Figure 2 The 3D image 200 shown in (1) may also be Figure 2 The real scene picture 210 shown in (2).

[0250] In some embodiments, the instruction for triggering the display of the above-mentioned full-screen interface (i.e., the second instruction) may be executed by the user. For example, the instruction may be various voice operations, gesture operations, key operations, etc. performed by the user. Taking the driving and parking integrated scenario as an example, as a specific example, the instruction may be an operation of canceling parking performed by the user. Of course, in other scenarios, the instruction may also be other operations performed by the user, and this application does not specifically limit this.

[0251] In other embodiments, the instruction for displaying the above-mentioned full-screen interface may also be automatically generated by the vehicle or the central control screen of the vehicle. Taking the driving-parking integrated scenario as an example, as a specific example, when the vehicle or the central control screen of the vehicle determines that the parking is finished, the instruction may be generated. Alternatively, when the vehicle or the central control screen of the vehicle determines that the duration of displaying the split-screen interface exceeds a preset duration, the vehicle or the central control screen of the vehicle may generate the instruction. The embodiments of the present application do not impose specific restrictions on this.

[0252] Optionally, when an instruction for triggering display of a full-screen interface is generated by other devices, the other devices may send the instruction to the vehicle's central control screen so that the vehicle's central control screen displays the full-screen interface according to the instruction.

[0253] In this scenario, in some embodiments, the central control screen of the vehicle can also realize the process from displaying the 3D image and the real scene image in split screen to displaying only the 3D image by configuring animation for the 3D image and the real scene image. Please refer to the above description for the introduction of the animation.

[0254] In some embodiments, if the full-screen interface and the interface before the split-screen display are the same type of screen, such as the interface before the split-screen display is a 3D screen, the full-screen interface is also a 3D screen. In other words, the full-screen interface is the interface of the window where the interface before the split-screen display is located. In the process of the vehicle's central control screen changing from displaying the split-screen interface to displaying the full-screen interface, the movement direction of the 3D screen can be the same as the movement direction of the real-life screen. However, the movement direction of the aforementioned screen is opposite to the movement direction of the screen in the process of the vehicle's central control screen changing from displaying the full-screen interface to displaying the split-screen interface.

[0255] For example, the vehicle's central control screen changes from displaying the 3D image 200 shown in (1) of FIG2 to displaying Figure 7 In the split screen interface 700 shown in (1), the screen moves to the left. Then, the central control screen of the vehicle changes from Figure 7 The split screen interface 700 shown in (1) is displayed Figure 2 In the 3D picture 200 shown in (1), the picture moves to the right.

[0256] If the full-screen interface and the interface before the split-screen display are different types of pictures, such as the interface before the split-screen display is a 3D picture, and the full-screen interface is a real-scene picture. In other words, the full-screen interface is not the interface of the window where the interface before the split-screen display is located. When the vehicle's central control screen changes from displaying the split-screen interface to displaying the full-screen interface, the movement direction of the 3D picture and the real-scene picture is the same. However, the movement direction of the aforementioned picture is the same as the movement direction of the picture when the vehicle's central control screen changes from displaying the full-screen interface to displaying the split-screen interface.

[0257] For example, the vehicle's central control screen changes from displaying the 3D image 200 shown in (1) of FIG2 to displaying Figure 7 In the split screen interface 700 shown in (1), the screen moves to the left. Then, the central control screen of the vehicle changes from Figure 7 The split screen interface 700 shown in (1) is displayed Figure 2 In the real scene picture 210 shown in (2), the moving direction of the picture is also to the left.

[0258] It can be understood that the full-screen interface and the interface before the split-screen display are the same type of screen, but the contents in the two same type of screens can be the same or different.

[0259] In some embodiments, during the animation process, the movement duration, start time, and end time of the 3D image and the real scene image may also be the same.

[0260] In some embodiments, during the animation process, the distance, speed, starting position, and ending position of the 3D image and the real scene image may also be different. In a specific embodiment, taking the interface before the split-screen display as a 3D image and the full-screen interface as a 3D image, the ratio of the distance moved by the 3D image and the real scene image can be the same as the ratio of the split-screen display of the 3D image and the real scene image; the ratio of the speed of the 3D image moving and the speed of the real scene image moving can also be the same as the ratio of the split-screen display of the 3D image and the real scene image. In this way, the display effect of one shot can also be achieved in the process of displaying the split-screen interface to the full-screen interface.

[0261] In some embodiments, during the animation process, the 3D image of the target object may also remain at the original position of the 3D image visible to the user, such as but not limited to the center position.

[0262] For example: the vehicle's central control screen Figure 7 The split screen interface 700 shown in (1) is displayed Figure 2 During the 3D image 200 shown in (1), the vehicle's central control screen can also display Fig.11 The split screen interfaces are displayed in the following order: Fig.11 The split screen interface 1150 shown in (6) Fig.11 The split screen interface 1140 shown in (5) Fig.11 The split screen interface 1130 shown in (4) Fig.11 The split screen interface 1120 shown in (3) Fig.11 The split screen interface 1110 shown in (2) Fig.11 In this way, during the animation process, the following are displayed in sequence: Fig.11 The real scene picture shown can realize the animation effect of "banner pulling out".

[0263] That is, the display sequence is similar to the vehicle's central control screen from displaying the 3D image 200 as shown in (1) of FIG. 2 to displaying Figure 7 During the split screen interface 700 shown in (1), the display Fig.11 The interfaces are shown in reverse order.

[0264] The 3D image of the target object (such as the 3D image 201 of the vehicle) can still be in Fig.11 Middle (6) to Fig.11In this way, during the entire animation from displaying the split-screen interface to displaying the full-screen interface, the 3D image of the target object can also be always at the center of the 3D image visible to the user, so that the user can always observe the environmental conditions around the target object, such as the environmental conditions around the vehicle, etc., which can improve the display effect and driving safety.

[0265] In some embodiments, the vehicle's central control screen can also display the real scene in a layer above the 3D picture to block part of the cropped 3D picture. In this way, the relative position of the 3D image of the target object in the 3D picture visible to the user can be ensured to always remain in the original position.

[0266] For other implementations in this scenario, please refer to the relevant implementation from displaying the full-screen interface to displaying the split-screen interface described above.

[0267] It can be understood that the embodiment of the present application takes left and right split screen as an example, and the implementation of top and bottom split screen can refer to the relevant implementation of left and right split screen.

[0268] It can also be understood that the embodiment of the present application takes the split screen display of two screens as an example, and the implementation of the split screen display of multiple screens can also refer to the implementation of the embodiment of the present application. Figure 7 When the split screen interface is displayed, if the vehicle's central control screen needs to display a third screen, the vehicle's central control screen can Figure 7 The split screen shown is taken as a whole, and then continue to Figure 7 The split screen interface shown in the figure continues to be split screen with the third screen. For the specific implementation of the split screen process, please refer to Fig.11 Similarly, when the fourth screen is displayed next, the central control screen of the vehicle can treat the first three screens as a whole, and so on.

[0269] Of course, the vehicle's central control screen already displays information such as Figure 7 When the split screen interface is shown, if the vehicle's central control screen needs to display a third screen, the vehicle's central control screen can also float the third screen on a screen such as Figure 7 The split-screen interface shown is not limited to this embodiment of the present application.

[0270] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. In combination with the units and algorithm steps of each example described in the embodiment disclosed in this application, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer-driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present application.

[0271] The present application is an embodiment that can divide the functional modules of the electronic device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0272] like Fig.13 , which is a schematic diagram of the structure of an electronic device 1300 provided in an embodiment of the present application, and the electronic device 1300 can be used to implement the methods described in the above method embodiments. Exemplarily, the electronic device 1300 may specifically include: a processing unit 1301 and a display unit 1302.

[0273] The processing unit 1301 is used to support the electronic device 1300 to execute Figures 1 to 12 The processing function performed by any of the electronic devices described above. The display unit is used to support the electronic device 1300 to perform Figures 1 to 12 The display function performed by any of the electronic devices described above.

[0274] Optional, Fig.13 The electronic device 1300 shown may also include a storage unit 1303, which stores a program or instruction. When the processing unit 1301 executes the program or instruction, Fig.13 The electronic device 1300 shown can execute the method shown in the above method embodiment.

[0275] Optional, Fig.13 The electronic device 1300 shown may also include a communication unit (not shown in the figure), which is used to support the electronic device 1300 to execute the steps of communication between the electronic device and other devices in the embodiments of the present application.

[0276] Fig.13The technical effects of the electronic device 1300 shown can refer to the technical effects of the method described in the above method embodiment, and will not be repeated here. Fig.13 The processing unit 1301 involved in the electronic device 1300 shown can be implemented by a processor or a processor-related circuit component, which can be a processor or a processing module. The communication unit can be implemented by a transceiver or a transceiver-related circuit component, which can be a transceiver or a transceiver module. The display unit 1302 can be implemented by display screen-related components.

[0277] The present application also provides a chip system, such as Fig.14 As shown, the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 can be interconnected via lines. For example, the interface circuit 1402 can be used to receive signals from other devices. For another example, the interface circuit 1402 can be used to send signals to other devices (such as processor 1401). Exemplarily, the interface circuit 1402 can read instructions stored in the memory and send the instructions to the processor 1401. When the instructions are executed by the processor 1401, the electronic device can execute the various steps performed by the electronic device in the above-mentioned embodiment. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0278] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0279] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be separately provided with the processor, which is not limited in the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be provided on different chips. The present application does not specifically limit the type of memory and the arrangement of the memory and the processor.

[0280] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0281] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0282] The embodiment of the present application also provides a vehicle, including: a processor and a memory, the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, the processor reads the computer instructions from the memory, so that the vehicle executes the method described in the above method embodiment. Optionally, the memory can be coupled to the processor or can be independent of the memory.

[0283] An embodiment of the present application also provides a vehicle-mounted system, including a vehicle-mounted module and a display screen, wherein the vehicle-mounted module is used to cooperate with the display to execute the method described in the above method embodiment.

[0284] The embodiment of the present application also provides a vehicle-mounted module, including: a processor and a memory, the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and the processor reads the computer instructions from the memory so that the vehicle-mounted module executes the method described in the above method embodiment. Optionally, the memory can be coupled to the processor or can be independent of the memory.

[0285] An embodiment of the present application further provides a circuit system, the circuit system includes a processing circuit, and the processing circuit is configured to execute the method described in any one of the designs of the first aspect above.

[0286] An embodiment of the present application further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the above method embodiment.

[0287] An embodiment of the present application provides a computer program product, which includes: a computer program or instructions, when the computer program or instructions are executed on a computer, the computer executes the method described in the above method embodiment.

[0288] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the device executes the methods in the above-mentioned method embodiments.

[0289] Among them, the electronic device, vehicle, vehicle-mounted system, vehicle-mounted module, circuit system, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0290] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0291] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The various embodiments can be combined with each other or referenced to each other without conflict. The device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0292] The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be a physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, each functional unit in each embodiment of the present application may be integrated in a processing unit, or each unit may exist physically separately, or two or more units may be integrated in one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0293] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0294] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display method, characterized in that: Applied to an electronic device having a display screen, the method comprises: Displaying a first interface, where the first interface is a first screen of a first application, and a first target is displayed at the center of the first screen of the first application; In response to a first instruction, displaying a second interface dynamically changed from the first interface; The second interface is a split-screen interface of the second screen of the first application and the first screen of the second application, the second screen of the first application is a partial screen of the first screen of the first application, and the first target is displayed in the center of the second screen of the first application.

2. The method according to claim 1, characterized in that In the process of dynamically changing the display of the first interface to the second interface, the method further includes: At least one frame of a third interface is displayed, wherein the third interface is a split-screen interface of the third screen of the first application and the second screen of the second application, the third screen of the first application is a partial screen of the first screen of the first application, the first target is displayed at the center of the third screen of the first application, and the second screen of the second application is a partial screen of the first screen of the second application.

3. The method according to claim 1 or 2, characterized in that: After displaying the second interface dynamically changed from the first interface in response to the first instruction, the method further includes: receiving a second instruction; In response to the second instruction, display dynamically changes from the second interface to the first interface.

4. The method according to claim 3, characterized in that In the process of displaying the first interface dynamically changed from the second interface, the method further includes: The at least one frame of the third interface is displayed.

5. The method according to any one of claims 2 to 4, characterized in that: The sizes of the third screens of the first application included in different third interfaces are different; and / or the sizes of the second screens of the second application included in the different third interfaces are different.

6. The method according to any one of claims 2 to 5, characterized in that: Before displaying at least one frame of the third interface, the method further includes: The data of the first screen of the first application is rendered through the first control, and the data of the first screen of the second application is rendered through the second control. The data of the first screen of the first application and the data of the second screen of the second application are used to generate the third interface and the second interface.

7. The method according to claim 6, characterized in that Before displaying each frame of the third interface in the at least one frame of the third interface, the method further includes: generating a third screen of the first application according to the data of the first screen of the first application and the parameters of the first layout respectively corresponding to the third screen of the first application included in each frame of the third interface, wherein the parameters of the first layout indicate the display effect of the data of the first screen of the first application on the display screen; generating a second screen of the second application according to the data of the first screen of the second application and the parameters of the second layout respectively corresponding to the second screen of the second application included in each frame of the third interface, wherein the parameters of the second layout indicate the display effect of the data of the first screen of the second application on the display screen; The third interface of each frame is synthesized according to the third screen of the first application and the second screen of the second application.

8. The method according to claim 6 or 7, characterized in that: Before displaying the second interface, the method further includes: generating a second screen of the first application according to data of the first screen of the first application and parameters of a first layout corresponding to the second screen of the first application, wherein the parameters of the first layout indicate a display effect of the data of the first screen of the first application on the display screen; generating the first screen of the second application according to the data of the first screen of the second application and the parameters of the second layout corresponding to the first screen of the second application, wherein the parameters of the second layout indicate the display effect of the data of the first screen of the second application on the display screen; The second interface is synthesized according to the second screen of the first application and the first screen of the second application.

9. The method according to claim 7 or 8, characterized in that: The parameters of the first layout are determined according to the animation parameters of the first screen configuration of the first application, and the parameters of the second layout are determined according to the animation parameters of the first screen configuration of the second application; The animation parameters configured in the first screen of the first application and / or the animation parameters configured in the first screen of the second application indicate multiple ones of a starting position, an ending position, a moving duration, a moving direction, a moving distance, and a moving speed.

10. The method according to claim 9, characterized in that The moving direction and moving duration indicated by the animation parameters of the first screen configuration of the first application are respectively the same as the moving direction and moving duration indicated by the animation parameters of the first screen configuration of the second application; and / or, a ratio between a moving distance indicated by an animation parameter configured for a first screen of the first application and a moving distance indicated by an animation parameter configured for a first screen of the second application is the same as a split-screen ratio between a second screen of the first application and a first screen of the second application in the second interface; And / or, the ratio between the moving speed indicated by the animation parameters of the first screen configuration of the first application and the moving speed indicated by the animation parameters of the first screen configuration of the second application is the same as the split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface.

11. The method according to claim 10, characterized in that The first screen of the second application is displayed on a layer above the second screen of the first application; the second screen of the second application is displayed on a layer above the third screen of the first application.

12. The method according to any one of claims 1 to 11, characterized in that: The first application is an advanced driver assistance system (ADAS) application, and the second application is a camera application.

13. The method according to any one of claims 1 to 12, characterized in that: The split-screen ratio of the second screen of the first application and the first screen of the second application in the second interface is 1:

2.

14. An electronic device, characterized in that: include: A processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and the processor reads the computer instructions from the memory so that the electronic device executes the method as described in any one of claims 1-13.

15. A vehicle, characterized in that: include: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, the processor reading the computer instructions from the memory so that the vehicle executes the method as claimed in any one of claims 1 to 13.

16. A vehicle-mounted system, characterized in that: It comprises a vehicle-mounted module and a display screen, wherein the vehicle-mounted module is used to cooperate with the display screen to execute the method as described in any one of claims 1-13.

17. A vehicle-mounted module, characterized in that: include: A processor and a memory, the memory being coupled to the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, the processor reading the computer instructions from the memory so that the vehicle-mounted module executes the method as described in any one of claims 1-13.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a computer program or an instruction. When the computer program or the instruction is run on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 13.

19. A computer program product, characterized in that When the computer program product is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 13.

Images