Display adjustment method, electronic equipment, display system and vehicle

Abstract

The invention discloses a display adjustment method, electronic equipment, a display system and a vehicle, relates to the technical field of vehicles, and is used for improving the vehicle-mounted display screen use experience of a user. The method comprises the following steps: displaying a first picture and a second picture of a target virtual scene; in response to a received picture adjustment instruction for the first picture, performing association adjustment on the first picture and the second picture; wherein the first adjustment parameter of the first picture is different from the second adjustment parameter of the second picture relative to the initial state of the virtual camera in the target virtual scene.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a display adjustment method, an electronic device, a display system and a vehicle. BACKGROUND

[0002] With the rapid development of intelligent cockpit technology, multi-screen display systems have gradually become the core interactive platform of high-end vehicles. Through advanced screen splicing algorithms and distributed rendering technology, the system can construct a 3D scene display with high immersion.

[0003] However, the splicing scheme still has experience bottlenecks in multi-screen collaborative interaction, resulting in poor user experience. SUMMARY

[0004] The present application provides a display adjustment method, an electronic device and a vehicle, which can improve the user experience of using the vehicle display screen.

[0005] To achieve the above purpose, the present application adopts the following technical solutions:

[0006] In a first aspect, the present application provides a display adjustment method, which comprises: displaying a first picture and a second picture of a target virtual scene; in response to receiving a picture adjustment instruction for the first picture, performing associated adjustment on the first picture and the second picture; wherein the first adjustment parameter of the first picture and the second adjustment parameter of the second picture are different relative to the initial state of the virtual camera in the target virtual scene.

[0007] The display adjustment method provided by the present application displays different pictures of the same virtual scene, forms a coherent visual space through multi-picture splicing, and thus can guarantee the immersive experience of the user. When a picture adjustment instruction for the first picture is received, the first picture and the second picture are subjected to associated adjustment, and the first picture and the second picture use different adjustment parameters (relative to the initial state of the virtual camera in the target virtual scene), which can realize more flexible and personalized virtual scene picture presentation. On the one hand, the user can make specific adjustments to the first picture according to his own needs, and at the same time the system can make corresponding changes to the second picture according to the associated rules to meet the diversified visual experience needs; on the other hand, the setting of different adjustment parameters enables the two pictures to maintain their own unique adjustment effects in the associated adjustment process, and through reasonable parameter setting, the transition of the pictures in the adjustment process is smooth and stable, avoiding the problem of picture flickering when the two pictures are adjusted, and thus the user's experience when checking the display picture can be improved.

[0008] In some embodiments, the virtual camera positions corresponding to the first picture and the second picture are different.

[0009] In some embodiments, parameters of the virtual cameras corresponding to the first picture and the second picture are different.

[0010] In some embodiments, the first screen is used to present a first scene body of the target virtual scene, and the second screen is used to present a second scene body of the target virtual scene.

[0011] In some embodiments, the first scene subject and the second scene subject are different.

[0012] In some embodiments, one of the first scene subject and the second scene subject is a vehicle, and the other is related to a scene background element of the target virtual scene.

[0013] In some embodiments, the first adjustment parameter includes at least one of the following: a pose parameter, an optical parameter, and a motion parameter of a virtual camera corresponding to the first picture;

[0014] The second adjustment parameter includes at least one of the following: a posture parameter, an optical parameter, and a motion parameter of the virtual camera corresponding to the second picture.

[0015] In some embodiments, the posture parameters include: rotation angle or camera position; the optical parameters include: field of view angle; and the motion parameters include: rotation angular velocity, angular acceleration, or camera movement speed.

[0016] In some embodiments, the initial state of the first frame and the initial state of the second frame form a continuous frame.

[0017] In some embodiments, performing associated adjustment on the first and second screens includes: determining first and second adjustment parameters based on the instruction intent of the screen adjustment instruction; adjusting the first screen based on the first adjustment parameter, and adjusting the second screen based on the second adjustment parameter.

[0018] In some embodiments, determining the first adjustment parameter and the second adjustment parameter based on the instruction intent of the screen adjustment instruction includes: determining the first adjustment parameter based on the instruction intent of the screen adjustment instruction; performing weighted calculation on the first adjustment parameter according to a preset ratio to obtain the second adjustment parameter.

[0019] In some embodiments, the preset ratio is related to the virtual camera positions and / or scene subjects of the first and second pictures respectively.

[0020] In some embodiments, the preset ratio is determined based on the distance between the virtual camera position of the first picture and the center of the scene, and the distance between the virtual camera position of the second picture and the center of the scene.

[0021] In some embodiments, the preset ratio is determined based on the visible range of the scene main body of the first picture in the target virtual scene and the visible range of the scene main body of the second picture in the target virtual scene.

[0022] In some embodiments, the preset ratio is: a visual range corresponding to a scene subject of the first picture, divided by a visual range corresponding to a scene subject of the second picture.

[0023] In some embodiments, the picture adjustment instruction is triggered by at least one of the following: detecting a touch operation on the first display screen; the touch operation includes at least one of the following: a sliding operation, a clicking operation, a long-pressing operation, a pinch / expand gesture operation, a rotation gesture operation; the first display screen is a display screen displaying the first picture; detecting that a view angle switching key is triggered; receiving a voice instruction carrying a view angle switching; receiving a picture adjustment instruction sent by a remote control device; detecting a preset gesture action of a user on the target seat; detecting that a first gaze point of a user on the target seat on the first display screen moves to a second gaze point.

[0024] In some embodiments, displaying the first picture of the target virtual scene and the second picture includes: displaying the first picture of the target virtual scene through the first display screen, and displaying the second picture of the target virtual scene through the second display screen.

[0025] In some embodiments, displaying the first picture of the target virtual scene through the first display screen, and displaying the second picture of the target virtual scene through the second display screen includes: in response to a virtual scene display instruction, displaying the first picture of the target virtual scene indicated by the virtual scene display instruction through the first display screen; in a case where the second display screen is in a non-use state, displaying the second picture of the target virtual scene through the second display screen.

[0026] In some embodiments, the non-use state is used to indicate that the display screen is in a screen-on state without content update activity, and no interaction operation is detected within a preset time period.

[0027] In some embodiments, the non-use state includes at least one of the following: a standby sleep state, a static information display state, a screen protection state, and an information standby state.

[0028] In some embodiments, displaying the second picture of the target virtual scene through the second display screen includes: in a case where the second display screen is in a use state, waiting until the second display screen switches to a non-use state, and then displaying the second picture through the second display screen.

[0029] In some embodiments, in a case where the second display screen is in a non-use state, displaying the second picture of the target virtual scene through the second display screen includes: detecting a communication state between the first display screen and the second display screen; in a case where the communication state is a normal communication state and the second display screen is in a non-use state, displaying the second picture through the second display screen.

[0030] In some embodiments, in a case where the communication state is the normal communication state and the second display screen is in the non-use state, displaying the second picture through the second display screen comprises: in a case where the communication state is the normal communication state and the second display screen is in the non-use state, performing, by a graphic processing unit corresponding to the first display screen, picture rendering on the second picture based on the target virtual scene, and sending the second picture after the picture rendering to the second display screen for display.

[0031] In some embodiments, the method further comprises: in a case where the communication state is the abnormal communication state, displaying a static image of the target virtual scene through the second display screen, or displaying a pre-stored image in a storage unit corresponding to the second display screen through the second display screen.

[0032] In some embodiments, one of the first display screen and the second display screen is a main driver display screen of the vehicle, and the other is a co-driver display screen of the vehicle.

[0033] In some embodiments, the method further comprises: determining an environmental parameter of the target virtual scene based on current time information and / or real-time weather data; and updating the first picture and the second picture based on the environmental parameter.

[0034] In a second aspect, the embodiments of the present application provide an electronic device, comprising a processor and a memory, the processor is connected with the memory, and the memory stores computer instructions, when the computer instructions run on the electronic device, the electronic device executes the method provided in the first aspect.

[0035] In a third aspect, the embodiments of the present application provide a display system, comprising an electronic device and a display screen; the display screen is used to display a first picture and a second picture; and the electronic device is used to execute the method provided in the first aspect.

[0036] In some embodiments, the display screen comprises a first display screen and a second display screen, the first display screen is used to display the first picture, and the second display screen is used to display the second picture.

[0037] In a fourth aspect, the embodiments of the present application provide a computer readable storage medium, which stores computer execution instructions, when the computer execution instructions run on the computer, the computer executes the method provided in the first aspect.

[0038] In a fifth aspect, the embodiments of the present application provide a vehicle, comprising the electronic device provided in the second aspect, or the display system provided in the third aspect, or the computer readable storage medium provided in the fourth aspect.

[0039] In a sixth aspect, the embodiments of the present application provide a computer program product, comprising instructions, when the instructions run on the computer, the computer executes the method provided in the first aspect.

[0040] The technical effects brought by any one of the implementation manners of the second aspect to the sixth aspect can refer to the technical effects brought by the corresponding implementation manners in the first aspect, which will not be described here. BRIEF DESCRIPTION OF DRAWINGS

[0041] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0042] Figure 1 Method flow of a display adjustment method provided by the embodiment of the present application Figure 1 ;

[0043] Figure 2 Display screen display content diagram provided by the embodiment of the present application Figure 1 ;

[0044] Figure 3 Display screen display content diagram provided by the embodiment of the present application Figure 2 ;

[0045] Figure 4 Method flow of a display adjustment method provided by the embodiment of the present application Figure 2 ;

[0046] Figure 5 Method flow of a display adjustment method provided by the embodiment of the present application Figure 3 ;

[0047] Figure 6 Method flow of a display adjustment method provided by the embodiment of the present application Figure 4 ;

[0048] Figure 7 Structure diagram of a multi-screen linkage interaction system provided by the embodiment of the present application

[0049] Figure 8 Schematic diagram of an electronic device provided by the embodiment of the present application DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings. Obviously, the described embodiments are only some of the embodiments of the present application, not all. Based on the embodiments provided by the present application, all other embodiments obtained by those skilled in the art belong to the scope of protection of the present application.

[0051] In the embodiments of the present application, the terms "center", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship shown in the drawings, which are only for the convenience of describing the embodiments of the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.

[0052] In the embodiments of the present application, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the sentence "includes a…" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0053] "A and / or B" includes the following three combinations: only A, only B, and a combination of A and B.

[0054] With the rapid development of intelligent cockpit technology, multi-screen display systems have gradually become the core interactive platform of high-end vehicles. Through advanced screen splicing algorithms and distributed rendering technology, multiple display screens display the content of a virtual scene, and build a 3D scene display with high immersion. However, when multiple display screens display the content of a virtual scene, there are still experience bottlenecks in multi-screen collaborative interaction, resulting in poor user experience.

[0055] For example, when multiple display screens display the content of a virtual scene, the rotation center is usually set on one display screen. During the process of multi-screen collaborative interaction, when the virtual scene rotates around the rotation center, the viewpoint (Camera Position) of the other screens will make circular motion around the center, causing the farther the screen is from the rotation center, the more dramatic the change in viewing angle (same angular velocity but greater linear velocity), and thus easily causing flickering problems, thereby significantly reducing user experience. For example, when the vehicle-mounted center control screen rotates, the 3D scene edge of the co-pilot screen appears to jump due to perspective distortion.

[0056] Based on this, the display adjustment method provided in the embodiments of the present application can display different pictures of the same virtual scene, form a coherent visual space through multi-picture splicing, and thus can guarantee the immersive experience of the user. When a picture adjustment instruction for the first picture is received, the first picture and the second picture are adjusted in association, and the first picture and the second picture use different adjustment parameters (relative to the initial state of the target virtual scene), which can realize more flexible and personalized presentation of the virtual scene picture. On the one hand, the user can make specific adjustments to the first picture according to his own needs, and at the same time, the system can make corresponding changes to the second picture according to the association rule, thus meeting the diversified visual experience needs; on the other hand, the setting of different adjustment parameters enables the two pictures to maintain their own unique adjustment effects in the process of associated adjustment, and through reasonable setting of the parameters, it is ensured that the pictures transition smoothly and stably in the adjustment process, avoiding the problem of picture flickering when the two pictures are adjusted, and thus the use experience of the user when checking the display picture can be improved.

[0057] It can be understood that the display adjustment method provided in the embodiments of the present application can be applied to a device with multiple display screens to display the first picture and the second picture through the multiple display screens, such as a vehicle with a main driver screen and a copilot screen, or an e-sports display with multiple screens; it can also be applied to a device with a single display screen, and the display area of the single display screen is divided to display the first picture and the second picture, which is not limited in the embodiments of the present application.

[0058] The embodiments of the present application do not limit the execution subject of the display adjustment method. Taking the display adjustment method applied to a vehicle as an example, the display adjustment method can be applied to a controller related to imaging of the display screen of the vehicle, such as a vehicle-mounted controller. For ease of description, the vehicle-mounted controller is taken as an example in the following description.

[0059] Please refer to Figure 1 The display adjustment method provided in the embodiments of the present application includes the following steps S101-S102:

[0060] S101, display a first picture and a second picture of a target virtual scene.

[0061] It should be understood that the target virtual scene refers to an immersive three-dimensional environment constructed through 3D modeling, rendering and dynamic interaction technology, which is used to simulate the interaction between the vehicle and the environment. The scene content can include a vehicle model and a background environment, etc. The first picture and the second picture can share the same scene data (such as 3D model, light map) of the target virtual scene, but generate different pictures through different rendering parameters.

[0062] In some embodiments, in the desktop or screen saver settings of the vehicle display screen, the user can flexibly switch between two-dimensional static content (such as pictures, wallpapers) and three-dimensional dynamic content (such as 3D models, interactive scenes) according to personal preferences or use scenarios, which not only improves the personalized experience, but also takes into account the practicality and entertainment.

[0063] Therefore, as a feasible implementation manner, after receiving the virtual scene display instruction, the first display screen and the second display screen can display the picture of the target virtual scene.

[0064] It should be understood that the embodiments of the present application do not limit the triggering conditions of the virtual scene display instruction. The user can trigger the virtual scene display instruction by various ways such as touching the virtual scene icon (such as "waterfall 3D display" and "vehicle AR demonstration"), making a preset gesture or issuing a voice instruction, which is not limited by the embodiments of the present application.

[0065] For example, the user long-presses the "scene key" on the steering wheel for 1 second, and the vehicle-mounted controller determines that the virtual scene display instruction is received, and switches to the 3D vehicle display scene last used by the user.

[0066] S102, in response to receiving a picture adjustment instruction for the first picture, performing associated adjustment on the first picture and the second picture.

[0067] It should be understood that the embodiments of the present application do not limit the triggering conditions of the picture adjustment instruction.

[0068] As an implementation manner, the picture adjustment instruction can be determined to be received when a touch operation on the first display screen is detected. The touch operation includes at least one of the following: sliding operation, clicking operation, long-pressing operation, pinch / expand gesture operation, rotation gesture operation. Whether the picture adjustment instruction is triggered is determined by detecting the gesture (such as sliding, rotating, pinching, etc.) of the user on the main screen, for example, double-finger sliding adjusts the pitch angle of the virtual scene, or three-finger rotation switches the observation view angle. That is

[0069] As an implementation manner, the picture adjustment instruction can be determined to be received when it is detected that the view angle switching key is triggered. This way can rely on physical keys (such as steering wheel keys, handle trigger keys) or virtual keys (such as screen fixed icons) to trigger switching, for example, long-pressing the "View" key of the steering wheel switches the first / third person view angle.

[0070] As an implementation manner, the picture adjustment instruction can be determined to be received when a voice instruction carrying view angle switching is received. Whether the picture adjustment instruction is received is determined by analyzing the user instruction (such as "switch to rear view angle" and "view angle rotation 30°") through voice recognition technology.

[0071] As an implementation manner, the picture adjustment instruction can be determined to be received when a picture adjustment instruction sent by a remote control device is received. That is, when a view angle switching command sent by a remote control device such as a mobile phone, a remote controller, or a cloud control terminal is received.

[0072] As an implementation manner, the picture adjustment instruction can be determined to be received when a preset gesture action of a user in a target seat is detected. The user gesture (such as waving a hand or making a fist) can be detected by a camera or a radar to trigger the view angle switching. For example, after a rear passenger raises a hand, the system automatically projects the content of the co-driver screen to the front screen of the seat of the rear passenger.

[0073] As an implementation manner, the picture adjustment instruction can be determined to be received when a first gaze point of a user in a target seat on a first display screen is detected to move to a second gaze point. The movement track of the gaze point of the user on the screen (such as the gaze point moving from a central area to a right edge area) is detected by using a line-of-sight movement track analysis technology, the instruction intention of the picture adjustment instruction is determined to be rotating to the right, and thus the expression control follow-up according to the orientation of the eyes is implemented, and a natural interaction experience of "what you see is what you get" is implemented.

[0074] When the vehicle-mounted controller receives the picture adjustment instruction for the first display screen (such as the main driver screen), the instruction intention is analyzed, the adjustment parameters (such as the rotation center and the zoom ratio) of the first display screen and the second display screen are respectively calculated, the differential correlation adjustment of the two screens is implemented through frame synchronization and hardware acceleration, and the transition animation and the exception handling are provided, so as to ensure the fluency and safety of the multi-screen view angle switching.

[0075] In the embodiment of the application, the first adjustment parameter of the first picture and the second adjustment parameter of the second picture are different relative to the initial state of the virtual camera in the target virtual scene.

[0076] As an implementation manner, the initial state of the first picture and the initial state of the second picture constitute a continuous picture. The initial states of the two pictures are continuous, which is helpful to completely present the information contained in the virtual scene. They can be like two parts of a jigsaw puzzle, which jointly build a more comprehensive and richer scene picture.

[0077] Exemplarily, refer to Figure 2 When the method is applied to a vehicle, the two pictures can be respectively displayed by two display screens (a main driver screen and a co-driver screen) in the vehicle. The scene content of the target virtual scene can be that a vehicle model is located in front of a waterfall. As shown in Figure 2 The two pictures are continuous in the initial state, so that the information contained in the virtual scene can be completely presented.

[0078] The first adjustment parameter of the first picture and the second adjustment parameter of the second picture are different based on the initial state of the virtual camera in the target virtual scene. That is, different virtual camera adjustment parameters are used for the first picture and the second picture respectively. This means that the two pictures will present different visual effects after adjustment, and the visual effects between them will also be different.

[0079] It can be understood that the first picture and the second picture can share one virtual camera, and two different pictures can be displayed through time-sharing multiplexing or viewport segmentation of a single virtual camera. The first picture and the second picture can also be respectively provided with corresponding virtual cameras. In this way, the first adjustment parameter is determined based on the initial state of the virtual camera corresponding to the first picture, and the second adjustment parameter is determined based on the initial state of the virtual camera corresponding to the second picture.

[0080] The first picture and the second picture have different adjustment parameters, that is, when the pictures are adjusted, the same adjustment rule or value is not used, so as to realize differentiated linkage adjustment. Moreover, the first adjustment parameter and the second adjustment parameter are adjusted relative to the initial state of the virtual camera. That is, the adjustment of each picture is independent and targeted, and can be accurately adjusted according to the characteristics and needs of the respective pictures, avoiding the blindness and uniformity of adjustment, which helps to realize more flexible and more expected picture effects, and improves the user's satisfaction with picture adjustment.

[0081] As a feasible implementation manner, the first picture and the second picture are generated by using different virtual cameras. In order to avoid picture flicker, the camera positions of the two pictures adopt a differentiated adjustment strategy. Specifically, when the view angle or scene is adjusted, the displacement / rotation amount of the two virtual cameras is set to different values, rather than completely synchronous change. This asymmetric adjustment method can effectively eliminate the picture flicker problem caused by complete consistency of camera movement, while maintaining visual continuity.

[0082] As a feasible implementation manner, the first adjustment parameter includes at least one of the following: a pose parameter, an optical parameter, and a motion parameter of the virtual camera corresponding to the first picture.

[0083] It should be understood that the pose parameter usually relates to the position and attitude of the virtual camera in the virtual space, and adjusting the pose parameter can change the observation angle and shooting distance of the virtual camera, thereby changing the content composition and element layout of the picture. The corresponding pose parameters of the two pictures are different when they are adjusted, so as to realize the visual experience of bringing completely different visual experience to the user.

[0084] Exemplarily, in a virtual vehicle display scene, when the pose parameters of a first picture are adjusted, the initial eye-level view angle of the virtual camera is gradually adjusted to a low-angle overhead view angle. As the parameters change, the chassis height and front face modeling details of the vehicle in the picture are enlarged and presented. The audience can clearly see the air intake grille texture, headlight internal structure, etc. of the front part of the vehicle. The second picture is adjusted from the initial side and rear following view angle to a high-angle overhead view angle. The overall profile, body line direction, and proportional relationship with the surrounding environment of the vehicle in the picture are clear at a glance. The two pictures provide the user with comprehensive information about the vehicle appearance from the local to the overall through the dynamic adjustment of different pose parameters.

[0085] As an implementation manner, the pose parameters include a rotation angle or a camera position.

[0086] The rotation angle determines the degree of rotation of the virtual camera around the vehicle or other target, which can change the orientation and display angle of the vehicle in the picture. The rotation angles of the two pictures are different, so that different picture adjustment experiences can be presented to the user. Moreover, due to the different rotation angles of the two pictures, the change rhythm and amplitude of the picture elements in the adjustment process are different, and there is no conflict due to synchronous adjustment, so as to ensure smooth and stable picture transition, greatly improving the user experience when checking the display picture.

[0087] The camera position explicitly specifies the specific coordinates of the virtual camera in the three-dimensional space, which affects the distance and view angle of the vehicle and the surrounding environment in the picture. That is, the adjustment amount of the camera position is different when the two pictures are adjusted, such as the depth of field and the size of the main body in the two pictures are different, so as to effectively avoid the picture flicker problem.

[0088] The optical parameters of the virtual camera corresponding to the first picture affect the visual effect of the picture taken by the virtual camera. As an implementation manner, the optical parameters include a field of view angle. The field of view angle refers to the range of the scene that the camera can observe, which is usually measured by angle and can be divided into horizontal field of view angle, vertical field of view angle and diagonal field of view angle. In the virtual camera, the size of the field of view angle directly affects the content and visual effect presented by the picture.

[0089] The motion parameters describe the motion mode of the virtual camera in the virtual scene. As an implementation manner, the motion parameters include a rotation angular velocity, an angular acceleration or a camera movement speed.

[0090] It can be understood that when two pictures adopt completely same motion parameters, the rendering system is prone to rendering delay due to instantaneous overload when facing rapid view angle or position change, thereby causing picture flicker. By adopting the manner of asymmetrically adjusting motion parameters, on the one hand, different parameter combinations enable the rendering system to adjust strategies as needed and disperse processing pressure, and on the other hand, by reasonably designing parameter change curves, the picture transition can be ensured to be natural and smooth, and visual coherence can be maintained. Thus, picture flicker can be effectively eliminated, and the visual experience of the virtual scene can be improved.

[0091] Correspondingly, the second adjustment parameter can also include at least one of the following: a pose parameter, an optical parameter, and a motion parameter of a virtual camera corresponding to the second picture. Embodiments of the present application will not be described here.

[0092] It should be understood that the relationship between the adjustment parameters corresponding to the two pictures can be determined according to the relationship between the configuration parameters of the two pictures, so that the rendering process is optimized for different display focuses during the rotation, reducing the mutual interference of different picture rendering and the possibility of picture flicker caused by rendering conflict.

[0093] It can be seen that the display adjustment method provided by the embodiments of the present application displays different pictures of the same virtual scene, and forms a coherent visual space through multi-picture splicing, thereby being able to guarantee the immersive experience of the user. When a picture adjustment instruction for the first picture is received, the first picture and the second picture are executed for associated adjustment, and the first picture and the second picture adopt different adjustment parameters (relative to the initial state of the target virtual scene), which can realize more flexible and personalized virtual scene picture presentation. On the one hand, the user can make specific adjustment to the first picture according to his own needs, and at the same time, the system can make corresponding changes to the second picture according to the association rule, meeting the diversified visual experience needs; on the other hand, the setting of different adjustment parameters enables the two pictures to maintain their own unique adjustment effects during the associated adjustment, and by reasonably setting the parameters, the transition of the pictures during the adjustment process is ensured to be smooth and stable, avoiding the problem of picture flicker when the two pictures are adjusted, thereby being able to improve the use experience of the user when consulting the display picture.

[0094] In some embodiments, in order to avoid the problem of picture flicker affecting the viewing experience of the user, different display focuses can be set for the two pictures, the display focus can correspond to different parts or design elements in the target virtual scene, and the relationship between the adjustment parameters corresponding to the two pictures can be determined according to the display focus, so that the rendering process is optimized for different display focuses during the rotation, reducing the mutual interference of different picture rendering and the possibility of picture flicker caused by rendering conflict.

[0095] As a feasible implementation manner, the first picture and the second picture correspond to different virtual camera positions.

[0096] Illustratively, the virtual camera of one picture is placed at a lower position in front of the vehicle, and the vehicle is shot upward. This perspective can highlight the appearance profile of the vehicle, making the lines of the vehicle more rugged, and the details such as the air intake grille and headlamp are enlarged to present the design features and delicate craftsmanship of the front face of the vehicle to the audience. Another picture uses a high-angle overhead position, and the virtual camera is placed at a higher position above the vehicle to shoot downward. At this time, the picture can show the overall layout of the vehicle, including the length, width ratio, roof line, and projection of the vehicle on the ground, so that the audience can intuitively understand the size and space of the vehicle, and also see the relative position relationship between the vehicle and the surrounding environment. The two pictures enrich the information dimension of the vehicle display from different angles through different virtual camera positions.

[0097] As a feasible implementation manner, the first picture and the second picture correspond to different parameters of the virtual camera.

[0098] Illustratively, the first picture uses a wide-angle virtual camera (such as a focal length of 24 mm and an aperture of f / 8) to shoot a large scene containing the environment where the vehicle is located, and the vehicle and buildings in the background are clearly visible. The second picture uses a long-focus virtual camera (such as a focal length of 85 mm and an aperture of f / 2.8) to focus on the current vehicle, and the background is naturally blurred to highlight the subject. The two virtual cameras are set with different optical parameters, which not only avoids the flicker problem when switching pictures, but also forms a complementary effect of panoramic display and local close-up.

[0099] As a feasible implementation manner, the first picture is used to present a first scene subject of the target virtual scene, and the second picture is used to present a second scene subject of the target virtual scene.

[0100] It should be understood that the core of the perspective is to simulate the natural observation of the human eye, and the human eye usually actively focuses attention on the target subject (such as naturally focusing on the object in the hand when picking up the object). At this time, placing the subject in the visual center (the center of the picture or the golden section point) conforms to the physiological habit and enhances the sense of identification. Therefore, as a feasible implementation manner, in the two pictures, the scene subject can be set in the visual center.

[0101] As a feasible implementation manner, the first scene subject and the second scene subject are different. That is, the display focuses of the two pictures are different, and then the adjustment of the two pictures is not completely synchronous, so that the picture flicker problem can be avoided.

[0102] As a feasible implementation manner, one of the first scene subject and the second scene subject is a vehicle, and the other is related to a scene background element of the target virtual scene.

[0103] Exemplarily, refer to Figure 3 When the method is applied to a vehicle, two screens (a main driver screen and a co-driver screen) in the vehicle can respectively display two pictures. The scene content of the target virtual scene can be that a vehicle model is in front of a waterfall. The first scene subject corresponding to the main driver screen is the vehicle model, and a rendering focus is on the vehicle 3D model and a dynamic state thereof (such as opening and closing of a door, rotation of a tire, and light effect). When a user zooms in or out the main driver screen through a gesture, the vehicle model on the first screen remains to be positioned at the center, and the waterfall background moves accordingly. The second screen takes the background (the waterfall) where the vehicle model is located as a visual center, and a rendering focus is on displaying dynamic details (such as water flow, fog, and light and shadow) of the waterfall.

[0104] It should be understood that the embodiments of the present application do not limit the display manner of the two pictures. As a feasible implementation manner, the two pictures can be displayed in different areas of the same screen. As another feasible implementation manner, the two pictures can be displayed through two screens. Specifically, the first picture of the target virtual scene can be displayed through a first screen, and the second picture of the target virtual scene can be displayed through a second screen.

[0105] As a feasible implementation manner, one of the first screen and the second screen is a main driver display screen of the vehicle, and the other is a co-driver display screen of the vehicle.

[0106] As a feasible implementation manner, the rotation centers corresponding to the first picture and the second picture are different.

[0107] The rotation center is a fixed point around which the visual angle rotates, and determines the position of the fulcrum when the visual angle is transformed. Exemplarily, if the rotation center is the center of the vehicle chassis, the vehicle as a whole rotates around the chassis when the visual angle rotates.

[0108] It can be understood that the rotation centers of the first picture (such as the vehicle visual angle of the main driver screen) and the second picture (such as the environment visual angle of the co-driver screen) are different, so that the rotation of the two visual angles does not interfere with each other (such as rotation of the main driver screen around the vehicle and rotation of the co-driver screen around the waterfall). Further, when performing multi-screen linkage interaction, the rotation centers are independently controlled based on the picture adjustment instruction, so as to reduce visual angle switching lag or picture abnormality caused by synchronization problems, thereby improving the smoothness of the interaction.

[0109] In some embodiments, when the first picture and the second picture are adjusted, the adjustment parameters can be determined based on the content indicated by the picture adjustment instruction, and then the first picture and the second picture are adjusted based on the adjustment parameters.

[0110] As a feasible implementation manner, refer to Figure 4 , S102 can be specifically:

[0111] S1021, determining the first adjustment parameter and the second adjustment parameter based on the instruction intention of the picture adjustment instruction.

[0112] It should be understood that the instruction intention refers to the purpose of issuing the picture adjustment instruction or the effect that is intended to be achieved. By analyzing the intention of the picture adjustment instruction (such as "switch to first person" or "rotate to the right"), the corresponding virtual camera parameters (such as position, rotation, speed, etc.) are dynamically calculated. For example, if the instruction intention is "quickly turn right", the yaw rotation speed of the camera needs to be increased; if the intention is "zoom in on the observation", the field of view (FOV) needs to be reduced and the position needs to be adjusted to be close to the target. The system needs to combine the input and scene requirements to generate smooth and expected transformation parameters in real time, and finally drive the virtual camera to complete the view switching.

[0113] Exemplarily, the picture adjustment instruction (such as voice "enlarge the vehicle chassis", gesture sliding direction) needs to be analyzed into specific parameters (such as zoom ratio, rotation angle, angular velocity of movement), for example: instruction "switch to waterfall close-up" → parameter: target position (center of waterfall), zoom ratio (enlarge by 2 times), FOV (reduce the view angle range).

[0114] When determining the first adjustment parameter and the second adjustment parameter, a configuration table or an AI model can be used to realize the mapping rule of the picture adjustment instruction to the adjustment parameter. It can be understood that the calculation of the adjustment parameters of the first picture (such as the vehicle view of the main driver screen) and the second picture (such as the environment view of the co-driver screen) does not interfere with each other, but can share part of the logic (such as synchronous zoom ratio), and the embodiments of the present application do not limit this.

[0115] As a feasible implementation manner, S1021 can be specifically implemented as:

[0116] S11, determining the first adjustment parameter based on the instruction intention indicated by the picture adjustment instruction.

[0117] Taking the user's finger sliding on the first display screen displaying the first picture as an example: the controller captures the sliding input (such as touchmove event) on the first display screen, and then determines the sliding direction (such as Δx>0 when sliding to the right) by calculating the coordinate difference (Δx, Δy) of the starting point and the ending point of the sliding. Further, the sliding direction is mapped to the view rotation intention. For example: horizontal right sliding → "rotate the view to the right"; sliding speed (Δx / Δt) → rotation speed.

[0118] S12, weighting calculation is performed on the first adjustment parameter according to a preset ratio to obtain the second adjustment parameter.

[0119] Since the two screens display different pictures, it means that the objects or the perspective characteristics (such as the rotation center and the zoom ratio) of the two screens are different. For example, the main driver screen focuses on the details of the vehicle, and the rotation center is the geometric center of the vehicle; the co-driver screen focuses on the panoramic view of the environment, and the rotation center is the center point of the scene.

[0120] When the first adjustment parameter corresponding to the first picture is determined (such as the rotation angle and the zoom ratio), the second adjustment parameter needs to be adjusted by weighted calculation, rather than directly copying the first adjustment parameter. It can be understood that the parameters of the two screens are associated (for example, when the first picture is rotated, the second picture is scaled synchronously), so that the perspective linkage can be maintained by presetting the ratio for weighted calculation, and the differentiated adaptation can also be realized to ensure that the perspective characteristics of the co-driver screen meet the functional requirements.

[0121] It should be understood that the preset ratio is a core parameter for weighted calculation, which is essentially a weight coefficient for scaling the adjustment parameter (such as the rotation angle and the zoom ratio) of the first picture by a certain ratio and applying it to the second picture, so that the second picture can follow the first picture. For example, if the rotation angle of the first picture is 30° and the preset ratio k = 0.6, then the rotation angle of the second picture is 18°.

[0122] It should be understood that the preset ratio can be determined by design rules or user preferences, and the embodiments of the present application do not limit the preset ratio. For example, the user can adjust the preset ratio in various ways to make the linkage strength of the two screens meet the user's needs, and the embodiments of the present application do not limit the preset ratio.

[0123] As a feasible implementation manner, the preset ratio is related to the virtual camera positions of the first picture and the second picture and / or the scene subject.

[0124] The adjustment ratio corresponding to the first picture and the second picture is not randomly set, but is closely related to the respective virtual camera positions and / or the scene subject. That is, the virtual camera position and the scene subject are the key elements for determining the adjustment ratio.

[0125] As an implementation manner, the preset ratio is determined based on the distance between the virtual camera position of the first picture and the scene center, and the distance between the virtual camera position of the second picture and the scene center.

[0126] In virtual scene display, different virtual camera positions correspond to different display perspectives and focuses. The distance between the virtual camera and the scene center will affect the composition, depth of field, perspective, and other effects of the picture. When the virtual camera is close to the scene center, the picture will focus more on the subject (such as the vehicle) near the scene center; when the virtual camera is far away from the scene center, the picture will present a wider scene range. According to the distance from the scene center to determine the preset ratio, the display requirements of the scene under different perspectives can be better adapted.

[0127] As another implementation manner, the preset proportion is determined based on a visible range of the first scene subject in the target virtual scene in the first picture and a visible range of the second scene subject in the target virtual scene in the second picture.

[0128] It can be understood that, since there may be a part of the visual angle range that cannot present the first / second scene subject when rotating around the scene center of the target virtual scene, in order to ensure that both pictures have corresponding scene subjects, the preset proportion needs to be determined by the visible ranges corresponding to the two scene subjects, so as to constrain the rotation range of the two pictures and avoid the scene subject from leaving the visible area due to the rotation of the visual angle.

[0129] Exemplarily, in the dual visual angle linkage adjustment of the virtual scene, when the rotation center coincides with the first scene subject (such as a vehicle) and the second scene subject (such as a waterfall) is located at the periphery, there is a natural difference between the visible ranges of the two. At this time, the preset proportion can be introduced by dynamically calculating the intersection of the visible ranges, so as to realize the differential visual angle linkage control.

[0130] As an implementation manner, the preset proportion is: the visible range corresponding to the first scene subject, the visible range corresponding to the second scene subject.

[0131] That is, the ratio of the visible ranges of the two scene subjects is taken as the preset proportion, so as to ensure that when the visual angle is adjusted, the two pictures can always continuously display the respective corresponding scene subjects when rotating or moving.

[0132] Exemplarily, when the rotation center is the first scene subject (such as a vehicle), since the rotation center is visible regardless of the rotation angle, the corresponding visible range is 360°. The second scene subject (such as a waterfall) is located behind the vehicle, and when it is rotated to a certain angle, it cannot be displayed, and the corresponding visible range is usually small (for example, 60°). In this way, the preset proportion is 60° / 360°=1 / 6.

[0133] As an implementation manner, the visible range of the scene subject in the target virtual scene is in a positive correlation with the distance between the virtual camera corresponding to the scene subject and the rotation center of the target virtual scene.

[0134] In the virtual scene, the visual range of the scene subject is directly proportional to its distance from the rotation center: when the virtual camera is far from the rotation center, the arc length covered by its field of view increases (e.g., a satellite perspective can see a larger area), and when it is close to the rotation center, the field of view narrows (e.g., a first-person perspective only sees a part). It should be understood that this positive correlation directly affects the perspective design. For example, a long-distance camera is suitable for global observation, while a close-up camera focuses on details, so in actual application, the distance can be dynamically adjusted according to the requirements to balance the field of view and the target focusing needs.

[0135] It can be seen that the scheme provided by the embodiment first determines the first adjustment parameter based on the instruction intention indicated by the screen adjustment instruction, so that the first screen is adjusted following the user operation, ensuring that the user operation target is accurately responded. Secondly, the second perspective parameter is dynamically generated by the preset ratio, which can maintain the key content of the second screen (the second scene subject is always framed within the visual range); finally, parameterized weighted calculation makes the dual-perspective transformation form an organic whole, avoiding the discomfort caused by perspective jump, and flexibly adjusting the following strength of the two screens according to the scene requirements. That is, the scheme provided by the embodiment can significantly improve the operation efficiency and visual coherence.

[0136] S1022, adjusting the first screen based on the first adjustment parameter, and adjusting the second screen based on the second adjustment parameter.

[0137] After obtaining the two adjustment parameters, the screens of the two display screens are adjusted at the same time. This dual-perspective cooperative updating mechanism ensures that the first screen and the second screen output by the two display screens always maintain spatial logical consistency during the perspective switching process, avoiding screen tearing or perspective jump, and maintaining the visual coherence between multiple screens.

[0138] It should be understood that in the embodiment, the screen adjustment instruction triggered by the user for the first display screen is taken as an example for illustration, so the first adjustment parameter needs to be determined based on the instruction intention indicated by the screen adjustment instruction, so that the switching effect of the display screen of the first display screen conforms to the user's intention. In actual application, the user can also trigger the screen adjustment instruction through the second display screen, at which time the second adjustment parameter can be determined first, and then the first adjustment parameter is determined based on the inverse ratio of the preset ratio, which is not described in detail in the embodiment.

[0139] In some embodiments, the user can freely select a wallpaper theme in the desktop setting option, including a normal wallpaper desktop, a map navigation desktop, and a 3D immersive desktop, etc. When the user selects the 3D desktop, the system will automatically enter the multi-screen linkage mode, at which time the two display screens will synchronously load and display the same virtual scene, realizing the cooperation and differentiation of the two-screen perspectives.

[0140] But in actual application, when the user selects a 3D desktop on one display screen, the other display screen can be in use, such as a video playing state. At this time, displaying the virtual scene can affect the normal use of the user.

[0141] Based on this, as a feasible implementation manner, refer to Figure 5 The first picture of the target virtual scene displayed through the first display screen and the second picture of the target virtual scene displayed through the second display screen can be specifically implemented as follows:

[0142] S1011, in response to the virtual scene display instruction, displaying a first picture of a target virtual scene indicated by the virtual scene display instruction through a first display screen.

[0143] It should be understood that the triggering condition of the virtual scene display instruction is not limited in the embodiments of the present application, and the user can trigger it in various ways such as touching the virtual scene display control, issuing a voice instruction, making a preset gesture, etc.

[0144] Upon receiving the virtual scene display instruction, the vehicle-mounted controller will respond immediately, presenting the target virtual scene specified by the instruction on the first display screen and displaying the corresponding first picture of the first picture, so as to ensure that the user can quickly and intuitively obtain the initial or specified view angle content of the virtual scene.

[0145] S1012, in the case that the second display screen is in a non-use state, displaying a second picture of the target virtual scene through the second display screen.

[0146] The non-use state is used to represent that the display screen is in a bright screen state without content updating activity, and no interaction operation is detected within a preset time period.

[0147] Exemplarily, the non-use state includes at least one of the following: standby sleep state, static information display state, screen protection state, information standby state.

[0148] When it is detected that the second display screen is in the non-use state, the vehicle-mounted controller can quickly utilize the idle resource to present the corresponding picture of the second picture of the target virtual scene on the second display screen, thereby expanding the display dimension of the virtual scene and improving the integrity and immersion of the multi-screen interaction experience.

[0149] As another feasible implementation manner, the displaying of the second picture of the target virtual scene through the second display screen in S101 can be specifically implemented as follows: in the case that the second display screen is in a use state, waiting for the second display screen to switch to a non-use state, and then displaying the second picture through the second display screen.

[0150] In the case that the second display screen is in use, it is necessary to ensure the current use task of the second display screen is not disturbed. Therefore, it continuously monitors the state of the second display screen, and only when it is detected that the second display screen enters a non-use state (such as standby, hibernate, screen saver or static information display), it is safe to switch to the display of the second picture. This design not only avoids picture conflict or operation interruption, but also utilizes the display screen resources at the right time to realize seamless content transition.

[0151] In some embodiments, when two display screens render different perspectives of the same virtual scene through the same engine. It is necessary to be rendered by the same engine to ensure frame synchronization, perspective matching and logical consistency. But the frame data rendered by the engine needs to be sent to two display screens at the same time (or in time sharing) on the basis of multi-screen communication. If the communication delay is different, it will cause the picture to be out of sync (such as one screen is fast and the other screen is slow). Therefore, it is necessary to determine whether to display different perspectives of the same virtual scene through two display screens according to whether the multi-screen communication is normal.

[0152] As a feasible implementation manner, S1012 can be specifically as follows:

[0153] S11, detecting the communication state between the first display screen and the second display screen.

[0154] It should be understood that detecting the communication state between the first display screen and the second display screen can be realized by hardware interface monitoring and data transmission verification, and the embodiments of the present application do not limit this.

[0155] Exemplarily, as an implementation manner, the communication state between the two screens can be determined by the following steps:

[0156] Firstly, it is confirmed whether the two screens are physically connected through a standard communication protocol, and the electrical signals (such as voltage, clock synchronization) of the interface are checked whether they are normal; secondly, the integrity and real-time of data transmission are verified by sending test data packets and listening to feedback signals; at the same time, the signal waveform and data content in the communication process are captured by using a protocol analysis tool to analyze whether there are error frames, retransmission mechanism triggering or protocol handshake failure problems; in addition, if the two screens support a state feedback mechanism, the communication state flag bit can be directly read to quickly locate the fault; finally, the communication state is judged whether it is normal by comprehensively considering the hardware connection state, data transmission success rate, protocol compliance and device feedback information.

[0157] S12, in the case that the communication state is a normal communication state and the second display screen is in a non-use state, displaying a second picture of a target virtual scene through the second display screen.

[0158] The communication state is a normal communication state, indicating that the connection and data interaction between the first display screen and the second display screen fully meet the expected requirements, which can be manifested as stable hardware connection between the first display screen and the second display screen, reliable data transmission, normal device feedback, and the like, and the embodiments of the application do not limit this.

[0159] In the case where the communication state is a normal communication state, it indicates that the engine can accurately send the rendered frame data to the second display screen, so that the two display screens can simultaneously display different perspectives of the same virtual scene. Therefore, in the case where the communication state is a normal communication state and the second display screen is in a non-use state, the second screen displays the second picture of the target virtual scene.

[0160] As a feasible implementation manner, S12 can be specifically: in the case where the communication state is a normal communication state and the second display screen is in a non-use state, the graphics processing unit (GPU) corresponding to the first display screen performs picture rendering on the second picture based on the target virtual scene, and sends the rendered second picture to the second display screen for display.

[0161] Since the two display screens display the content of the same virtual scene, in order to ensure frame synchronization, perspective matching and logical consistency, picture rendering needs to be performed by the graphics processing unit corresponding to one display screen. And the first display screen is the main driver display screen, which has a higher level than the copilot display screen, so the image processing unit can be integrated into the first display screen to realize picture rendering through the first display screen.

[0162] It can be understood that picture rendering through the GPU of the first display screen can ensure synchronization (frame rate, timestamp consistency) of the pictures of the two screens, avoid picture tearing or delay difference caused by scattered rendering. Moreover, scene data (such as 3D model, texture) needs to be loaded to the main GPU memory only once, which can avoid repeated storage. Finally, the second display screen does not need local rendering, and only receives the compressed video stream output by the GPU of the first display screen, which can significantly reduce the cross-screen communication bandwidth requirement.

[0163] Therefore, in the case where the communication state is a normal communication state and the second display screen is in a non-use state, the graphics processing unit corresponding to the first display screen needs to perform picture rendering on the second picture of the target virtual scene, and send the rendered second picture to the second display screen for display.

[0164] As can be seen from S11-S12, the scheme provided in this embodiment can determine the communication state between the two display screens when the two display screens display different pictures of the same virtual scene, and only display normally when the communication state is normal, thereby avoiding the problems of frame synchronization, view angle matching or logic inconsistency caused by communication delay, and thus guaranteeing the user experience.

[0165] In some embodiments, when the communication state between the two display screens is abnormal, there may be a certain communication delay or even no communication, resulting in serious functional defects or affecting the user experience in the multi-screen linkage interaction process.

[0166] As a feasible implementation manner, the scheme provided in the embodiment of the application further includes: in the case that the communication state is the abnormal communication state, displaying a static image of the target virtual scene through the second display screen, or displaying an image stored in advance in the storage unit corresponding to the second display screen through the second display screen.

[0167] It should be understood that the communication state being the abnormal communication state generally means that the data transmission between the two display screens is interrupted, delayed, erroneous or has a performance decline, resulting in that the two screens cannot normally synchronize or interact. At this time, in order to avoid affecting the user experience, a static image of the target virtual scene or an image stored in advance in the storage unit can be displayed through the second display screen.

[0168] In the case of communication abnormality, since the static content display does not depend on the real-time communication link, the scheme provided in the embodiment replaces the real-time rendering picture with a static image or pre-stored content, prevents the user from seeing a blank or error display, and reduces the sense of strangeness. Moreover, the static image and the pre-stored content are called locally, which can avoid attempting to retransmit data when the communication is abnormal, and reduce the invalid bandwidth occupation.

[0169] As an implementation manner, since the static image does not need to be continuously rendered by the GPU, the computing power of the GPU can be released for performing other tasks when the communication state is the abnormal communication state.

[0170] In some embodiments, in order to improve the immersion and interaction authenticity of the target virtual scene, the visual elements, physical parameters and interaction logic of the virtual scene can be dynamically adjusted based on real-time environmental information of the vehicle to which the display screen belongs, such as geographic location, weather condition, time data, light intensity, indoor and outdoor temperature and humidity, and dynamic scene features captured by a sensor.

[0171] Specifically, as a feasible implementation manner, referring to Figure 6 The display adjustment method provided in the embodiment of the application further includes the following steps:

[0172] S201. Determine the environment parameter of the target virtual scene based on the current time information and / or real-time weather data.

[0173] As an implementation manner, the vehicle-mounted controller can obtain the current timestamp based on the system clock, and then match the time zone through the geographic positioning data (such as GPS latitude and longitude), to determine the day-night cycle, seasonal characteristics, and special time period (such as holidays) of the real world.

[0174] As an implementation manner, the vehicle-mounted controller obtains the current weather state (sunny / rainy / snowy / foggy), temperature, humidity, wind speed, and cloud coverage through the vehicle networking API or local meteorological sensors, and derives the environment parameter (such as superimposing the raindrop density in rainy days, increasing the snow thickness in snowy days, and enabling the heat wave distortion effect in high-temperature weather) in combination with the time information.

[0175] Further, based on the association model of time-weather-environment parameter, the environment parameter of the target virtual scene is determined. For example, if it is determined based on the current time information and / or real-time weather data that it is winter and it is snowing, it can be determined that the virtual scene has 80% of snow and the sky tone is blue-gray.

[0176] S202. Update the first picture and the second picture based on the environment parameter.

[0177] After obtaining the environment parameter, the virtual scene is adjusted based on the environment parameter, so that the picture content of the first picture and the second picture changes.

[0178] For example, when the vehicle is driving in the UTC+8 area at 17:30 on December 20 in rainy and snowy weather, it is determined to be a winter dusk rainy and snowy mixed weather, and the pictures of the two display screens automatically apply the following parameters:

[0179] The sky box is switched to a gray-purple gradient, and the cloud density is 85%;

[0180] The road snow coverage is 60%, and the raindrop density is 1200 drops per square meter;

[0181] The global light color temperature is 2500K, and the ambient occlusion (AO) intensity is increased by 30%;

[0182] Switch to the "winter snow scene" theme to display the snow animation and hot drink recommendation interface.

[0183] As can be seen, the scheme provided in the embodiment can realize strong correlation between the virtual scene and the real world through the closed-loop linkage of time-weather-environment parameters, and significantly improve the immersion and scene adaptation capability of multi-screen interaction.

[0184] It should be noted that when the first picture and the second picture are adjusted, the adjustment parameters can also include the environmental parameters of the virtual scene. For example, the first picture can focus on adjusting the light angle and color saturation to highlight the details and texture of a certain scene subject in the scene; the second picture can focus on adjusting the fog density and overall brightness to create a hazy and mysterious atmosphere. In this way, after the adjustment, the two pictures not only present different visual effects compared with the initial state of the virtual scene, but also have significant visual differences between each other due to the differences in the adjustment parameters.

[0185] In an exemplary embodiment, the embodiments of the present application also provide a multi-screen linkage interactive system, please refer to Figure 7 The basic modules of the multi-screen linkage interactive system include a screen display unit 101, a 3D engine rendering unit 102, a window management unit 103, a gesture recognition unit 104, a sensor module unit 105, and a multi-modal unit 106.

[0186] The screen display unit 101 serves as the terminal output layer of human-machine interaction (HMI) and is responsible for presenting system content to the user interface. For example, the user can browse the virtual scene (such as AR navigation, digital twin interface) rendered in real time by the 3D engine through the multimedia application interface (such as the first display screen) of the unit.

[0187] The 3D engine rendering unit 102 is used to provide underlying 3D graphics rendering services to support the visual effects of multi-screen linkage. Specifically, it is used to uniformly manage the 3D display effects (such as lighting, material, and shadow) of each screen, and to realize the synchronous rendering and view switching of cross-screen 3D scenes based on the multi-screen communication protocol (such as the main driver screen and the copilot screen displaying different observation angles of the same 3D model).

[0188] The window management unit 103 is used to plan the layout and interaction priority of the multi-screen interface, especially for the HMI design of the autonomous driving scene. Specifically, it can be used to dynamically allocate screen resources (such as the main driver screen preferentially displaying navigation information and the copilot screen displaying entertainment content), and support mixed rendering of 3D interfaces and 2D controls (such as the display of a floating instrument panel and a video window).

[0189] The gesture recognition unit 104 is used to analyze user gesture input and realize natural interaction. Specifically, it can recognize basic gestures such as sliding, scaling, and rotating based on touch screen event streams (such as adjusting the size of a 3D model by double-clicking), and can support a custom gesture library (such as triggering a confirmation operation by clenching a fist and switching screen content by palm translation).

[0190] The sensor module unit 105 is used to collect environmental data and drive the dynamic changes of the 3D scene. It can include:

[0191] Environmental sensors: light intensity sensor (adjust HDR effect of 3D scene), temperature and humidity sensor (correlate weather simulation in virtual scene);

[0192] Vehicle state sensors: speed sensor (increase dynamic blur effect at high speed), acceleration sensor (trigger collision warning animation when braking sharply).

[0193] The multi-modal interaction unit 106 is used to fuse multi-source input signals (voice, gesture, gaze, etc.) to improve the naturalness of interaction. For example, when the user says "check the left blind area" and waves his hand, the camera screen can be automatically switched; or the detail level of the 3D scene can be dynamically adjusted according to the user's gaze point (e.g., high-precision rendering in the gaze area and simplified rendering in the non-gaze area).

[0194] In an exemplary embodiment, the application also provides a display adjustment device, which comprises a display module and an adjustment module. The display module is configured to display a first picture and a second picture of a target virtual scene. The adjustment module is configured to perform associated adjustment on the first picture and the second picture in response to receiving a picture adjustment instruction for the first picture. The first adjustment parameter of the first picture and the second adjustment parameter of the second picture are different relative to the initial state of a virtual camera in the target virtual scene.

[0195] In some embodiments, the first picture and the second picture correspond to different virtual camera positions.

[0196] In some embodiments, the first picture and the second picture correspond to different parameters of the virtual camera.

[0197] In some embodiments, the first picture is used to present a first scene subject of the target virtual scene, and the second picture is used to present a second scene subject of the target virtual scene.

[0198] In some embodiments, the first scene subject and the second scene subject are different.

[0199] In some embodiments, one of the first scene subject and the second scene subject is a vehicle, and the other is related to a scene background element of the target virtual scene.

[0200] In some embodiments, the first adjustment parameter comprises at least one of the following: pose parameter, optical parameter, motion parameter of the virtual camera corresponding to the first picture; and the second adjustment parameter comprises at least one of the following: pose parameter, optical parameter, motion parameter of the virtual camera corresponding to the second picture.

[0201] In some embodiments, the pose parameter comprises a rotation angle or a camera position; the optical parameter comprises a field of view angle; and the motion parameter comprises a rotation angular velocity, an angular acceleration, or a camera movement speed.

[0202] In some embodiments, the initial state of the first picture and the initial state of the second picture constitute a continuous picture.

[0203] In some embodiments, the adjusting module is specifically configured to: determine the first adjustment parameter and the second adjustment parameter based on the instruction intention of the picture adjustment instruction; adjust the first picture based on the first adjustment parameter, and adjust the second picture based on the second adjustment parameter.

[0204] In some embodiments, the adjusting module is specifically configured to: determine the first adjustment parameter based on the instruction intention of the picture adjustment instruction; and perform weighted calculation on the first adjustment parameter according to a preset ratio to obtain the second adjustment parameter.

[0205] In some embodiments, the preset ratio is related to the virtual camera positions and / or scene subjects of the first picture and the second picture.

[0206] In some embodiments, the preset ratio is determined based on the distance between the virtual camera position of the first picture and the center of the scene, and the distance between the virtual camera position of the second picture and the center of the scene.

[0207] In some embodiments, the preset ratio is determined based on the visible range of the scene subject of the first picture in the target virtual scene, and the visible range of the scene subject of the second picture in the target virtual scene.

[0208] In some embodiments, the preset ratio is the visible range of the scene subject of the first picture divided by the visible range of the scene subject of the second picture.

[0209] In some embodiments, the picture adjustment instruction is triggered by at least one of the following manners: detecting a touch operation on the first display screen; the touch operation includes at least one of the following: a sliding operation, a clicking operation, a long-pressing operation, a pinch / expand gesture operation, a rotation gesture operation; the first display screen is a display screen for displaying the first picture; detecting that a view angle switching key is triggered; receiving a voice instruction carrying a view angle switching; receiving a picture adjustment instruction sent by a remote control device; detecting a preset gesture action of a user sitting on a target seat; detecting that a first gaze point of a user sitting on a target seat on the first display screen moves to a second gaze point.

[0210] In some embodiments, the display module is specifically configured to: display the first picture of the target virtual scene through the first display screen, and display the second picture of the target virtual scene through the second display screen.

[0211] In some embodiments, the display module is specifically configured to: in response to the virtual scene display instruction, display a first picture of a target virtual scene indicated by the virtual scene display instruction on the first display screen; and display a second picture of the target virtual scene on the second display screen in a case where the second display screen is in a non-use state.

[0212] In some embodiments, the non-use state is used to represent that the display screen is in a screen-on state without content update activity, and no interaction operation is detected within a preset time period.

[0213] In some embodiments, the non-use state includes at least one of the following: a standby sleep state, a static information display state, a screen protection state, and an information standby state.

[0214] In some embodiments, the display module is specifically configured to: in a case where the second display screen is in a use state, wait until the second display screen switches to a non-use state, and then display the second picture on the second display screen.

[0215] In some embodiments, the display module is specifically configured to: detect a communication state between the first display screen and the second display screen; and in a case where the communication state is a normal communication state and the second display screen is in a non-use state, display the second picture on the second display screen.

[0216] In some embodiments, the display module is specifically configured to: in a case where the communication state is a normal communication state and the second display screen is in a non-use state, perform picture rendering on the second picture based on the target virtual scene by a graphic processing unit corresponding to the first display screen, and send the rendered second picture to the second display screen for display.

[0217] In some embodiments, the display module is further configured to: in a case where the communication state is an abnormal communication state, display a static image of the target virtual scene on the second display screen, or display an image pre-stored in a storage unit corresponding to the second display screen on the second display screen.

[0218] In some embodiments, one of the first display screen and the second display screen is a main driver display screen of a vehicle, and the other is a co-driver display screen of the vehicle.

[0219] In some embodiments, the display adjustment apparatus further includes an update module configured to: determine an environmental parameter of the target virtual scene based on current time information and / or real-time weather data; and update the first picture and the second picture based on the environmental parameter.

[0220] For specific descriptions of the above optional manners, refer to the foregoing method embodiments, which will not be described here again.

[0221] Figure 8 A structural schematic diagram of an electronic device provided by an embodiment of the present application is shown in FIG. 1.Figure 8 As shown, the electronic device 130 includes, but is not limited to, a processor 1301 and a memory 1302.

[0222] The memory 1302 is configured to store executable instructions of the processor 1301. It can be understood that the processor 1301 is configured to execute the instructions to implement the display adjustment method in the above embodiments.

[0223] The processor 1301 is a control center of the electronic device, which connects each part of the electronic device through various interfaces and lines, executes software programs and / or modules stored in the memory 1302, and calls data stored in the memory 1302, to perform various functions and process data of the electronic device, thereby overall controlling the electronic device. The processor 1301 can include one or more processing modules. Alternatively, the processor 1301 can integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communication. It can be understood that the modem processor can also not be integrated into the processor 1301.

[0224] The memory 1302 can be configured to store software programs and various data. The memory 1302 can mainly include a program storage area and a data storage area, wherein the program storage area can store operating systems, application programs (such as obtaining units, determining modules, processing units, etc.) required by at least one function module, and the like. In addition, the memory 1302 can include a high-speed random access memory, and can also include a non-volatile memory, for example, at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device.

[0225] The embodiments of the present application also provide a controller, including a processor and a memory, the processor being connected with the memory, and the memory storing computer instructions, when the computer instructions run in the controller, causing the controller to execute the method of any one of the above.

[0226] The embodiments of the present application also provide a display system, including an electronic device and a display screen; the display screen is configured to display a first picture and a second picture; and the electronic device is configured to execute the display adjustment method in the above embodiments.

[0227] In some embodiments, the display screen includes a first display screen and a second display screen, the first display screen is configured to display the first picture, and the second display screen is configured to display the second picture.

[0228] The embodiments of the present application also provide a computer readable storage medium, the computer readable storage medium storing computer execution instructions, when the computer execution instructions run on the computer, causing the computer to implement the display adjustment method in the above embodiments.

[0229] The embodiment of the present application also provides a vehicle comprising the electronic device, the display adjustment device, the display system, the computer readable storage medium or the multi-screen linkage interaction system.

[0230] In some embodiments, the embodiment of the present application also provides a computer program product comprising a computer program which, when executed by a device, causes the device to perform the method of any one of the above.

[0231] In this way, through the computer program in the computer program product, the control method can be customized according to the specific needs and operating conditions of the device, realizing personalized control method, and improving the adaptability and flexibility of device control.

[0232] In addition, the computer program product can be executed on different devices or systems, realizing cross-platform application, providing a unified control method for different types of devices, and improving the integration and interoperability of the system.

[0233] Although the present application is described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the description and drawings are to be regarded simply as illustrative of the present application as defined by the appended claims, and any and all modifications, changes, combinations, or equivalents that fall within the range of the application are intended to be embraced by the appended claims. Obviously, a person skilled in the art can make various modifications and changes to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and changes of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is intended to include these modifications and changes.

[0234] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0235] In the description of the embodiments of the present application, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0236] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A display adjustment method, characterized in that: The method comprises: Displaying the first and second images of the target virtual scene; In response to receiving a picture adjustment instruction for a first picture, associated adjustment is performed on the first picture and the second picture; wherein, relative to an initial state of a virtual camera in the target virtual scene, a first adjustment parameter of the first picture and a second adjustment parameter of the second picture are different.

2. The method according to claim 1, characterized in that The first picture and the second picture correspond to different virtual camera positions.

3. The method according to claim 1, characterized in that The parameters of the virtual cameras corresponding to the first picture and the second picture are different.

4. The method according to claim 1, wherein The first screen is used to present a first scene body of the target virtual scene, and the second screen is used to present a second scene body of the target virtual scene.

5. The method according to claim 4, characterized in that The first scene subject and the second scene subject are different.

6. The method according to claim 4 or 5, characterized in that One of the first scene subject and the second scene subject is a vehicle, and the other is related to a scene background element of the target virtual scene.

7. The method according to claim 1, characterized in that The first adjustment parameter includes at least one of the following: a posture parameter, an optical parameter, and a motion parameter of a virtual camera corresponding to the first picture; The second adjustment parameter includes at least one of the following: a posture parameter, an optical parameter, and a motion parameter of a virtual camera corresponding to the second picture.

8. The method according to claim 7, characterized in that The posture parameters include: rotation angle or camera position; the optical parameters include: field of view angle; the motion parameters include: rotation angular velocity, angular acceleration or camera movement speed.

9. The method according to claim 1, characterized in that The initial state of the first picture and the initial state of the second picture form a continuous picture.

10. The method according to claim 1, characterized in that The performing association adjustment on the first picture and the second picture includes: determining the first adjustment parameter and the second adjustment parameter based on the instruction intent of the picture adjustment instruction; The first frame is adjusted based on the first adjustment parameter, and the second frame is adjusted based on the second adjustment parameter.

11. The method according to claim 9, characterized in that The determining the first adjustment parameter and the second adjustment parameter based on the instruction intention of the picture adjustment instruction includes: determining the first adjustment parameter based on the instruction intent of the picture adjustment instruction; The first adjustment parameter is weightedly calculated according to a preset ratio to obtain the second adjustment parameter.

12. The method according to claim 11, characterized in that The preset ratio is related to the virtual camera positions and / or scene subjects of the first picture and the second picture respectively.

13. The method according to claim 12, characterized in that The preset ratio is determined based on the distance between the virtual camera position of the first picture and the center of the scene, and the distance between the virtual camera position of the second picture and the center of the scene.

14. The method according to claim 12, characterized in that The preset ratio is determined based on a visible range of the scene main body of the first picture in the target virtual scene and a visible range of the scene main body of the second picture in the target virtual scene.

15. The method according to claim 14, characterized in that The preset ratio is: the visible range corresponding to the main scene of the first picture divided by the visible range corresponding to the main scene of the second picture.

16. The method according to claim 1, wherein The screen adjustment instruction is triggered by at least one of the following methods: Detecting a touch operation on the first display screen; the touch operation includes at least one of the following: a sliding operation, a clicking operation, a long pressing operation, a pinching / expanding gesture operation, and a rotating gesture operation; The first display screen is a display screen for displaying the first image; Detect that the perspective switch button is triggered; Receive a voice command with perspective switching; Receiving a picture adjustment instruction sent by a remote control device; Detecting a preset gesture action of a user in a target seat; It is detected that the first gaze point of the user sitting in the target seat moves to the second gaze point on the first display screen.

17. The method according to claim 1, wherein The first screen and the second screen showing the target virtual scene include: A first screen image of the target virtual scene is displayed through a first display screen, and a second screen image of the target virtual scene is displayed through a second display screen.

18. The method according to claim 17, characterized in that The method of displaying the first image of the target virtual scene through the first display screen and displaying the second image of the target virtual scene through the second display screen includes: In response to a virtual scene display instruction, displaying a first image of the target virtual scene indicated by the virtual scene display instruction through the first display screen; When the second display screen is in an unused state, the second screen of the target virtual scene is displayed through the second display screen.

19. The method according to claim 18, characterized in that The non-use state is used to indicate that the display screen is in a bright screen state with no content update activity, and no interactive operation is detected within a preset time period.

20. The method according to claim 18, wherein The non-use state includes at least one of the following: a standby sleep state, a static information display state, a screen saver state, and an information standby state.

21. The method according to claim 18, wherein The displaying of the second image of the target virtual scene on the second display screen includes: When the second display screen is in use, the second screen is displayed on the second display screen after the second display screen is switched to a non-use state.

22. The method according to claim 18, wherein The method of displaying the second image of the target virtual scene through the second display screen when the second display screen is in an unused state includes: detecting a communication status between the first display screen and the second display screen; When the communication state is a normal communication state and the second display screen is in an unused state, the second screen is displayed through the second display screen.

23. The method according to claim 22, characterized in that The method of displaying the second screen on the second display screen when the communication state is a normal communication state and the second display screen is in an unused state includes: When the communication state is a normal communication state and the second display screen is in a non-use state, the graphics processing unit corresponding to the first display screen renders the second screen based on the target virtual scene and sends the rendered second screen to the second display screen for display.

24. The method according to claim 22, characterized in that The method further comprises: When the communication state is an abnormal communication state, a static image of the target virtual scene is displayed through the second display screen, or an image pre-stored in a storage unit corresponding to the second display screen is displayed through the second display screen.

25. The method according to any one of claims 17 to 24, characterized in that One of the first display screen and the second display screen is a main driver's display screen of the vehicle, and the other is a co-driver's display screen of the vehicle.

26. The method according to claim 1, wherein The method further comprises: Determining environmental parameters of the target virtual scene based on current time information and / or real-time weather data; The first screen and the second screen are updated based on the environmental parameters.

27. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the processor is connected to the memory, and the memory stores computer instructions. When the computer instructions are executed on the electronic device, the electronic device executes the method according to any one of claims 1 to 26.

28. A display system, characterized in that: It comprises an electronic device and a display screen; the display screen is used to display a first picture and a second picture; the electronic device is used to execute the method according to any one of claims 1-26.

29. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 26.

30. A vehicle, characterized in that: Includes the electronic device according to claim 27, or the display system according to claim 28, or the computer-readable storage medium according to claim 29.

31. A computer program product comprising instructions, characterized in that: When the instructions are executed on a computer, the computer performs the method according to any one of claims 1 to 26.

Images