Control method, device and storage medium of central control screen
By adjusting the acquisition angle of the rear vision sensor to match the aspect ratio of the rear image control, the problem of limited application scenarios for the rear vision sensor was solved, and the stable display of the rear image control on the central control screen and the expansion of application scenarios were achieved.
Patent Information
- Application Number
- CN202511715969.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-21
- Publication Date
- 2026-02-24
- Estimated Expiration
- 2045-11-21
AI Technical Summary
The narrow viewing angle of the rear-end vision sensor necessitates that the display controls on the central control screen be nearly square and fill the entire screen, thus limiting the application scenarios of the rear-end vision sensor.
In response to the addition command of the rear image control, the first pixel area of the first display control, including the navigation control, is determined. The acquisition angle of the rear vision sensor is adjusted according to the aspect ratio, and the adjusted video stream is acquired for rendering and display, ensuring that the acquisition angle is proportionally adapted to the UI pixel size.
This allows the rear image control to remain on the central control screen as a fixed control for an extended period, expanding the usage scenarios of the rear image without affecting the overall UI visual experience.
Smart Images

Figure CN121179977B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic digital data processing technology, and in particular to a control method, device and storage medium for a central control screen. Background Technology
[0002] Currently, the operating logic of automotive infotainment systems for displaying rear-end images involves switching to reverse gear, with the central control screen displaying either the rear-end image or a top-view view of the rear to assist the driver in reversing. However, the rear-end vision sensor in this solution is only designed for reversing scenarios, and its viewing angle is too narrow. This forces the display controls on the central control screen to be adapted to the sensor's acquisition range, requiring the rear-end image display controls to be nearly square and fill the entire screen. Consequently, the application scenarios for the rear-end vision sensor are limited. Summary of the Invention
[0003] The main purpose of this application is to provide a control method, device and storage medium for a central control screen, which aims to solve the technical problem that the display controls for the rear-view image need to be close to a square and fill the entire screen, thus limiting the application scenarios of the rear-view vision sensor.
[0004] To achieve the above objectives, this application provides a control method for a central control screen, the control method comprising:
[0005] In response to the instruction to add a rear image control, a first pixel area of a first display control is determined, the first display control including a navigation control;
[0006] Based on the first pixel area and the aspect ratio corresponding to the addition instruction, the candidate pixel area of the rear image control is rendered and displayed on the central control screen.
[0007] In response to a trigger operation targeting a candidate pixel region, the acquisition angle of the rear vision sensor is adjusted according to the aspect ratio.
[0008] The adjusted video stream from the rear-view vision sensor is acquired, and the rear-view image control is rendered and displayed in the target candidate pixel area.
[0009] In one embodiment, prior to the step of determining a first pixel area of a first display control in response to an instruction to add a rear-end image control, wherein the first display control includes a navigation control, the steps include:
[0010] In response to the control addition command, obtain the layout information of the central control screen;
[0011] Based on the layout information and the pixel size of the central control screen, determine the candidate aspect ratios;
[0012] In response to a click action based on the aspect ratio of the target candidate, an add instruction is generated.
[0013] In one embodiment, after determining the candidate aspect ratio based on the layout information and the pixel size of the central control screen, the process includes:
[0014] The sensor selection control displays the rear vision sensor, the first side rear sensor, and the second side rear sensor.
[0015] In response to the trigger operation of the target sensor in the sensor selection control, determine the sensor combination;
[0016] Update the candidate aspect ratio based on the acquisition perspective of the sensor combination.
[0017] In one embodiment, the step of determining a first pixel region of a first display control, the first display control including a navigation control, includes:
[0018] If the first display control only contains navigation controls, then obtain the pixel coordinate range of the navigation controls in the current layout of the central control screen, and determine the pixel coordinate range as the first pixel area;
[0019] If the first display control includes a navigation control and at least one other application control, the pixel occupancy area of the navigation control and each other application control is identified, the total pixel coverage area is calculated according to the layout relationship of each control, and the total pixel coverage area is determined as the first pixel area.
[0020] In one embodiment, the step of rendering and displaying the candidate pixel region of the rear image control on the central control screen according to the first pixel region and the aspect ratio corresponding to the addition instruction includes:
[0021] Identify the application type of each application control in the first display control. The application type includes core applications and non-core applications. The navigation control belongs to the core application, while the other application controls belong to non-core applications.
[0022] For controls corresponding to core applications, a minimum necessary scaling strategy is adopted, while for controls corresponding to non-core applications, an adaptive scaling strategy is adopted. The minimum necessary scaling strategy is to maintain the minimum scaling ratio that keeps the key information of the control completely displayed.
[0023] Based on the minimum necessary scaling strategy and the adaptive scaling strategy, the first pixel region is scaled to obtain the remaining layout space of the scaled first pixel region.
[0024] Based on the size of the remaining layout space and the aspect ratio corresponding to the addition instruction, plan at least one placement area for the rear image control that meets the aspect ratio requirement, determine the placement area as a candidate pixel area, and render and display it.
[0025] In one embodiment, the step of adjusting the acquisition angle of the rear-end vision sensor according to the aspect ratio in response to a triggering operation targeting a candidate pixel region includes:
[0026] In response to a trigger operation targeting a candidate pixel region, obtain the actual display aspect ratio of the candidate pixel region.
[0027] Based on the hardware parameters of the rear-view sensor, the range of the acquisition angle to be adjusted is determined. The hardware parameters include the maximum horizontal angle, the minimum horizontal angle, and the angle adjustment step size.
[0028] Based on the mapping relationship between the actual display aspect ratio and the image ratio of the rear visual sensor, the target horizontal viewing angle that satisfies the actual display aspect ratio is calculated. The image ratio mapping relationship is that for every increase of a preset ratio in the actual display aspect ratio, the target horizontal viewing angle increases by a preset angle value.
[0029] Based on the range of the acquisition view to be adjusted, determine whether the target's horizontal view is within the range of the acquisition view;
[0030] If it is within the range of the acquisition view, a view adjustment command is sent to the rear vision sensor to control the rear vision sensor to adjust the acquisition view to the target horizontal view.
[0031] If the image exceeds the range of the acquisition angle, adjust the acquisition angle of the rear vision sensor to the maximum or minimum horizontal angle.
[0032] In one embodiment, the step of adjusting the acquisition angle of the rear-end vision sensor according to the aspect ratio in response to a triggering operation targeting a candidate pixel region includes:
[0033] In response to a trigger operation targeting a candidate pixel region, obtain the pixel range of the candidate pixel region and the corresponding target aspect ratio;
[0034] Based on the selected rear-view sensor, first side rear sensor, and second side rear sensor, the initial acquisition angle, installation position parameters, and hardware distortion coefficient of each sensor are obtained respectively.
[0035] Determine the physical field of view covered by the stitched image based on the pixel range and the aspect ratio of the target.
[0036] Based on the physical field of view, calculate the field of view zones that each sensor needs to cover;
[0037] Based on the field of view partitions and target aspect ratio of each sensor, and combined with their installation position parameters, the target horizontal viewing angle of the rear vision sensor, the target horizontal viewing angle of the first side rear sensor, and the target horizontal viewing angle of the second side rear sensor are calculated respectively.
[0038] Verify that the horizontal viewing angle of each target is within the hardware adjustment range of the corresponding sensor;
[0039] If all are within range, then send viewing angle adjustment commands to the three sensors respectively, synchronously adjust to the corresponding target horizontal viewing angle, and calibrate the stitching parameters based on the feature points of the overlapping area;
[0040] If the target horizontal field of view of a sensor exceeds the hardware range, the optimization target is to use the sensor field of view in the core field of view that matches the target value. For the side and rear sensors that exceed the range, the minimum hardware field of view is used and the distortion compensation of the stitched overlapping area is optimized by algorithm.
[0041] In one embodiment, the step of acquiring the adjusted video stream from the rear-end vision sensor and rendering and displaying a rear-end image control in the target candidate pixel region includes:
[0042] The original video streams collected by the adjusted rear vision sensor, the first side rear sensor, and the second side rear sensor are acquired simultaneously, and frame synchronization processing is performed based on the timestamps of each sensor.
[0043] Based on the adjusted sensor acquisition angles and preset overlapping areas, feature points of the overlapping areas of the three video streams are matched and aligned to generate a panoramic video stream covering the rear of the vehicle and the two rear sides.
[0044] Obtain the pixel resolution, boundary coordinates, and aspect ratio of the target candidate pixel region, and calculate the adaptation ratio between the panoramic video stream and the target region. If the original aspect ratio of the panoramic video stream is consistent with the aspect ratio of the target, then scale it proportionally according to the resolution.
[0045] The stitched panoramic video stream is scaled according to the adaptation ratio to obtain adapted video frames, and the rendering position is determined based on the boundary coordinates of the target candidate pixel area.
[0046] The adapted video frame is used as the underlying image of the rear image control and is integrated with the navigation control in a hierarchical manner so that the display layer of the rear image control does not obscure the key interactive elements of the navigation control.
[0047] The rear image control is rendered and displayed within the target candidate pixel area.
[0048] In addition, to achieve the above objectives, this application also provides a control device for a central control screen, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. The computer program is configured to implement the steps of the control method for the central control screen as described above.
[0049] In addition, to achieve the above objectives, this application also provides a storage medium, which is a computer-readable storage medium, storing a program for implementing the control method of the central control screen. The program for implementing the control method of the central control screen is executed by a processor to implement the steps of the control method of the central control screen as described above.
[0050] This application provides a control method for a central control screen. In response to an addition command for a rear-view image control, the method determines a first pixel area of a first display control, including navigation controls. Based on the first pixel area and the aspect ratio corresponding to the addition command, it renders and displays candidate pixel areas of the rear-view image control on the central control screen. In response to a trigger operation targeting a candidate pixel area, it adjusts the acquisition angle of the rear-view sensor according to the aspect ratio. It then acquires the adjusted video stream from the rear-view sensor and renders and displays the rear-view image control in the target candidate pixel area. In other words, by setting the aspect ratio and using the existing display controls on the central control screen, this application adjusts the acquisition angle of the rear-view sensor to ensure that the acquisition angle is proportionally adapted to the UI pixel size of the rear-view image control. This allows the rear-view image control to remain on the central control screen as a fixed control for an extended period without affecting the overall UI visual experience, thus expanding the application scenarios of the rear-view image. Attached Figure Description
[0051] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0052] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0053] Figure 1 This is a flowchart illustrating the control method for the central control screen in Embodiment 1 of this application.
[0054] Figure 2 This is a flowchart illustrating the second embodiment of the control method for the central control screen in this application.
[0055] Figure 3 This is a flowchart illustrating the control method for the central control screen in Embodiment 3 of this application.
[0056] Figure 4 This is a schematic diagram of the embodiment of this application before the addition of the rear image control;
[0057] Figure 5 This is a schematic diagram of the vehicle rear image control added in the embodiments of this application;
[0058] Figure 6 This is a schematic diagram of the structure of the central control screen control device in the embodiments of this application.
[0059] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0060] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of this application and are not intended to limit this application.
[0061] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.
[0062] Currently, the rear-view vision sensor in related technologies is only designed for reversing scenarios. Its viewing angle is too small, which means that the UI of the display control on the central control screen needs to be adapted to the collection range of the rear-view vision sensor. Therefore, the display control of the rear image needs to be close to a square and fill the entire screen, which limits the application scenarios of the rear-view vision sensor.
[0063] The main solution of this application is as follows: In response to an addition command for a rear-view image control, a first pixel area of a first display control is determined, the first display control including a navigation control; based on the first pixel area and the aspect ratio corresponding to the addition command, a candidate pixel area of the rear-view image control is rendered and displayed on the central control screen; in response to a trigger operation targeting the candidate pixel area, the acquisition angle of the rear-view sensor is adjusted according to the aspect ratio; the adjusted video stream acquired by the rear-view sensor is obtained, and the rear-view image control is rendered and displayed on the target candidate pixel area. In other words, this application adjusts the acquisition angle of the rear-view sensor by setting the aspect ratio and the existing display controls on the central control screen, so that the acquisition angle is proportionally adapted to the UI pixel size of the rear-view image control. This allows the rear-view image control to remain on the central control screen as a fixed control for a long time without affecting the overall UI visual experience, expanding the application scenarios of the rear-view image.
[0064] It should be noted that the execution subject in this embodiment can be a control device of a central control screen, or a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or a control device of a central control screen capable of performing the above functions. This embodiment does not specifically limit it in this way. The following uses a control device of a central control screen as an example to describe this embodiment and the following embodiments.
[0065] Based on this, Embodiment 1 of this application proposes a control method for a central control screen. Please refer to... Figure 1 , Figure 1This is a flowchart illustrating an embodiment of the control method for the central control screen in this application. The control method for the central control screen includes steps S10 to S40:
[0066] Step S10: In response to the instruction to add the rear image control, determine the first pixel area of the first display control, which includes a navigation control.
[0067] The rear image control is used to display an image of the vehicle's rear, which can show a real-time view of the rear or a preset image. The add command is an instruction issued by the user or system to add a control to the interface. In this embodiment, the command objective is to add a rear image control, thereby determining the first pixel area of the first display control. The first display control is a specific one among multiple display controls in the interface, used to carry content related to a specific function. In this embodiment, it refers to the target control containing the navigation control, whose pixel area needs to be precisely determined to match the layout of the added rear image control. The first pixel area refers to the range of pixel coordinates occupied by the control in the interface, defining the control's display position and size. In this embodiment, it refers to the specific pixel boundary of the first display control on the screen; determining this boundary avoids display conflicts with the newly added rear image control. The navigation control is used to provide navigation functions, such as direction indicators and path display components, and is a core component of the first display control. When determining the first pixel area, priority should be given to ensuring that its display and function are not affected by the addition of the rear image control.
[0068] In this embodiment, upon receiving an operation command to add a rear-end image control, the system accurately locates the pixel area occupied by the first display control on the interface. This first display control includes a navigation control for implementing navigation functions. Determining the first pixel area of the first display control facilitates subsequent processing based on this first pixel area.
[0069] In a first feasible implementation, step S10 may include: receiving an instruction to add a rear-end image control; parsing the interface layout priority carried in the instruction, such as ensuring the navigation control is not obscured; locating the first display control containing the navigation control; retrieving its preset initial pixel area parameters; verifying whether the initial pixel area conflicts with the preset display area of the rear-end image control; if there is no conflict, directly determining the initial pixel area as the first pixel area; if there is a conflict, fine-tuning the initial parameters to ensure the navigation control is fully displayed before determining the final pixel area. By prioritizing the display priority of the core control, the obscuration of the navigation control is avoided.
[0070] In a second feasible implementation, step S10 may include: upon responding to an add command, starting an interface control scanning program to identify all controls containing navigation functions in the current interface, and filtering out target controls with a preset identifier as the first display control. Using screen pixel mapping technology, the actual display boundary of the first display control is captured in real time, and the pixel coordinates of its upper left and lower right corners are recorded. Combined with the sub-pixel area of the navigation control within the first display control, it is verified whether the captured boundary can completely cover the navigation control; if confirmed, the coordinate range is determined as the first pixel area. By capturing the actual display boundary in real time, it is not affected by preset parameter deviations, resulting in a more accurate pixel area.
[0071] In a third feasible implementation, step S10 may include: after receiving the add instruction, reading the interface layout configuration file stored in the system, and extracting the pixel region rules corresponding to the first display control, such as the navigation control being fixed at the bottom of the screen. Based on the current screen resolution and layout rules, calculating the specific pixel range of the first display control. Sending a pixel region verification request to the system, confirming that the calculated region is not occupied by other loaded controls and that the navigation control area does not exceed this region, and then determining this range as the first pixel region. By calculating based on the configuration file and resolution, compatibility with devices of different screen sizes and resolutions can be achieved.
[0072] The above are only three feasible implementation methods of step S10 provided in this embodiment. This embodiment does not specifically limit the specific implementation method of step S10.
[0073] Step S20: Based on the first pixel area and the aspect ratio corresponding to the addition instruction, render and display the candidate pixel area of the rear image control on the central control screen.
[0074] The aspect ratio is the ratio of the width to the height of the image or control. In this embodiment, it is a preset parameter carried by the added instruction, which specifies the proportion that the rear image control needs to be displayed in, avoiding image stretching or distortion. The central control screen, also known as the vehicle central control display screen, is an in-vehicle hardware device that integrates display, interaction, and control functions, and is usually installed on the center console of the driver's cabin. It is used not only to display navigation, rear view, and reversing image, but also to control air conditioning, audio, vehicle settings, etc. All operations related to pixel areas and control display are completed within the display range of the central control screen. The candidate pixel area is a number of pixel areas that meet the display requirements and is an alternative to the final rendering area. In this embodiment, the available display area on the central control screen is calculated by combining the first pixel area and the preset aspect ratio. The candidate pixel area must meet two core conditions: first, the aspect ratio must match the added instruction; second, it must not overlap with the first pixel area to ensure that the navigation control is displayed normally.
[0075] In this embodiment, the determined first pixel region and the aspect ratio carried by the addition instruction are obtained. Within the available display space of the central control screen, regions that meet the two conditions of matching the aspect ratio and not overlapping with the first pixel region are selected. Multiple candidate pixel regions are rendered and displayed for subsequent selection of the target region. By rendering multiple candidate pixel regions, it is possible to adapt to different user habits or different scenario requirements.
[0076] In a first feasible implementation, step S20 may include: extracting the preset aspect ratio of the rear image control from the addition instruction, parsing the boundary coordinates of the first pixel area, and determining the usable blank area on the central control screen excluding the first pixel area. According to the preset aspect ratio, traversing and calculating all proportionally compatible rectangular pixel ranges within the usable blank area, and selecting the three largest rectangular areas as preliminary candidates. Verifying whether the preliminary candidate areas conflict with the pixel areas of other fixed controls on the central control screen, such as the status bar and shortcut buttons, and eliminating conflicting areas, the remaining areas are determined as candidate pixel areas for the rear image control. By selecting the largest proportionally compatible area, the rear image control can be displayed at the largest possible size, improving the visual experience.
[0077] In a second feasible implementation, step S20 may include: Firstly, delineating a non-conflict safety zone based on the location of the first pixel region. Then, calculating the minimum fit area within the safety zone according to the aspect ratio of the added instruction, based on a proportional scaling principle, and generating multiple candidate areas of different sizes but with consistent proportions, such as large, medium, and small sizes. Simulating the display effect for each candidate area, such as previewing the stretching or compression degree of the image in that area, retaining areas with a stretching rate below a threshold, and finally determining the candidate pixel region for the rear image control. By providing multiple size candidate schemes, display requirements in different scenarios can be adapted.
[0078] Step S30: In response to the trigger operation targeting the candidate pixel region, adjust the acquisition angle of the rear vision sensor according to the aspect ratio.
[0079] The trigger operation is a user interaction or system-automated action that can initiate a specific function, serving as a signal for process progression. In this embodiment, it refers to the confirmation operation of the target candidate pixel area, such as a user clicking on a candidate area on the central control screen or the system automatically selecting the optimal candidate area. The acquisition angle is the angular range of the rear-view sensor when capturing images, determining the width of the field of view and the content coverage of the image. In this embodiment, the acquisition angle is the angle at which the sensor actually captures the rear-view scene, which needs to be adjusted according to the aspect ratio of the target candidate area. By adjusting, the image captured by the sensor can be perfectly adapted to the proportion of the target area, avoiding stretching or cropping of key information during display.
[0080] In this embodiment, when a trigger operation is performed targeting a candidate pixel region, the acquisition angle of the rear-view sensor is adjusted according to the aspect ratio of the addition instruction. Adjusting the acquisition angle according to the aspect ratio of the addition instruction ensures that the proportion of the image captured by the sensor perfectly matches the target region, preventing stretching and cropping during subsequent display and ensuring the integrity of the image information.
[0081] In a first feasible implementation, step S30 may include: real-time monitoring of interactive events on the central control screen; when a user clicks or long-presses a target candidate pixel area, immediately locking the aspect ratio parameter of that area; sending a ratio adaptation command to the rear vision sensor, carrying the preset viewing angle parameter corresponding to the aspect ratio, such as 16:9 corresponding to a 120° wide angle and 4:3 corresponding to a 90° standard angle; after receiving the command, the sensor quickly switches to the preset viewing angle and starts image acquisition, while simultaneously sending a signal to the central control screen indicating that the viewing angle adjustment is complete, ensuring that the image is rendered to the target area in real time. Based on the preset viewing angle parameter switching, no complex calculations are required, and the viewing angle adjustment can be completed quickly, with a fast response speed, making it suitable for scenarios with high real-time requirements.
[0082] In a second feasible implementation, step S30 may include: supporting two trigger operation modes: the user manually confirms the target candidate pixel area, such as by clicking a confirmation button, or the system automatically triggers based on the scenario, such as when linked by a reverse gear signal. After triggering, the actual aspect ratio of the target area is extracted. Based on this precise aspect ratio, the optimal acquisition angle is calculated through a sensor control algorithm to avoid adaptation deviations of preset parameters. The sensor is controlled to gradually fine-tune the angle, while simultaneously transmitting the acquired image back to the central control screen in real time. The deviation between the image ratio and the target area ratio is compared. When the deviation is less than a threshold, the current angle is locked and acquisition is stabilized. Calculating the optimal angle based on the aspect ratio of the target candidate pixel area can minimize image stretching or cropping and ensure the integrity of image information.
[0083] Step S40: Obtain the adjusted video stream captured by the rear vision sensor, and render and display the rear image control in the target candidate pixel area.
[0084] The video stream is a data stream composed of a large number of continuous static images, transmitted and displayed sequentially at a fixed frame rate, such as 30 frames per second, to visually create a dynamic video effect. In this embodiment, the video stream is a sequence of images of the rear of the vehicle captured in real time by the rear-view sensor after adjusting its acquisition angle. It includes continuous images of the rear environment, such as the road surface, obstacles, and vehicles behind. The video stream is transmitted to the central control screen and displayed frame by frame in the target candidate pixel area, ultimately presenting a dynamic real-time image of the rear of the vehicle.
[0085] In this embodiment, a data acquisition command is sent to the adjusted rear-end vision sensor. The sensor continuously acquires images of the rear-end scene at the target viewpoint and a preset frame rate, forming a video stream. The video stream is transmitted in real time to the central control screen host via the vehicle communication bus. The parameters of the locked target candidate pixel area are retrieved, and the specific location of the area is located in the central control screen display layer. Based on the aspect ratio of the target area, the received video stream is adapted in real time. The rear-end image control is initialized, and the adapted video stream is mapped to the control frame by frame. The control is rendered within the target candidate pixel area to achieve real-time display of the video stream, while ensuring that the control's layer is lower than the navigation control. The video stream transmission status and control display effect are continuously monitored. If frame drops, stuttering, or display offset are detected, automatic repair operations such as reconnecting the sensor and calibrating the area coordinates are triggered. When no video stream is received, a signal abnormality prompt is displayed in the target area. By adapting the video stream based on the aspect ratio of the target area, the original ratio is not changed, avoiding information loss caused by stretching or cropping, and ensuring that the details of the rear-end scene are clearly distinguishable.
[0086] In a first feasible implementation, step S40 may include: sending a real-time acquisition command to the adjusted rear-end vision sensor; the sensor acquires a video stream at a default resolution, such as 720P, 30 frames per second, and transmits it to the central control screen via the vehicle bus in low-latency mode. Parameters of the target candidate pixel region are retrieved, and the received video stream is scaled proportionally only to quickly match the region size. A lightweight rendering engine is started, mapping the adapted video stream frame by frame to the rear-end image control for direct display in the target area. The video stream transmission latency is monitored in real time; if the latency exceeds a threshold, such as 100ms, the video stream resolution is automatically reduced, such as switching to 480P, prioritizing display smoothness. Through low-latency transmission, lightweight rendering, and simplified processing, the time from acquisition to display is significantly shortened, resulting in extremely fast response speeds, suitable for scenarios with high real-time requirements, such as reversing.
[0087] In a second feasible implementation, step S40 may include: when the sensor acquires the video stream, it simultaneously records acquisition parameters, such as resolution and frame rate, and transmits it in high-definition mode, such as 1080P. During transmission, a data compression algorithm is used to reduce bandwidth usage while preserving image details. After receiving the video stream, precise cropping and proportional calibration are performed based on the aspect ratio of the target candidate pixel area and the screen resolution to remove invalid information at the edges of the image, ensuring that the core scene is fully presented in the target area. A high-definition rendering engine is enabled to optimize the image quality of the video stream, such as noise reduction and contrast enhancement. The optimized image is then rendered frame by frame to the rear image control, while ensuring that the display layer of the control does not conflict with the navigation control. The adaptation deviation between the rendered image and the target area is continuously compared. If display offset or distortion occurs, the rendering parameters are fine-tuned in real time to ensure accurate alignment between the image and the target area. By employing high-definition acquisition, compression transmission, and image quality optimization technologies, the image quality is clear, the details of the rear scene are preserved, and the visual experience and judgment accuracy are improved.
[0088] This embodiment provides a control method for a central control screen. In response to an addition command for a rear-view image control, a first pixel area of a first display control (including navigation controls) is determined. Based on the first pixel area and the aspect ratio corresponding to the addition command, candidate pixel areas of the rear-view image control are rendered and displayed on the central control screen. In response to a trigger operation targeting a candidate pixel area, the acquisition angle of the rear-view sensor is adjusted according to the aspect ratio. The adjusted video stream acquired by the rear-view sensor is obtained, and the rear-view image control is rendered and displayed in the target candidate pixel area. In other words, this application adjusts the acquisition angle of the rear-view sensor by setting the aspect ratio and the existing display controls on the central control screen, so that the acquisition angle is proportionally adapted to the UI pixel size of the rear-view image control. This allows the rear-view image control to remain on the central control screen as a fixed control for a long time without affecting the overall UI visual experience, expanding the usage scenarios of the rear-view image.
[0089] Based on Embodiment 1, in Embodiment 2 of this application, the content that is the same as or similar to that in Embodiment 1 can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 2 , Figure 2 The flowchart provided in Embodiment 2 of the control method for the central control screen of this application, in response to the addition instruction of the rear image control, determines the first pixel area of the first display control. Before the step of the first display control including the navigation control, the following steps are included:
[0090] Step S01: In response to the control addition command, obtain the layout information of the central control screen.
[0091] The layout information is a collection of hardware parameters, control distribution, and display rules for the current interface of the central control screen. Layout information includes the central control screen's basic hardware parameters, the distribution data of existing loaded controls, interface display rules and constraints, and available display resource data. The central control screen's basic hardware parameters include screen resolution, such as 1920×1080 pixels, and the pixel density corresponding to the screen's physical size, clearly defining the overall display range of the interface. It also includes the effective boundaries of the screen display area to prevent controls from being rendered in invisible areas. The distribution data of existing loaded controls includes key information for each displayed control, namely its unique identifier, pixel area, and display layer, such as navigation controls being at the top layer. It also includes the functional attributes of the controls, such as whether they are fixed controls or can be temporarily hidden; for example, navigation controls are usually fixed core controls and cannot be obscured. Interface display rules and constraints include control layout priority rules, such as core functional controls having higher priority than auxiliary functional controls, and minimum spacing requirements between controls. It also includes reserved area rules, such as the bottom of the central control screen being a quick operation area where large auxiliary controls cannot be loaded. Available display resource data includes information on blank areas on the central control screen that are not occupied by existing controls, including the pixel range, shape, and whether each blank area conforms to the display ratio of common controls.
[0092] In this embodiment, a control addition command, such as adding a rear-view image control, is used as a signal to initiate the layout information acquisition process. This process acquires core layout data for the central control screen, including the pixel area of already loaded controls, screen resolution, available blank area range, and control display hierarchy rules. It clarifies the distribution of interface resources on the central control screen, avoiding conflicts between newly added controls and existing controls, and provides data support for subsequent calculation of candidate pixel areas and adaptation of display ratios.
[0093] Step S02: Determine the candidate aspect ratio based on the layout information and the pixel size of the central control screen.
[0094] In this context, pixel size is expressed as the number of pixels horizontally multiplied by the number of pixels vertically, such as 1920×1080. Each pixel is the smallest unit of screen display. For example, a pixel size of 1920×1080 means that the screen has 1920 pixels horizontally and 1080 pixels vertically, and the total number of pixels is the product of the two.
[0095] In this embodiment, the available blank area in the layout information and the pixel size of the central control screen are first associated to clarify the maximum width and height limits of the available space. Based on the width and height range of the available space, proportions that do not obstruct core controls and adapt to the screen display logic are selected. For example, when the available space is 1600 pixels wide and 900 pixels high, common proportions such as 16:9 and 4:3 are preferentially generated. Extreme proportions that exceed hardware support, such as those that the sensor cannot adapt to or those with poor display effects, are eliminated, and finally 3-5 optimal proportions are retained as candidate aspect ratios. By making the candidate aspect ratios adapt to both the hardware capabilities of the central control screen and the interface layout constraints, the feasibility and coordination of subsequent control display are ensured from the source.
[0096] Step S03: In response to the click operation of the target candidate aspect ratio, generate an add instruction.
[0097] In this embodiment, the central control screen displays a list of candidate aspect ratios and monitors user operations in real time. When it detects that the user clicks on a candidate aspect ratio, i.e., the target aspect ratio, it triggers the instruction generation process. The user-selected target aspect ratio is used as the core parameter, combined with auxiliary information such as the central control screen identifier and operation timestamp, and encapsulated into a standardized add instruction. The integrity of the instruction parameters is verified. If successful, the instruction is sent to the central control screen control system as a trigger signal for subsequent steps. The click operation translates the user's preference for the display ratio into a specific instruction, ensuring that subsequent processes are strictly executed according to the user's selection.
[0098] In this embodiment, candidate aspect ratios are derived based on the layout information and pixel dimensions of the central control screen to ensure that the ratios not only meet the screen hardware capabilities but also avoid control conflicts, thus preventing subsequent display distortion and obstruction issues from the outset. This significantly improves the coordination between newly added controls and the original layout of the central control screen.
[0099] Based on any of the above embodiments of this application, Embodiment 3 of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, please refer to... Figure 3 , Figure 3 The flowchart provided in Embodiment 3 of the control method for the central control screen of this application, after determining the candidate aspect ratio based on the layout information and the pixel size of the central control screen, includes:
[0100] Step S021: Display the sensor selection control. The sensor selection control displays the rear vision sensor, the first side rear sensor, and the second side rear sensor.
[0101] The sensor selection control is an interactive component on the central control screen, specifically designed to display selectable in-vehicle imaging sensors. Users can manually select the sensors they wish to activate; once selected, the system will use that sensor to capture images, providing a data source for subsequent control displays. The rear-view vision sensor is typically installed at the rear of the vehicle, such as near the trunk handle or above the license plate. It's a dedicated image sensor for capturing scenes directly behind the vehicle, often a camera. It captures real-time images of the area directly behind the vehicle, corresponding to a standard reversing camera, primarily used to observe the distance between the rear of the vehicle and obstacles, as well as the road conditions behind. The first side-rear sensor is installed on the rear of one side of the vehicle, such as near the left rear door handle or on the left rear fender. It's a dedicated side-rear imaging sensor. It captures scenes behind one side of the vehicle, such as the left rear lane or obstacles, supplementing the blind spots of the rear sensor. It's commonly used in parallel parking and lane-change assist scenarios. The second side-rear sensor has the same function and type as the first, only differing in installation location. It's typically located on the rear of the other side of the vehicle, such as near the right rear door handle or on the right rear fender. It captures the scene behind the other side of the vehicle, such as the right rear lane and obstacles, and works in conjunction with the first rear side sensor to achieve full coverage of the rear view on both sides of the vehicle.
[0102] In this embodiment, after determining the candidate aspect ratios based on the layout information and the pixel size of the central control screen, a sensor selection control is displayed. This control includes a rear-view vision sensor, a first rear-side sensor, and a second rear-side sensor. The rear-view vision sensor is mandatory, while the first and second rear-side sensors are optional. By providing three types of sensors for selection, the system covers the rear of the vehicle and the rearward views on both sides, meeting the image acquisition needs of different scenarios such as reversing and parallel parking.
[0103] Step S022: In response to the trigger operation of the target sensor in the sensor selection control, determine the sensor combination.
[0104] The sensor combination is the product of the system integrating the sensors selected by the user. It can be a single sensor, such as selecting only the rear-view sensor, or a combination of multiple sensors, such as the rear-view sensor and the first side rear sensor. By combining sensors in different locations, the field of view for image acquisition is expanded, blind spots are reduced, and users are provided with a more comprehensive view of the vehicle's surroundings, thereby improving driving safety.
[0105] In this embodiment, the system continuously monitors user interaction behavior and captures user trigger operations on target sensors. It records the trigger status of each sensor, supporting single and multiple selections by the user. Based on the trigger status, it extracts the identifiers of all user-selected sensors, such as the rear-view sensor ID and the first side rear sensor ID. It verifies whether the selected sensors are in normal working condition; if a selected sensor is abnormal, a prompt is displayed and the sensor is excluded. The verified selected sensors are integrated to form a sensor combination, the combination format determined by the user's choice. Key information of the sensor combination is synchronized to subsequent modules. The currently selected combination result is displayed on the central control screen. Single and multiple sensor selections are supported, and users can customize combinations according to scenario requirements to adapt to different usage scenarios.
[0106] Step S023: Update the candidate aspect ratio based on the acquisition angle of the sensor combination.
[0107] In this embodiment, the hardware parameters of each sensor in the sensor array are retrieved, including the acquisition ratio of an individual sensor (e.g., 16:9 for a rear-view sensor) and the field of view angle (e.g., 120° horizontal for a rear-view sensor). For multi-sensor arrays, the equivalent ratio after image stitching and fusion needs to be analyzed. For single-sensor arrays, their original ratio is directly used. Based on the equivalent ratio of the combined viewpoint, ratios with high matching degrees are selected from the original candidate aspect ratios. If a special ratio is formed after multi-sensor stitching, this ratio is added to the candidate list to ensure coverage of the combined image characteristics. The candidate aspect ratio no longer relies solely on the central control screen parameters but is dynamically adjusted in conjunction with the acquisition viewpoint of the sensor array to ensure the ratio perfectly matches the actual acquired image, avoiding display distortion and loss of effective information.
[0108] In this embodiment, a dedicated adaptive ratio is provided for the different viewing characteristics of single or multi-sensor combinations, meeting the display needs of all scenarios such as reversing and parallel parking. This avoids the situation where the image of a certain type of sensor combination cannot be fully displayed due to a fixed ratio.
[0109] Based on any of the above embodiments of this application, Embodiment 4 of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, the step of determining the first pixel area of a first display control, wherein the first display control includes a navigation control, includes:
[0110] Step S11: If the first display control only contains navigation controls, then obtain the pixel coordinate range of the navigation controls in the current layout of the central control screen, and determine the pixel coordinate range as the first pixel area.
[0111] In this embodiment, the system first identifies the content contained in the first display control. After confirming that it only contains a navigation control, it retrieves the position data of the navigation control from the layout information of the central control screen to obtain its complete pixel coordinate range in the screen coordinate system. The collected pixel coordinate range of the navigation control is directly defined as the first pixel region, and the width, height, and boundary parameters of this region are recorded. By directly reusing the existing coordinate data of the navigation control, no additional calculation is required, quickly identifying the first pixel region and improving process efficiency.
[0112] Step S12: If the first display control includes a navigation control and at least one other application control, then identify the pixel occupancy area of the navigation control and each other application control, calculate the total pixel coverage area according to the layout relationship of each control, and determine the total pixel coverage area as the first pixel area.
[0113] In this embodiment, the system first scans the first display control to identify the navigation control and all other application controls within it. It retrieves the pixel area data for each control, including its boundary coordinates and width / height pixel values, analyzes the layout relationship of each control, and calculates the total pixel coverage area using the outermost boundary as the standard. The system then takes the leftmost and rightmost X-coordinates of all controls horizontally, and the top and bottom Y-coordinates of all controls vertically; the resulting rectangular area is the total pixel coverage area. This calculated total pixel coverage area is designated as the first pixel region, and its complete coordinate parameters and total width / height data are recorded. By identifying the controls contained within the first display control, the accurate total pixel coverage area is obtained based on the layout relationship of each control.
[0114] In this embodiment, by determining the controls contained in the first display control and calculating the total coverage of all controls, the non-navigation core functions are avoided from being obscured by newly added controls due to the omission of a certain application control.
[0115] Based on any of the above embodiments of this application, Embodiment 5 of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, the step of rendering and displaying the candidate pixel area of the rear image control on the central control screen according to the first pixel area and the aspect ratio corresponding to the addition instruction includes:
[0116] Step S21: Identify the application type of each application control in the first display control. The application type includes core applications and non-core applications. The navigation control belongs to the core application, while the other application controls belong to the non-core application.
[0117] The application types are categorized based on the functional importance and usage priority of the central control screen's application controls, falling into only two categories: core applications and non-core applications. This provides a basis for layout planning, clarifying which controls require priority display and which can be flexibly adjusted. Core applications directly serve driving safety and core driving needs, representing essential functions during driving. They have the highest priority, ensuring unobstructed display throughout, with relatively fixed layout positions that cannot be arbitrarily covered by other controls. Examples include navigation controls. Non-core applications are defined as auxiliary applications that enhance driving comfort and entertainment, not directly affecting driving safety. Their functions can be temporarily paused or their display positions adjusted. They have lower priority than core applications, allowing display without affecting core applications, and can be hidden or moved when necessary to adapt to the layout requirements of other functions. Examples include music playback controls and weather display controls.
[0118] In this embodiment, the system scans all application controls within the first display control, extracting the unique identifier of each control, such as control ID and function name. A control list is created to ensure no control requiring categorization is missed. A categorization determination is performed on each control; if the control identifier matches a navigation control, it is directly identified as a core application. All other application controls are uniformly identified as non-core applications, requiring no additional complex validation. By adopting the explicit rule that navigation controls are core applications and everything else is non-core, categorization is completed quickly without complex algorithms, improving process efficiency.
[0119] Step S22: Adopt the minimum necessary scaling strategy for controls corresponding to core applications, and adopt the adaptive scaling strategy for controls corresponding to non-core applications. The minimum necessary scaling strategy is the minimum scaling ratio that keeps the key information of the control completely displayed.
[0120] The minimum necessary scaling strategy is a scaling rule designed specifically for core applications. It scales only to the minimum necessary extent, with the core goal of ensuring that critical information such as navigation routes and distance indicators are displayed completely. First, the key information areas of core controls are clearly defined. During scaling, these areas are retained without compression or cropping. Only when a control's space exceeds layout limits is it scaled down to the minimum extent possible to display the critical information completely, avoiding over-scaling that could lead to blurred or missing information. The adaptive scaling strategy is a scaling rule for non-core applications. It flexibly adjusts the scaling ratio of controls based on the available display space on the central control screen to adapt to layout requirements. No fixed scaling ratio is needed; the system automatically calculates an appropriate scaling factor based on the available space, allowing for either enlarging or shrinking the overall size of the control. Scaling aims to fit the control's overall space, allowing for appropriate compression of secondary information as long as it doesn't affect basic operations.
[0121] In this embodiment, the application type classification results from the previous steps are retrieved, and controls corresponding to core applications are bound to the minimum necessary scaling strategy, while controls corresponding to non-core applications are bound to the adaptive scaling strategy. The scaling priority of core application controls is lower than the integrity of their critical information, while the scaling priority of non-core application controls follows the overall layout space requirements. By sacrificing some display space in non-critical areas, core functions are ensured to remain unaffected. The minimum necessary scaling strategy focuses on ensuring the integrity of critical information in core applications, avoiding the failure of core functions such as navigation due to scaling, thus meeting driving safety requirements.
[0122] Step S23: According to the minimum necessary scaling strategy and the adaptive scaling strategy, the first pixel region is scaled to obtain the remaining layout space of the scaled first pixel region.
[0123] In this embodiment, minimum necessary scaling is performed on core application controls, reducing them to the minimum scale that preserves key information, and the new space occupied by the core controls after scaling is recorded. Adaptive scaling is performed on non-core application controls, flexibly adjusting the scaling ratio according to the overall layout constraints, and the new space occupied by the non-core controls after scaling is recorded. It is ensured that all controls do not overlap after scaling, key information and basic operation areas remain usable, and the overall layout remains within the original first pixel area. Remaining layout space = total space of the first pixel area - space occupied by the scaled core controls - space occupied by the scaled non-core controls. Specific parameters of the remaining layout space are defined, including boundary coordinates, width and height pixel values, and shape. Redundant space is released through a differentiated scaling strategy, allowing idle resources within the first pixel area to be fully utilized, providing ample display space for newly added controls.
[0124] Step S24: Based on the size of the remaining layout space and the aspect ratio corresponding to the addition instruction, plan at least one placement area for the rear image control that meets the aspect ratio requirement, determine the placement area as a candidate pixel area, and render and display it.
[0125] In this embodiment, the core parameters of the remaining layout space are retrieved, including the width and height pixel values, boundary coordinates, and shape of the space. The aspect ratio corresponding to the addition command is extracted, and the proportional constraints of the rear image control are clarified. Based on the target aspect ratio and the remaining space size, the maximum displayable size that meets the proportional requirements is calculated. According to the principle of aspect ratio matching and not exceeding the boundary of the remaining space, the optimal width and height of the control are derived. If the remaining space can accommodate multiple proportionally compatible areas, at least one candidate area is planned. It is ensured that the area does not overlap with any scaled area of core or non-core controls, and the boundary is within the remaining layout space. The planned placement area is defined as a candidate pixel area, and its complete coordinates, width and height data, and corresponding target aspect ratio are recorded. The effect of displaying the candidate pixel area is rendered within the remaining layout space of the central control screen. The area is planned based on the actual remaining space and proportional constraints to avoid overlap with existing controls from the source and ensure layout coordination.
[0126] In this embodiment, by dividing the application type into core applications and non-core applications, and scaling them according to the minimum necessary scaling strategy and the adaptive scaling strategy respectively, the rear image control can make full use of idle space and improve the display effect while meeting the proportional requirements.
[0127] Based on any of the above embodiments of this application, Embodiment Six of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, the step of adjusting the acquisition angle of the rear visual sensor according to the aspect ratio in response to a trigger operation targeting a target candidate pixel region includes:
[0128] Step S31: In response to the triggering operation for the target candidate pixel region, obtain the actual display aspect ratio of the target candidate pixel region.
[0129] In this embodiment, the system continuously monitors user interactions with candidate pixel areas on the central control screen. When a trigger operation is detected targeting a specific candidate pixel area, that target area is locked. The system retrieves the stored data of the target candidate pixel area, extracts its actual displayed width and height pixel values, calculates the aspect ratio, and standardizes the results. The calculation is based on the actual pixel size of the user-selected area, rather than a theoretical ratio, to avoid proportional deviations caused by spatial adaptation and ensure distortion-free control rendering.
[0130] Step S32: Based on the hardware parameters of the rear-view sensor, determine the range of the acquisition angle to be adjusted. The hardware parameters include the maximum horizontal angle, the minimum horizontal angle, and the angle adjustment step size.
[0131] The maximum horizontal field of view (MPL) is the maximum horizontal field of view that the rear-view sensor can capture, representing the upper limit of the field of view adjustment. It is typically measured in degrees, such as 120°, meaning the sensor can cover a maximum of 60° to the left and right in the horizontal direction; scenes exceeding this angle cannot be captured. The minimum horizontal field of view (MPL) is the minimum horizontal field of view that the rear-view sensor can stably operate, representing the lower limit of the field of view adjustment. It is also measured in degrees, such as 60°, meaning the sensor can focus on a minimum of 30° to the left and right in the horizontal direction; angles smaller than this will result in excessive magnification, distortion, or unstable image capture. The field of view adjustment step is the fixed angular increment of the change in field of view between the maximum and minimum horizontal field of view, determining the precision of the field of view adjustment. It is measured in degrees, such as 5°, meaning the sensor's field of view can only be adjusted in 5° increments.
[0132] In this embodiment, the core hardware parameters of the rear-view sensor are retrieved, namely the maximum horizontal viewing angle, the minimum horizontal viewing angle, and the viewing angle adjustment step size. The minimum horizontal viewing angle is used as the lower limit of adjustment, and the maximum horizontal viewing angle is used as the upper limit, clearly defining the adjustment range of the sensor's viewing angle, such as 60°~120°. Simultaneously, the fixed angular increment for each adjustment is defined as 5°. Adjustment commands below the minimum viewing angle or above the maximum viewing angle are considered invalid to avoid exceeding hardware capabilities and causing image distortion or sensor damage. Defining the upper and lower limits of viewing angle adjustment based on hardware parameters avoids invalid adjustments beyond the sensor's capabilities, ensuring stable data acquisition.
[0133] Step S33: Calculate the target horizontal viewing angle that satisfies the actual display aspect ratio based on the mapping relationship between the actual display aspect ratio and the image ratio of the rear visual sensor. The image ratio mapping relationship is that for every increase of a preset ratio value in the actual display aspect ratio, the target horizontal viewing angle increases by a preset angle value.
[0134] The image aspect ratio mapping relationship is a pre-defined correspondence between the actual display aspect ratio and the horizontal viewing angle of the rear-end vision sensor. Specifically, for every pre-defined increase in the actual display aspect ratio, the target horizontal viewing angle increases by a corresponding pre-defined angle. The target horizontal viewing angle, calculated using the image aspect ratio mapping relationship, is the horizontal viewing angle that perfectly matches the sensor's captured image with the actual display aspect ratio; it is the final viewing angle value the sensor needs to adjust to. The target horizontal viewing angle is within the range of the sensor's adjustable viewing angle; if it exceeds this range, the boundary value is used.
[0135] In this embodiment, key data is retrieved, and the actual display aspect ratio, preset ratio value, preset angle value, and the sensor's reference viewing angle are calculated, with a default minimum horizontal viewing angle or a preset initial viewing angle, such as 60°. Using the reference ratio corresponding to the reference viewing angle, such as a 60° reference viewing angle corresponding to a ratio of 1.33 (i.e., 4:3), the difference between the actual display aspect ratio and the reference ratio is calculated. Ratio increment = actual display aspect ratio - reference ratio, e.g., 1.78 - 1.33 = 0.45. According to the mapping relationship, angle increment = (ratio increment ÷ preset ratio value) × preset angle value, e.g., 0.45 ÷ 0.2 × 10° = 22.5°. Target horizontal viewing angle = reference viewing angle + angle increment, e.g., 60° + 22.5° = 82.5°, thus calculating the target horizontal viewing angle. Through the correlation between ratio and angle, it is ensured that the sensor-captured image and the display area are completely consistent in proportion, avoiding stretching, black borders, or cropping.
[0136] Step S34: Based on the acquisition view range to be adjusted, determine whether the target's horizontal view is within the acquisition view range.
[0137] In this embodiment, the target horizontal viewing angle calculated in the preceding steps, such as 82.5°, is extracted. The adjustable viewing angle range of the sensor is determined, such as a minimum of 60° and a maximum of 120°. If the target horizontal viewing angle is greater than or equal to the minimum horizontal viewing angle and less than or equal to the maximum horizontal viewing angle, it is determined to be within the range. If the target horizontal viewing angle is less than the minimum horizontal viewing angle, it is determined to be below the lower limit. If the target horizontal viewing angle is greater than the maximum horizontal viewing angle, it is determined to be above the upper limit. The judgment result and key data are recorded, such as the target viewing angle being 82.5°, with a range of 60°~120°, indicating that the target horizontal viewing angle is within the range. Verification is completed only through boundary value comparison, without complex calculations, resulting in fast response speed and adaptability to real-time adjustment requirements.
[0138] Step S35: If within the range of the acquisition view, send a view adjustment command to the rear vision sensor to control the rear vision sensor to adjust the acquisition view to the target horizontal view.
[0139] In this embodiment, once it is confirmed that the target horizontal viewing angle is within the adjustment range, the command sending process is triggered. The acquisition viewpoint is adjusted to the target horizontal viewing angle. By confirming that the target horizontal viewing angle is within the range, a rapid adjustment of the horizontal viewing angle is performed.
[0140] Step S36: If the range of the acquisition angle is exceeded, adjust the acquisition angle of the rear vision sensor to the maximum or minimum horizontal angle.
[0141] In this embodiment, when it is confirmed that the target horizontal viewing angle is out of range, if the target horizontal viewing angle is lower than the minimum horizontal viewing angle, the acquisition viewing angle of the rear-view sensor is adjusted to its minimum horizontal viewing angle; if the target horizontal viewing angle is higher than the maximum horizontal viewing angle, the acquisition viewing angle of the rear-view sensor is adjusted to its maximum horizontal viewing angle. By adjusting the acquisition viewing angle of the rear-view sensor to the boundary value, the target viewing angle requirement is met to the greatest extent.
[0142] In this embodiment, the acquisition angle of the rear-view sensor is adjusted by determining the acquisition angle range and the target horizontal angle to meet the target angle requirements and ensure the image adaptation effect.
[0143] Based on any of the above embodiments of this application, Embodiment Seven of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, the step of adjusting the acquisition angle of the rear visual sensor according to the aspect ratio in response to a trigger operation targeting a target candidate pixel region includes:
[0144] Step S301: In response to the trigger operation for the target candidate pixel region, obtain the pixel range of the target candidate pixel region and the corresponding target aspect ratio.
[0145] In this embodiment, the system continuously monitors user interactions with candidate pixel areas on the central control screen. When a trigger operation is detected targeting a specific candidate pixel area, that target area is locked. The system retrieves the stored data of the target candidate pixel area, extracts its actual displayed width and height pixel values, calculates the aspect ratio, and standardizes the results. The calculation is based on the actual pixel size of the user-selected area, rather than a theoretical ratio, to avoid proportional deviations caused by spatial adaptation and ensure distortion-free control rendering.
[0146] Step S302: Based on the selected rear-view sensor, first side-rear sensor, and second side-rear sensor, obtain the initial acquisition angle, installation position parameters, and hardware distortion coefficient of each sensor.
[0147] The initial acquisition viewpoint is the default initial horizontal viewpoint of each sensor, serving as the reference value for subsequent viewpoint adjustments. Installation position parameters are the physical installation coordinates of the sensors on the vehicle body, such as the height of the rear sensor from the ground, the distance of the side rear sensors from the doors, and the installation angle, such as the horizontal tilt angle, clearly defining the spatial relationship of each sensor. Hardware distortion coefficients are the inherent distortion parameters of the sensor lenses, used for subsequent image distortion correction to avoid image distortion after stitching.
[0148] In this embodiment, based on the sensor combination results, the target sensor is identified, and the initial acquisition angle, installation position parameters, and hardware distortion coefficients of each sensor are obtained. By extracting these three types of key parameters, multiple requirements for angle adaptation, spatial positioning, and distortion correction are met.
[0149] Step S303: Determine the physical field of view covered by the stitched image based on the pixel range and the target aspect ratio.
[0150] In this embodiment, the proportional constraints of the display end are confirmed to match the spatial dimensions based on the pixel range and the target aspect ratio. The installation position parameters of the corresponding sensors are retrieved to clarify the physical location layout and overlapping areas of each sensor. Combined with the initial acquisition viewpoint, the physical field of view range acquired by each sensor individually is calculated to determine the stacking relationship of the original field of view. According to the target aspect ratio requirements, the horizontal and vertical physical angles that the stitched image needs to cover are calculated. In the horizontal direction, the fields of view of the three sensors need to be integrated to eliminate blind spots and allocate the coverage area proportionally. It is ensured that the stitched physical field of view, after rendering, can precisely fill the target pixel area without any wasted field of view or incomplete display. The field of view partitions that each sensor needs to contribute are clearly defined, providing a clear target for subsequent fine-tuning of sensor viewpoints and calibration of overlapping areas.
[0151] Step S304: Calculate the field of view zones that each sensor needs to cover based on the physical field of view range.
[0152] In this embodiment, the total horizontal field of view and the vertical field of view are extracted. The field of view is broken down according to the principle of prioritizing the horizontal direction and supplementing it with the vertical direction. In the vertical direction, each sensor is assumed to cover the area from its installation top angle. The basic field of view is allocated based on the installation position parameters. The rear vision sensor is centered, prioritizing the core area directly behind the vehicle. The first and second side rear sensors are symmetrically installed on both sides of the vehicle, allocating the side rear areas. It is ensured that the allocated field of view partitions do not exceed the adjustment range of any single sensor. If the maximum field of view of a sensor is insufficient, it is supplemented from the redundant field of view of adjacent sensors. To ensure smooth stitching, an overlap zone of 5°~10° can be set at the boundaries of the field of view of adjacent sensors to avoid stitching gaps. Field of view is allocated based on the sensor installation position and capabilities, ensuring that the partition undertaken by each sensor is within its controllable range, thus improving the stability of data acquisition.
[0153] Step S305: Based on the field of view partitions and target aspect ratio of each sensor, and combined with their installation position parameters, calculate the target horizontal viewing angle of the rear vision sensor, the target horizontal viewing angle of the first side rear sensor, and the target horizontal viewing angle of the second side rear sensor.
[0154] In this embodiment, the field of view (horizontal start angle and end angle), target aspect ratio, and installation position parameters of each sensor are retrieved. The horizontal span of the segment is calculated, i.e., the end angle of the rear sensor's field of view segment minus the start angle, such as 65° - (-65°) = 130°. Combined with target aspect ratio calibration, the span is fine-tuned to adapt to the display ratio, ensuring no image stretching. Then, the target horizontal viewing angle is determined, using the segment's horizontal span as the core and considering the centered installation position; the final target horizontal viewing angle equals the segment's horizontal span, ensuring complete coverage of the directly rear segment. The target horizontal viewing angle of the side and rear sensors is calculated, calculating the horizontal span of a single-side segment, i.e., the end angle of the side and rear sensor's field of view segment minus the start angle, such as -60° - (-125°) = 65°. Since the side and rear sensors are installed on the side of the vehicle, the viewing angle needs to be adjusted according to the installation tilt angle to ensure the segment is parallel to the side of the vehicle. For example, if the installation tilt angle is 5°, the viewing angle span is corrected to 70°. Fine-tune the span according to widescreen or standard aspect ratio requirements. The final target horizontal viewing angle equals the corrected zone span, ensuring coverage of the side and rear zones and adapting to the overall display ratio. Combining the three factors of field of view zones, aspect ratio, and installation location parameters, ensure that the viewing angle of each sensor both covers the assigned area and adapts to the overall display requirements.
[0155] Step S306: Verify whether the horizontal viewing angle of each target is within the hardware adjustment range of the corresponding sensor.
[0156] In this embodiment, the target horizontal viewing angle of each sensor is checked individually to ensure it is within its respective adjustment range. If it exceeds the adjustment range, the boundary value is used. By comparing the boundary values of the adjustment range, multi-sensor verification is quickly completed, adapting to real-time adjustment requirements.
[0157] In step S307, if all are within range, then send viewing angle adjustment commands to the three sensors respectively, synchronously adjust to the corresponding target horizontal viewing angle, and calibrate the stitching parameters based on the feature points of the overlapping area.
[0158] Among them, the feature points of the overlapping area refer to the image element points that can be clearly identified, are not easily deformed, and exist in the images of different sensors within the overlapping area of the fields of view of two adjacent sensors.
[0159] In this embodiment, if the horizontal viewing angle of each target is within the hardware adjustment range of the corresponding sensor, viewing angle adjustment commands are sent to each of the three sensors for adjustment. The real-time captured images after adjustment from each sensor are retrieved, feature points within the overlapping area are identified, and their pixel coordinates in each sensor's image are recorded. Based on cross-sensor pixel coordinate matching of feature points, core parameters such as stitching offset, rotation angle, and scaling ratio are calculated, and the stitching parameters are calibrated. This ensures that the feature points in the overlapping area are completely aligned after stitching, without ghosting or misalignment. By calibrating based on feature points in the overlapping area, the images are aligned at the pixel level, completely eliminating stitching gaps and ghosting, and improving the visual effect.
[0160] Step S308: If the target horizontal field of view of a sensor exceeds the hardware range, the sensor field of view in the core field of view area that matches the target value is used as the optimization target. For the side and rear sensors that exceed the range, their minimum hardware field of view is used and the distortion compensation of the stitched overlapping area is optimized by the algorithm.
[0161] In this embodiment, if the target horizontal viewing angle of a sensor exceeds the hardware range, the target horizontal viewing angle of the rear-view sensor is taken as the core, ensuring it completely matches the calculated value without any compromise or correction. For side and rear sensors exceeding the hardware range, their minimum hardware viewing angle is directly used. After the side and rear sensor viewing angle is corrected, distortion deviations will occur in the overlapping areas of their covered field of view and adjacent sensors, such as image stretching and angle shift. By comparing the pixel positions of feature points in the overlapping area in the images of both side sensors, distortion offset, stretching coefficient, and other indicators are calculated. Based on the distortion indicators, the image of the side and rear sensors is corrected, and the pixel coordinates of the overlapping area are adjusted to align with the feature points in the rear-view sensor image. For the edge parts of the overlapping area, a feathering algorithm can be used for smooth transition, eliminating image stitching artifacts caused by viewing angle correction and optimizing distortion compensation in the stitched overlapping area. By combining hardware boundary values and algorithm compensation, sensor hardware limitations are circumvented, and usable stitching effects can be achieved without modifying the hardware.
[0162] In this embodiment, priority is given to ensuring accurate viewing angles in the core area to meet the user's main usage needs, avoiding the impact of side and rear sensor limitations on core functions. Furthermore, it focuses on the critical aspect of overlapping areas to precisely resolve stitching issues caused by viewing angle corrections.
[0163] Based on any of the above embodiments of this application, Embodiment 8 of this application proposes a control method for a central control screen, which can be referred to the above description and will not be repeated hereafter. Based on this, the step of acquiring the adjusted video stream collected by the rear-end vision sensor and rendering and displaying the rear-end image control in the target candidate pixel area includes:
[0164] Step S41: Synchronously acquire the original video streams collected by the adjusted rear vision sensor, the first side rear sensor, and the second side rear sensor, and perform frame synchronization processing based on the timestamps of each sensor.
[0165] In this embodiment, the original video streams collected by the adjusted rear-view vision sensor, the first side-rear sensor, and the second side-rear sensor are acquired synchronously. Timestamps are extracted from the video stream frames of each sensor to ensure a consistent time base. The video frames of each sensor are sorted by timestamp to generate a continuous frame sequence index, facilitating quick retrieval of frame data at the corresponding time point. Using the frame timestamp of the rear-view vision sensor as a reference, the frames with the closest timestamps are found in the frame sequences of the first and second side-rear sensors, and these are identified as synchronized frame pairs. Based on timestamp and frame synchronization processing, it is ensured that the images from multiple sensors are acquired at the same time point, avoiding splicing misalignment caused by time differences.
[0166] Step S42: Based on the adjusted sensor acquisition angles and preset overlapping areas, the feature points of the overlapping areas of the three video streams are matched and aligned to generate a panoramic video stream covering the rear of the vehicle and the two rear sides.
[0167] In this embodiment, three original video streams after frame synchronization, the final adjusted acquisition angles of each sensor, and the preset overlapping areas are retrieved. Based on the sensor acquisition angles, the physical field of view corresponding to each video stream is determined, and the pixel coordinate range of the overlapping area in the video frame is marked, defining the target area for feature point matching. For the overlapping area of each video stream, stable feature points are extracted. Using the rear sensor video stream as a reference, the feature points of its overlapping area are matched with the feature points of the corresponding areas of the rear sensors on both sides. The aligned three video streams are stitched together according to the preset physical field of view to fill the non-overlapping areas of the panoramic image, ensuring complete coverage of the rear of the vehicle and the rear sides, generating a panoramic video stream covering the rear of the vehicle and the rear sides. Overlapping area alignment is achieved based on feature point matching, solving splicing misalignment and ghosting problems, and improving the visual experience.
[0168] Step S43: Obtain the pixel resolution, boundary coordinates and aspect ratio of the target candidate pixel region, and calculate the adaptation ratio between the panoramic video stream and the target region. If the original aspect ratio of the panoramic video stream is consistent with the aspect ratio of the target, it is scaled proportionally according to the resolution.
[0169] In this embodiment, the pixel resolution, boundary coordinates, and aspect ratio of the target candidate pixel region are obtained. The original resolution and original aspect ratio are extracted from the global video stream. It is determined whether the original aspect ratio of the panoramic video stream is equal to the target aspect ratio. If the original aspect ratio of the panoramic video stream is consistent with the target aspect ratio, it is scaled proportionally according to the resolution. Based on the actual parameters of the target region and the video stream, the scaled resolution perfectly matches the target region, resulting in accurate filling effect.
[0170] Step S44: Scale the stitched panoramic video stream according to the adaptation ratio to obtain the adapted video frame, and determine the rendering position based on the boundary coordinates of the target candidate pixel area.
[0171] Among them, the adapted video frame is a single frame of the panoramic video stream that has been scaled up and whose resolution and aspect ratio are completely matched with the target candidate pixel area.
[0172] In this embodiment, the calculated adaptation ratio is retrieved to confirm that the original aspect ratio of the panoramic video stream matches the target aspect ratio, and the stitched panoramic video stream is scaled. The stitched panoramic video stream is processed frame by frame according to the scaling factor to obtain the adapted video frame. The specific coordinates of the top-left and bottom-right corners of the target candidate pixel region are extracted. Using the boundary coordinates as a reference, the rendering range of the adapted video frame is determined, aligning the top-left corner of the video frame with the top-left corner of the target region and the bottom-right corner of the video frame with the bottom-right corner of the target region, ensuring no offset. Based on direct alignment using the boundary coordinates, it is ensured that the video frame perfectly fits the target region, with no black borders or exceeding the boundaries.
[0173] Step S45: Use the adapted video frame as the underlying image of the rear image control and integrate it with the navigation control to ensure that the display layer of the rear image control does not obscure the key interactive elements of the navigation control.
[0174] In this embodiment, the navigation control is set to high priority, while the rear image control is set to low priority, ensuring the complete display of the high-priority control. Adapted video frames are used as the underlying image and seamlessly integrated with the navigation control. This ensures that the display layer of the rear image control does not obscure the key interactive elements of the navigation control, preventing visual recognition issues caused by obscuring the navigation control. Through this layered integration, both critical navigation operations are unaffected, and the complete panoramic view of the rear of the vehicle is displayed, meeting the dual needs of driving scenarios.
[0175] Step S46: Render and display the rear image control in the target candidate pixel area.
[0176] In this embodiment, the boundary coordinates and resolution of the target candidate pixel region are retrieved to determine the precise rendering range. Parameters such as the underlying image and layer configuration of the rear image control are obtained. The rear image control is then rendered and displayed on the central control screen within the target candidate pixel region. This results in a complete panoramic view of the rear of the vehicle, with key operation areas of the navigation controls visible and interactive, and the overall interface meets the usage requirements of driving scenarios. By rendering and displaying the rear image control, a complete panoramic view of the rear of the vehicle is obtained, facilitating user operation while driving.
[0177] In this embodiment, the rear image control is rendered and displayed in the target candidate pixel area by acquiring the adjusted video stream collected by the rear vision sensor. The video stream completely covers the core field of view of the rear of the vehicle without missing any key environmental information. The video stream is the adjusted and accurate data with high environmental detail reproduction, which helps users to accurately judge distance and road conditions.
[0178] For example, to help understand the implementation flow of the central control screen control method obtained by combining this embodiment with the above embodiments, please refer to... Figure 4 and Figure 5 , Figure 4 This is a schematic diagram before the addition of the rear-end image control in this embodiment of the application. Figure 5 This is a schematic diagram of the vehicle rear image control added in the embodiments of this application, specifically:
[0179] like Figure 4 The controls already displayed on the central control screen include navigation control 100 and music control 200. When an instruction to add a rear-view image control is given, navigation control 100 and music control 200 are first identified as the primary display controls, and their first pixel areas are determined. Navigation control 100 is a core application, while music control 200 is a non-core application. Based on this pixel area and the aspect ratio corresponding to the addition instruction, a minimum necessary scaling strategy is adopted for navigation control 100, and an adaptive scaling strategy is adopted for music control 200. After scaling, the remaining layout space of the first pixel area is obtained. Based on the size of the remaining layout space and the aspect ratio corresponding to the addition instruction, at least one rear-view image control placement area that meets the aspect ratio requirement is planned as a candidate pixel area. The candidate pixel area of the rear-view image control is then rendered and displayed on the central control screen. Afterward, the acquisition angle of the vision sensor is adjusted according to the corresponding aspect ratio. The video stream acquired by the adjusted rear-end vision sensor is processed to obtain adapted video frames. These adapted video frames are then used as the underlying image of the rear-end image control and layered with the navigation control 100. This ensures that the display layer of the rear-end image control does not obscure the key interactive elements of the navigation control 100. Subsequently, the target candidate pixel area is rendered and displayed in the rear-end image control 300, resulting in an image as shown below. Figure 5 The selected area is the added rear-end image control 300. It should be noted that, as... Figure 5 The rear-end image shown has a significantly wider field of view than conventional reversing images, and does not produce excessive distortion. The rear-end vision sensor selected in this application can be installed not only at the lower bumper, but also at the top of the rear of the vehicle, or both, i.e., there are a first rear-end vision sensor and a second rear-end vision sensor. The specific angle adjustment scheme and image stitching scheme are as described in the aforementioned embodiments, and will not be repeated here.
[0180] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the control method of the control screen in this application. Any simple modifications based on this technical concept are within the protection scope of this application.
[0181] This application provides a control device for a central control screen, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the control method of the central control screen in the first embodiment described above.
[0182] The following is for reference. Figure 6 The diagram illustrates a structural schematic of a control device suitable for implementing the central control screen in the embodiments of this application. The control device for the central control screen in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablets, and in-vehicle terminals, as well as fixed terminals such as digital TVs and desktop computers. Figure 6 The control device shown in the central control screen is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0183] like Figure 6 As shown, the control device of the central control screen may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage device 1003 into the random access memory (RAM) 1004. The random access memory 1004 also stores various programs and data required for the operation of the control device of the central control screen. The processing unit 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the control device of the central control screen to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows a control device for a central control screen with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented alternatively.
[0184] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.
[0185] The control device for the central control screen provided in this application, employing the control method for the central control screen in the above embodiments, can solve the technical problem of limited application scenarios for the rear-end vision sensor. Compared with the prior art, the beneficial effects of the control device for the central control screen provided in this application are the same as those of the control device for the central control screen provided in the above embodiments, and other technical features in the control device for the central control screen are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.
[0186] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.
[0187] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0188] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, which are used to execute the control method of the central control screen in the above embodiments.
[0189] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, radio frequency (RF), or any suitable combination thereof.
[0190] The aforementioned computer-readable storage medium may be included in the control device of the central control screen; or it may exist independently and not be assembled into the control device of the central control screen.
[0191] The aforementioned computer-readable storage medium carries one or more programs. When the aforementioned one or more programs are executed by the control device of the central control screen, the control device of the central control screen causes the following to occur: in response to an instruction to add a rear image control, the control device determines a first pixel area of a first display control, the first display control including a navigation control; based on the first pixel area and the aspect ratio corresponding to the addition instruction, the control device renders and displays a candidate pixel area of the rear image control on the central control screen; in response to a trigger operation targeting a candidate pixel area, the control device adjusts the acquisition angle of the rear vision sensor according to the aspect ratio; and acquires the adjusted video stream acquired by the rear vision sensor, and renders and displays the rear image control in the target candidate pixel area.
[0192] Computer program code for performing the operations of this application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0193] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0194] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0195] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., computer programs) for executing the control method of the aforementioned central control screen, thereby solving the technical problem of limited application scenarios for rear-end vision sensors. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the control method of the central control screen provided in the above embodiments, and will not be repeated here.
[0196] This application provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the control method for the central control screen as described above.
[0197] The computer program product provided in this application can solve the problem of limited application scenarios for rear-end vision sensors. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the central control screen control method provided in the above embodiments, and will not be repeated here.
[0198] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.
Claims
1. A control method for a central control screen, characterized in that, The control method of the central control screen includes: In response to the instruction to add a rear image control, a first pixel area of a first display control is determined, the first display control including a navigation control; Identify the application type to which each application control in the first display control belongs. The application type includes core applications and non-core applications, wherein the navigation control belongs to the core application and the other application controls belong to the non-core application. The minimum necessary scaling strategy is adopted for the controls corresponding to the core applications, and the adaptive scaling strategy is adopted for the controls corresponding to the non-core applications. The minimum necessary scaling strategy is the minimum scaling ratio that keeps the key information of the control completely displayed. Based on the minimum necessary scaling strategy and the adaptive scaling strategy, the first pixel region is scaled to obtain the remaining layout space of the scaled first pixel region. Based on the size of the remaining layout space and the aspect ratio corresponding to the addition instruction, plan at least one rear image control placement area that meets the aspect ratio requirements, determine the placement area as a candidate pixel area, and render and display it. In response to a trigger operation targeting a candidate pixel region, the acquisition angle of the rear-view sensor is adjusted according to the aspect ratio. The adjusted video stream collected by the rear-end vision sensor is acquired, and the rear-end image control is rendered and displayed in the target candidate pixel area.
2. The control method for the central control screen as described in claim 1, characterized in that, Prior to the step of determining the first pixel area of the first display control in response to the addition instruction of the rear image control, wherein the first display control includes a navigation control, the steps include: In response to the control addition command, obtain the layout information of the central control screen; Based on the layout information and the pixel size of the central control screen, determine the candidate aspect ratio; In response to a click action based on the aspect ratio of the target candidate, an add instruction is generated.
3. The control method for the central control screen as described in claim 2, characterized in that, After determining the candidate aspect ratio based on the layout information and the pixel size of the central control screen, the following steps are included: The sensor selection control displays the rear vision sensor, the first side rear sensor, and the second side rear sensor. In response to the triggering operation of the target sensor in the sensor selection control, a sensor combination is determined; The candidate aspect ratio is updated based on the acquisition angle of the sensor combination.
4. The control method for the central control screen as described in claim 1, characterized in that, The step of determining the first pixel region of the first display control, wherein the first display control includes a navigation control, includes: If the first display control only contains navigation controls, then obtain the pixel coordinate range of the navigation controls in the current layout of the central control screen, and determine the pixel coordinate range as the first pixel area; If the first display control includes a navigation control and at least one other application control, then the pixel occupancy area of the navigation control and each other application control is identified, the total pixel coverage area is calculated according to the layout relationship of each control, and the total pixel coverage area is determined as the first pixel area.
5. The control method for the central control screen as described in claim 1, characterized in that, The step of adjusting the acquisition angle of the rear-view sensor according to the aspect ratio in response to a trigger operation targeting a candidate pixel region includes: In response to a trigger operation targeting a candidate pixel region, the actual display aspect ratio of the candidate pixel region is obtained; Based on the hardware parameters of the rear-view sensor, the range of the acquisition angle to be adjusted is determined. The hardware parameters include the maximum horizontal angle, the minimum horizontal angle, and the angle adjustment step size. Based on the mapping relationship between the actual display aspect ratio and the image ratio of the rear visual sensor, the target horizontal viewing angle that satisfies the actual display aspect ratio is calculated. The image ratio mapping relationship is that for every increase of a preset ratio in the actual display aspect ratio, the target horizontal viewing angle increases by a preset angle value. Based on the range of the acquisition angle to be adjusted, determine whether the target horizontal angle is within the range of the acquisition angle; If it is within the range of the acquisition view, a view adjustment command is sent to the rear vision sensor to control the rear vision sensor to adjust the acquisition view to the target horizontal view. If the image exceeds the range of the acquisition angle, adjust the acquisition angle of the rear vision sensor to the maximum or minimum horizontal angle.
6. The control method for the central control screen as described in claim 1, characterized in that, The step of adjusting the acquisition angle of the rear-view sensor according to the aspect ratio in response to a trigger operation targeting a candidate pixel region includes: In response to a trigger operation targeting a candidate pixel region, the pixel range of the candidate pixel region and the corresponding target aspect ratio are obtained; Based on the selected rear-view sensor, first side rear sensor, and second side rear sensor, the initial acquisition angle, installation position parameters, and hardware distortion coefficient of each sensor are obtained respectively. Based on the pixel range and the target aspect ratio, determine the physical field of view covered by the stitched image; Based on the physical field of view range, calculate the field of view partition to be undertaken by each sensor; Based on the field of view partitions and target aspect ratio of each sensor, and combined with their installation position parameters, the target horizontal viewing angle of the rear vision sensor, the target horizontal viewing angle of the first side rear sensor, and the target horizontal viewing angle of the second side rear sensor are calculated respectively. Verify that the horizontal viewing angle of each target is within the hardware adjustment range of the corresponding sensor; If all are within range, then send viewing angle adjustment commands to the three sensors respectively, synchronously adjust to the corresponding target horizontal viewing angle, and calibrate the stitching parameters based on the feature points of the overlapping area; If the target horizontal field of view of a sensor exceeds the hardware range, the optimization target is to use the sensor field of view in the core field of view that matches the target value. For the side and rear sensors that exceed the range, the minimum hardware field of view is used and the distortion compensation of the stitched overlapping area is optimized by algorithm.
7. The control method for the central control screen as described in claim 1, characterized in that, The step of acquiring the adjusted video stream collected by the rear-end vision sensor and rendering and displaying the rear-end image control in the target candidate pixel area includes: The original video streams collected by the adjusted rear vision sensor, the first side rear sensor, and the second side rear sensor are acquired simultaneously, and frame synchronization processing is performed based on the timestamps of each sensor. Based on the adjusted sensor acquisition angles and preset overlapping areas, feature points of the overlapping areas of the three video streams are matched and aligned to generate a panoramic video stream covering the rear of the vehicle and the two rear sides. Obtain the pixel resolution, boundary coordinates, and target aspect ratio of the target candidate pixel region, and calculate the adaptation ratio between the panoramic video stream and the target region. If the original aspect ratio of the panoramic video stream is consistent with the target aspect ratio, then scale it proportionally according to the resolution. The stitched panoramic video stream is scaled according to the adaptation ratio to obtain adapted video frames, and the rendering position is determined based on the boundary coordinates of the target candidate pixel area. The adapted video frame is used as the underlying image of the rear image control and is integrated with the navigation control in a hierarchical manner so that the display layer of the rear image control does not obscure the key interactive elements of the navigation control. The rear image control is rendered and displayed in the target candidate pixel area.
8. A control device for a central control screen, characterized in that, The control device of the central control screen includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the control method of the central control screen as described in any one of claims 1 to 7.
9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, it implements the steps of the control method of the central control screen as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Display apparatus, display method, display system, and electronic device
WO2025147819A1