A vehicle-mounted streaming rearview mirror terminal and a state-aware control method thereof

Abstract

The application relates to the technical field of vehicle-mounted display and video processing, and discloses a vehicle-mounted streaming media rearview mirror terminal and a state sensing control method thereof. The application aims to solve the problem that the existing streaming media rearview mirror terminal has a relatively fixed collection and display mode, and it is difficult to timely adjust the display focus and processing strategy in combination with the rear picture state, the vehicle running state and the terminal running state. The application collects multi-source input information, generates a rearview display state result, determines a core observation area and an auxiliary observation area, controls a rearview camera assembly to output an adjusted video, performs image processing on the adjusted video, and controls a display assembly to output the rearview display result, so that the processing load is reduced and a limited prompt is output in an abnormal state.

Description

Technical Field

[0001] This invention relates to the field of vehicle display and video processing technology, and more specifically, to a vehicle streaming media rearview mirror terminal and its status perception and control method. Background Technology

[0002] With the continuous improvement of vehicle electrification and intelligence, streaming rearview mirrors, which use cameras to capture images of the area behind the vehicle and display them in real time on an in-vehicle screen, are gradually being adopted. Compared to traditional optical rearview mirrors, streaming rearview mirrors can reduce the obstruction of rear view by occupants, vehicle structure, and external environment to a certain extent, improving the driver's convenience in obtaining rear information. In existing technologies, such terminals typically include a rearview camera, a display screen, and a processing unit for image acquisition, transmission, and display control. Their basic working principle is to acquire video from behind the vehicle and display it.

[0003] However, during actual vehicle operation, the display effect of the rear view is affected by a variety of factors, such as changes in vehicle operating status, changes in external lighting, water or dirt adhering to the lens, video transmission fluctuations, and changes in the terminal's own operating status. Existing streaming media rearview mirror terminals often employ relatively fixed acquisition and display methods when faced with these situations, making it difficult to adjust the display focus and processing strategy in a timely manner based on the current image and vehicle status, thus affecting the driver's continuous acquisition of crucial rear information. Therefore, how to promptly generate display control results adapted to the current driving needs based on the rear view status and related operating status information during the operation of the in-vehicle streaming media rearview mirror terminal, thereby improving the display effectiveness and stability of the rear view, has become a technical problem that needs to be solved in this field. Summary of the Invention

[0004] Given that the existing streaming media rearview mirror terminals have relatively fixed acquisition and display methods, making it difficult to adjust the display focus and processing strategy in a timely manner based on the rear view status, vehicle operation status, and terminal operation status, this invention provides the following technical solution to address the aforementioned technical problems: This invention provides a state perception and control method for an in-vehicle streaming media rearview mirror terminal, which includes the following steps: S1: Read the installation parameters of the rear-view camera component, the display parameters of the display component, and the control threshold, establish a unified time synchronization benchmark, collect multi-source input information, and generate the rear-view display status result; S2, determine the core observation area, auxiliary observation area and display control intention based on the rear view display status result, and control the rear view camera component to output the adjusted video according to the display control intention; S3, perform image processing on the adjusted video to obtain a reconstructed rear view, and control the display component to output the rear view display result according to the display control intention and the terminal operating status information; S4 reduces processing load in abnormal conditions and outputs a limited prompt when the rear video is interrupted, and outputs a limited prompt when the rear view remains unavailable.

[0005] As a preferred embodiment of the state perception control method for the vehicle-mounted streaming media rearview mirror terminal of the present invention, step S1 of reading the installation parameters of the rearview camera component, the display parameters of the display component, and the control threshold specifically involves: reading the installation position parameters, installation angle parameters, and lens correction parameters of the rearview camera component; reading the display area parameters and default display parameters of the display component; reading the brightness judgment threshold, strong light judgment threshold, blur judgment threshold, processing delay judgment threshold, frame rate judgment threshold, temperature judgment threshold, and power supply judgment threshold; and performing startup detection on the rearview camera component, display component, vehicle signal interface component, state perception component, and storage component.

[0006] As a preferred embodiment of the status perception and control method of the vehicle-mounted streaming media rearview mirror terminal of the present invention, wherein: the establishment of a unified time synchronization reference in step S1 specifically involves: using a unified system clock as the time reference, writing time stamps into the rear video frame, vehicle operation status information and terminal operation status information respectively, and writing the rear video frame, vehicle operation status information and terminal operation status information with the smallest time difference into the same cache unit.

[0007] As a preferred embodiment of the state perception control method for the vehicle-mounted streaming media rearview mirror terminal of the present invention, wherein: step S1, which involves collecting multi-source input information and generating a rearview display state result, specifically includes: The system collects rear video frames output from the rear-view camera component, including vehicle speed, gear position, turn signal status, braking status, wiper information, ambient light, display component temperature, power supply status, and video transmission status. It then performs image status analysis on the rear video frames and comprehensively judges the results with vehicle and terminal operating status information to generate rear-view display status results that characterize the usability of the rear-view image, preferred viewing direction, main influencing factors, and processing allowable level.

[0008] As a preferred embodiment of the state perception control method of the vehicle-mounted streaming media rearview mirror terminal of the present invention, wherein: the determination of the core observation area and the auxiliary observation area in step S2 specifically involves: determining the priority observation area based on the priority observation direction in the rearview display state result, defining the priority observation area as the core observation area, and defining the area adjacent to the core observation area and used for auxiliary observation as the auxiliary observation area.

[0009] As a preferred embodiment of the state perception control method for the vehicle-mounted streaming media rearview mirror terminal of the present invention, wherein: in step S2, generating display control intent and controlling the rearview camera component to output adjusted video specifically involves: generating display control intent based on the core observation area and the auxiliary observation area; adjusting the exposure parameters, gain parameters, and wide dynamic range parameters of the rearview camera component based on the display control intent and the rearview display state result, so that the rearview camera component outputs adjusted video corresponding to the display requirements of the core observation area.

[0010] As a preferred embodiment of the state perception control method of the vehicle-mounted streaming media rearview mirror terminal of the present invention, in step S3, the image processing of the adjusted video to obtain the reconstructed rearview image specifically involves: performing image correction and brightness adjustment on the adjusted video, dividing the adjusted video into regions based on the core observation area and the auxiliary observation area, and performing corresponding image processing on the different regions after division to obtain the reconstructed rearview image.

[0011] As a preferred embodiment of the state perception control method for the vehicle-mounted streaming media rearview mirror terminal of the present invention, in step S3, the display component is controlled to output the rearview display result according to the display control intention and the terminal operating status information. Specifically, the display layout of the reconstructed rearview image is determined according to the display control intention, and the display parameters of the display component are adjusted in combination with the terminal operating status information to output the rearview display result that is adapted to the current rearview display status result.

[0012] As a preferred embodiment of the state perception control method of the vehicle-mounted streaming media rearview mirror terminal of the present invention, step S4 specifically involves: comparing the rearview display state results within a continuous sampling period, reducing the processing load when the abnormal state continuously reaches a preset condition, controlling the display component to output a first restricted prompt when the rear video is interrupted, and controlling the display component to output a second restricted prompt when the rearview image is continuously unavailable.

[0013] The present invention also provides an in-vehicle streaming media rearview mirror terminal for executing the above-described method, comprising a rearview camera component, a display component, a main control component, a vehicle signal interface component, a status perception component, and a storage component. The main control component is connected to the rearview camera component, the display component, the vehicle signal interface component, the status perception component, and the storage component, respectively, for acquiring vehicle operating status information and terminal operating status information, reading installation parameters, display parameters, and control thresholds, and executing the status perception control method according to any one of claims 1 to 9.

[0014] The beneficial effects of this invention are as follows: it can synchronously process rear video, vehicle operation status information, and terminal operation status information; determine the core observation area and auxiliary observation area based on the rear view display status results; and coordinate the operation of the rear view camera component and display component, thereby improving the matching degree between the rear view image and the current driving needs; at the same time, it can maintain the continuous display of key rear information under conditions such as strong light, dim light, blurriness, water stains, and transmission fluctuations; and maintain the stability of terminal operation by reducing processing load and providing output limitation prompts in abnormal states. Attached Figure Description

[0015] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 Flowchart of the status perception and control method for in-vehicle streaming media rearview mirror terminal.

[0017] Figure 2 A flowchart for collecting multi-source input information and generating status results.

[0018] Figure 3 Flowchart for determining the observation area and controlling data acquisition.

[0019] Figure 4 This is a flowchart for image processing, display output, and exception handling.

[0020] Figure 5 This is a schematic diagram of the structure and data flow of an in-vehicle streaming media rearview mirror terminal. Detailed Implementation

[0021] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0022] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0023] Secondly, the term "one embodiment" or "example" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the invention. The appearance of an embodiment in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that mutually excludes other embodiments.

[0024] Example 1 Reference Figures 1-4 As one embodiment of the present invention, this embodiment provides a state perception control method for an in-vehicle streaming media rearview mirror terminal, comprising the following steps: S1. Read the installation parameters of the rear-view camera component, the display parameters of the display component, and the control threshold, establish a unified time synchronization benchmark, collect multi-source input information, and generate the rear-view display status result; The system reads the installation position parameters, installation angle parameters, and lens correction parameters of the rearview camera component; it also reads the display area parameters and default display parameters of the display component; and it reads the brightness judgment threshold, strong light judgment threshold, blur judgment threshold, processing delay judgment threshold, frame rate judgment threshold, temperature judgment threshold, and power supply judgment threshold. Finally, it performs startup detection on the rearview camera component, display component, vehicle signal interface component, status perception component, and storage component.

[0025] Using a unified system clock as the time reference, time stamps are written into the following video frames, vehicle operation status information and terminal operation status information respectively, and the following video frames, vehicle operation status information and terminal operation status information with the smallest time difference are written into the same buffer unit.

[0026] The system collects rear video frames output from the rear-view camera component, including vehicle speed, gear position, turn signal status, braking status, wiper information, ambient light, display component temperature, power supply status, and video transmission status. It then performs image status analysis on the rear video frames and integrates the analysis results with vehicle and terminal operating status information to generate rear-view display status results that characterize the usability of the rear-view image, preferred viewing direction, main influencing factors, and processing allowable level.

[0027] After the vehicle is powered on, the main control component first reads the installation height, left and right installation positions, pitch angle, lens field of view and lens correction parameters of the rearview camera component from the storage component, then reads the display area size, initial display position, initial brightness, initial contrast and default screen layout of the display component, and finally reads the brightness judgment threshold, strong light judgment threshold, blur judgment threshold, processing delay judgment threshold, frame rate judgment threshold, temperature judgment threshold and power supply judgment threshold.

[0028] In this embodiment, the main control component sets the sampling period to 33 milliseconds, the processing delay judgment threshold to 120 milliseconds, the frame rate judgment threshold to 20 frames per second, and the display component temperature judgment threshold to 75 degrees Celsius. Brightness judgment thresholds, strong light judgment thresholds, and blur judgment thresholds are pre-written into the storage component. After reading the above parameters, the main control component sequentially checks whether the rear-view camera component can continuously output a video stream, whether the display component can light up normally and refresh stably, whether the vehicle signal interface component can receive vehicle speed, gear, turn signal, braking, and wiper signals, whether the status perception component can output ambient light, temperature, power supply status, and video transmission status, and whether the storage component can complete read and write operations. If the rear-view camera component cannot output a video stream normally, the main control component controls the display component to output a startup abnormality prompt and stop subsequent processing; if the display component cannot work normally, the main control component records the display fault and sends an abnormal status; if the vehicle signal interface component, status perception component, or storage component is abnormal, the main control component enters a restricted working mode, retaining only the processes that can continue to be executed.

[0029] After completing the startup detection, the main control component establishes a unified time synchronization reference and begins collecting multi-source input information. This multi-source input information includes rear video frames output from the rearview camera component, vehicle operating status information output from the vehicle signal interface component, and terminal operating status information output from the status perception component. Vehicle operating status information includes vehicle speed, gear position, turn signal status, braking status, and wiper status. Terminal operating status information includes ambient light information, display component temperature information, power supply status, and video transmission status. Within each sampling period, the main control component records the timestamps for the rear video frames, vehicle operating status information, and terminal operating status information, and records the target time of the current sampling period as... Record the video frame timestamps as The vehicle operating status information is timestamped as The terminal's running status information is timestamped as And calculate the combined time difference of the current data combination: in, , , A preset weighting coefficient greater than 0 is used. In this embodiment, the real-time requirements of video frames are higher than those of vehicle status and terminal status, therefore... Value greater than and The main control component selects within each sampling period. The smallest set of rear video frames, vehicle operation status information, and terminal operation status information are processed as common source data and written into the same cache unit for subsequent judgment and retrieval.

[0030] The main control component generates the rear view display status result after obtaining the same source processing data. Specifically, it first analyzes the current rear video frame, then comprehensively judges the analysis results along with vehicle and terminal operating status information. The analysis includes calculating the proportion of low-brightness areas, calculating the proportion of high-brightness areas, detecting the continuity of image edges, detecting the clarity of vehicle outlines and road boundaries, detecting persistent blurring in local areas, detecting stains, watermarks, or obstructions at fixed locations, and detecting abnormal jumps between consecutive frames.

[0031] The main control component records the width of the current frame image as... Record the height of the current frame image as The brightness value at the coordinate position is recorded as And calculate the proportion of low-brightness pixels respectively. and high brightness pixel ratio : Among them, when When the brightness is less than the threshold for judgment, Select 1 if the value is 1, otherwise select 0; when When the light intensity exceeds the threshold for judging strong light, Select 1 if the value is 1, otherwise select 0. The main control component calculates the value in each sampling period. and The calculation results are then combined with the results from the previous two sampling periods to determine continuity.

[0032] When the gear is in reverse, and When the percentage is greater than 40% for three consecutive sampling periods, the main control component determines that the current image is in a dark and limited state; when the vehicle is in normal driving condition, and When the brightness is greater than 15% for three consecutive sampling periods, and the highlighted area covers the outline of the main target behind it, the main control component determines that the current image is in a strong light-limited state. When a fixed blurry area exists for three consecutive sampling periods and the outline of a vehicle or road boundary cannot be stably distinguished, the main control component determines that the current image is in a blur-limited state. When there is obvious stuttering in video transmission or the frame rate is continuously lower than 20 frames per second, the main control component determines that the current image is in a transmission-limited state. When the display component temperature is continuously higher than 75 degrees Celsius, the main control component determines that the current image is in a temperature-limited state.

[0033] The main control component generates the rearview display status result based on the above comprehensive judgment. The rearview display status result includes the image availability level, main influencing factors, preferred viewing direction, and processing allowable level.

[0034] The usability level of the image is divided into normal, limited, and unusable; the main influencing factors include darkness, strong light, blurriness, water stains, power fluctuations, temperature rise, and transmission abnormalities; the preferred viewing direction is used to characterize the observation position that should be prioritized in the current rear view; the processing allowance level is divided into three levels: high, medium, and low. S2. Determine the core observation area, auxiliary observation area, and display control intent based on the rear view display status results, and control the rear view camera component to output the adjusted video according to the display control intent; The priority observation area is determined based on the priority observation direction in the rearview display status result. The priority observation area is then designated as the core observation area, and the area adjacent to the core observation area and used for auxiliary observation is designated as the auxiliary observation area.

[0035] The display control intent is generated based on the core observation area and the auxiliary observation area. The exposure parameters, gain parameters and wide dynamic range parameters of the rear-view camera component are adjusted according to the display control intent and the rear-view display status results, so that the rear-view camera component outputs an adjusted video that corresponds to the display requirements of the core observation area.

[0036] After receiving the rearview display status result, the main control component first determines the core observation area. The determination process is executed in the order of prioritizing vehicle operating status and correcting for affected positions on the screen.

[0037] The main control unit first reads the gear position. If the gear is in reverse, the area near the rear of the vehicle is used as the initial core observation area. If the gear is not in reverse, the turn signal position is read. If the left turn signal is active, the area behind the left side is used as the initial core observation area. If the right turn signal is active, the area behind the right side is used as the initial core observation area. If the turn signal is inactive, the area in the middle of the rear of the vehicle is used as the initial core observation area.

[0038] After the initial core observation area is determined, the main control component reads the main influencing factors and affected locations in the rear view display status results. If strong light, blur, water marks, or obstructions are located outside the initial core observation area, the initial core observation area remains unchanged. If strong light, blur, water marks, or obstructions enter the initial core observation area, the proportion of the affected local area in the core observation area is reduced while keeping the observation direction unchanged.

[0039] Once the core observation area is determined, the main control component expands it by a preset width to form an auxiliary observation area. The auxiliary observation area and the core observation area together constitute the display organization basis of the current background image.

[0040] Subsequently, the main control component generates display control intent. Display control intent includes acquisition control content, area processing content, display layout content, and anomaly retention content. Acquisition control content instructs the rear-view camera component to prioritize improving visibility in dark areas, suppressing strong light effects, or maintaining parameter stability. Area processing content instructs the processing intensity for the core and auxiliary observation areas. Display layout content instructs the position and proportion of the core and auxiliary observation areas within the display component. Anomaly retention content instructs which portion of the image should be retained during system download.

[0041] The main control component controls the rear-view camera component to output adjusted video according to the displayed control intent. When the rear-view display indicates that the current state is dark and limited, and the priority observation direction is the close area of ​​the rear of the vehicle, the main control component gradually increases the exposure time and increases the gain until the boundary and contour of the core observation area meet the observation requirements. When the rear-view display indicates that the current state is bright and limited, the main control component shortens the exposure time and activates wide dynamic range processing to prevent the bright area from spreading further to the surrounding area. When the wipers are continuously active and there are fixed spots in the image, the main control component limits the variation of exposure and gain parameters between two adjacent sampling periods to keep the overall image brightness stable. After completing the acquisition parameter adjustment, the rear-view camera component outputs the adjusted video and sends it to the next process.

[0042] S3. Perform image processing on the adjusted video to obtain the reconstructed rear view, and control the display component to output the rear view display result according to the display control intention and terminal operating status information; The adjusted video is then subjected to image correction and brightness adjustment. Based on the core observation area and auxiliary observation area, the adjusted video is divided into regions, and corresponding image processing is performed on the different regions to obtain the reconstructed rear view.

[0043] The display layout of the reconstructed rear view is determined according to the display control intent, and the display parameters of the display components are adjusted in combination with the terminal operating status information to output a rear view display result that is adapted to the current rear view display status result.

[0044] Upon receiving the adjusted video, the main control component first performs image correction, followed by brightness adjustment. Image correction utilizes lens correction parameters stored in the component to correct lens edge stretching and image warping. Brightness adjustment, based on the current ambient light and rear-view display status, controls the entire image within a suitable brightness range for observation. After completing basic processing, the main control component divides the adjusted video into a core display section and an auxiliary display section according to the core observation area and auxiliary observation area.

[0045] For the core display portion, the main control component prioritizes sharpness enhancement, edge preservation, and local brightness adjustment to ensure stable display of the outlines, boundaries, and positional changes of key targets in the background. For the auxiliary display portion, the main control component only performs basic correction and basic brightness preservation, reducing non-critical processing. If the main control component detects dirt, water stains, fixed blur, or localized strong light diffusion in a certain local area, it first determines whether the local area is within the core display portion. If it is not within the core display portion, it reduces the display proportion of the local area in the final display image and places it in a position that does not obstruct the driver's primary line of sight. If it is within the core display portion, it maintains the overall position of the core display portion and only weakens the affected local area to avoid significant fluctuations in the entire image. After completing the above processing, the main control component obtains the reconstructed rear view image.

[0046] The main control component then controls the display component to output the rearview display result based on the display control intent and terminal operating status information. The control process is executed in the order of display layout, brightness adjustment, intensity adjustment, and refresh adjustment. The main control component first places the core display part in the main observation position slightly above the center of the display component, and then arranges the auxiliary display parts around the core display part; then, it adjusts the display brightness according to the ambient light, increasing the brightness when the ambient light is strong and decreasing the brightness when the ambient light is weak; next, it adjusts the display intensity according to the display component temperature, prioritizing the continuous output of the core display part when the temperature is close to the threshold, and reducing the display intensity of the auxiliary display parts; finally, it adjusts the refresh rate according to the video transmission status, prioritizing the continuous refresh of the core display part and reducing the amount of change in the auxiliary display parts when the video transmission is unstable. After completing the above control, the display component outputs the rearview display result.

[0047] S4. Reduce processing load under abnormal conditions, and output a limited prompt when the rear video is interrupted, and output a limited prompt when the rear view is continuously unavailable; The system compares the results of the rear view display status within a continuous sampling period. When the abnormal status continues to reach the preset conditions, the processing load is reduced. When the rear video is interrupted, the system controls the display component to output a first restricted prompt. When the rear view is continuously unavailable, the system controls the display component to output a second restricted prompt.

[0048] After the display component outputs the rearview display result, the main control component continues to detect the current processing latency, current frame rate, and current terminal load, and compares the rearview display status results over multiple consecutive sampling periods. The main control component only performs exception handling when the same abnormal state continuously reaches a preset condition. In this embodiment, the preset condition is that the same abnormal state is maintained for three consecutive sampling periods.

[0049] When the processing delay is greater than 120 milliseconds for a continuous period, the main control component determines that the delay is abnormal; when the frame rate is lower than 20 frames per second for a continuous period, the main control component determines that the frame rate is abnormal; when the voltage deviates from the rated value by more than 10% and remains so for three consecutive sampling cycles, the main control component determines that the power supply is abnormal; when the display component temperature is higher than 75 degrees Celsius for a continuous period, the main control component determines that the temperature rise is abnormal; when no valid rear video is received for three consecutive sampling cycles, the main control component determines that the rear video is interrupted; when the rear view display status result is unavailable for three consecutive sampling cycles, the main control component determines that the rear view image is continuously unavailable.

[0050] Once the main control component confirms that an abnormal state has been established, it reduces the processing load in a fixed sequence.

[0051] The first step is to stop the enhancement processing of the auxiliary display section; The second step is to reduce the refresh rate of the auxiliary display section; The third step is to reduce the display proportion of the auxiliary display components within the display components; The fourth step involves compressing image processing content other than the core display portion. Throughout the unloading process, the main control component prioritizes maintaining a continuous and stable output from the core display portion. If the rear video is interrupted, the main control component immediately controls the display component to output a first restricted warning; if the rear view remains unavailable, the main control component controls the display component to output a second restricted warning. The first restricted warning indicates that the video source has been interrupted, and the second restricted warning indicates that the current rear view cannot be used as a basis for complete observation. After completing the anomaly handling, the main control component continues to receive multi-source input information in the next sampling cycle and performs corresponding display control processing based on the updated data.

[0052] Example 2 Reference Figure 5This is the second embodiment of the present invention. This embodiment provides an in-vehicle streaming media rearview mirror terminal, which is usually installed at the front of the driver's cabin of a vehicle and is used to perform the method steps in embodiment 1.

[0053] The in-vehicle streaming rearview mirror terminal includes a rearview camera component, a display component, a main control component, a vehicle signal interface component, a status perception component, and a storage component. These components work together to complete back-end video acquisition, multi-source input information processing, rearview display output, and restricted prompts in abnormal states.

[0054] In this embodiment, the rear-view camera assembly is installed inside the rear housing of the vehicle, with the lens facing directly behind the vehicle. It continuously captures video footage from behind the vehicle and outputs it to the main control assembly. The rear-view camera assembly includes a camera body, a lens assembly, and a video output circuit. The lens assembly's mounting height, mounting angle, lens field of view, and lens correction parameters are written to a storage component during vehicle calibration, so that the main control assembly can call upon these parameters to perform image correction and area positioning during subsequent processing.

[0055] The display component is installed in front of the driver's rearview mirror and receives and displays the rearview display results output by the main control component. The display component includes a display screen, a backlight unit, and a display driver circuit. The display driver circuit is connected to the main control component and receives image data to drive the display screen to refresh. The backlight unit is connected to the main control component and adjusts the display brightness according to the control signals output by the main control component.

[0056] The vehicle signal interface component connects to the vehicle communication bus to acquire vehicle operating status information and output it to the main control component. This information includes vehicle speed, gear position, turn signal status, braking status, and windshield wiper status. The main control component uses this information to determine the vehicle's current operating status and the focus of its observation. The status perception component connects to the main control component to acquire terminal operating status information and output it to the main control component.

[0057] The terminal's operating status information includes ambient light information, display component temperature information, power supply status information, and video transmission status information. The main control component determines the current display conditions, terminal load, and video link status based on this information. The storage component, connected to the main control component, stores installation parameters, display parameters, and control thresholds. Display parameters include display area parameters, default display parameters, and default screen layout parameters. Control thresholds include brightness judgment thresholds, strong light judgment thresholds, blur judgment thresholds, processing latency judgment thresholds, frame rate judgment thresholds, temperature judgment thresholds, and power supply judgment thresholds.

[0058] After the vehicle starts, the main control component first reads the installation parameters, display parameters, and control thresholds from the storage component, and then sequentially performs startup checks on the rearview camera component, display component, vehicle signal interface component, status perception component, and storage component. After startup checks are completed, the main control component establishes a unified time synchronization reference and continuously receives rear video output from the rearview camera component, vehicle operating status information output from the vehicle signal interface component, and terminal operating status information output from the status perception component. It then uses the rear video, vehicle operating status information, and terminal operating status information as multi-source input information for subsequent processing.

[0059] During operation, the main control component performs time alignment on multi-source input information within each sampling cycle and generates a rearview display status result based on the time-aligned information. The rearview display status result includes the rearview image availability level, main influencing factors, preferred observation direction, and processing allowable level. After generating the rearview display status result, the main control component further determines the core observation area and auxiliary observation area, and generates a display control intent. The display control intent is used to determine the adjustment method of the rearview camera component's acquisition parameters, the area processing method of the rearview image, the image layout method of the display component, and the priority retention area under abnormal conditions.

[0060] Subsequently, the main control component controls the operation of the rear-view camera component according to the displayed control intent. When the rear-view display status indicates that the current image is too dark, the main control component adjusts the exposure and gain parameters of the rear-view camera component; when the rear-view display status indicates that there is significant strong light in the current image, the main control component adjusts the exposure parameters of the rear-view camera component and enables wide dynamic range processing; when the rear-view display status indicates that there are fixed spots in the current image and the wiper information remains active, the main control component limits the range of change in the exposure and gain parameters. After the above adjustments, the rear-view camera component outputs the adjusted video.

[0061] After receiving the adjusted video, the main control component performs image correction and brightness adjustment, and divides the adjusted video into regions based on the core observation area and the auxiliary observation area. The main control component prioritizes processing the portion of the image corresponding to the core observation area, performs basic processing on the portion corresponding to the auxiliary observation area, and reduces the display area of ​​localized areas with dirt, watermarks, partial blurring, or strong light diffusion. After completing the above processing, the main control component generates the reconstructed rearview image.

[0062] The main control component controls the display component to output the rearview display result based on the display control intent and terminal operating status information. Specifically, the main control component arranges the portion of the screen corresponding to the core observation area at the main observation position, arranges the portion of the screen corresponding to the auxiliary observation area at adjacent positions, adjusts the display brightness according to ambient light information, adjusts the display intensity according to the display component temperature information, and adjusts the refresh stability according to the video transmission status information. The display component outputs the rearview display result under the control of the main control component.

[0063] During continuous operation, the main control component continues to monitor processing latency, frame rate, and terminal load. When processing latency increases, frame rate decreases, power supply becomes abnormal, display component temperature rises, rear video is interrupted, or the rear view remains unavailable, the main control component executes exception handling. Exception handling proceeds in a preset order: the main control component first stops auxiliary area enhancement processing, then reduces the refresh rate of the auxiliary area, then reduces the display area's proportion, and finally compresses other processing content outside the core observation area. Throughout the exception handling process, the main control component prioritizes maintaining a continuous and stable output to the core observation area. If the rear video is interrupted, the main control component controls the display component to output a first limited-access warning; if the rear view remains unavailable, the main control component controls the display component to output a second limited-access warning.

[0064] Through the above structural connections and working coordination, the vehicle-mounted streaming media rearview mirror terminal can synchronously process multi-source input information, generate rearview display status results, and complete rearview image acquisition control, image processing, display control, and anomaly handling based on the rearview display status results.

[0065] In summary, it can synchronously process rear video, vehicle operation status information, and terminal operation status information, determine the core observation area and auxiliary observation area based on the rear view display status results, and coordinate the operation of the rear view camera component and display component to improve the matching degree between the rear view image and the current driving needs. At the same time, it can maintain the continuous display of key rear information under conditions such as strong light, dim light, blurriness, water stains, and transmission fluctuations, and maintain the stability of terminal operation by reducing processing load and output limitation prompts in abnormal conditions.

[0066] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A state perception and control method for an in-vehicle streaming media rearview mirror terminal, characterized in that, Includes the following steps: S1: Read the installation parameters of the rear-view camera component, the display parameters of the display component, and the control threshold, establish a unified time synchronization benchmark, collect multi-source input information, and generate the rear-view display status result; S2, determine the core observation area, auxiliary observation area and display control intention based on the rear view display status result, and control the rear view camera component to output the adjusted video according to the display control intention; S3, perform image processing on the adjusted video to obtain a reconstructed rear view, and control the display component to output the rear view display result according to the display control intention and the terminal operating status information; S4 reduces processing load in abnormal conditions and outputs a limited prompt when the rear video is interrupted, and outputs a limited prompt when the rear view remains unavailable.

2. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 1, characterized in that, In step S1, reading the installation parameters of the rear-view camera component, the display parameters of the display component, and the control threshold specifically involves: The system reads the installation position parameters, installation angle parameters, and lens correction parameters of the rearview camera component; it also reads the display area parameters and default display parameters of the display component; and it reads the brightness judgment threshold, strong light judgment threshold, blur judgment threshold, processing delay judgment threshold, frame rate judgment threshold, temperature judgment threshold, and power supply judgment threshold. Finally, it performs startup detection on the rearview camera component, display component, vehicle signal interface component, status perception component, and storage component.

3. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 2, characterized in that, The establishment of a unified time synchronization reference in step S1 specifically involves: Using a unified system clock as the time reference, time stamps are written into the following video frames, vehicle operation status information and terminal operation status information respectively, and the following video frames, vehicle operation status information and terminal operation status information with the smallest time difference are written into the same buffer unit.

4. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 3, characterized in that, The step S1, which involves collecting multi-source input information and generating a rear-view display status result, specifically includes: The system collects rear video frames output from the rear-view camera component, including vehicle speed, gear position, turn signal status, braking status, wiper information, ambient light, display component temperature, power supply status, and video transmission status. It then performs image status analysis on the rear video frames and comprehensively judges the results with vehicle and terminal operating status information to generate rear-view display status results that characterize the usability of the rear-view image, preferred viewing direction, main influencing factors, and processing allowable level.

5. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 1, characterized in that, In step S2, determining the core observation area and the auxiliary observation area specifically involves: The priority observation area is determined based on the priority observation direction in the rearview display status result. The priority observation area is then defined as the core observation area, and the area adjacent to the core observation area and used for auxiliary observation is defined as the auxiliary observation area.

6. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 5, characterized in that, In step S2, generating the display control intent and controlling the rear-view camera component to output the adjusted video specifically involves: Based on the core observation area and the auxiliary observation area, a display control intention is generated. Based on the display control intention and the rear view display status result, the exposure parameters, gain parameters and wide dynamic range parameters of the rear view camera component are adjusted so that the rear view camera component outputs an adjusted video that corresponds to the display requirements of the core observation area.

7. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 1, characterized in that, In step S3, image processing is performed on the adjusted video to obtain a reconstructed rear-view image, specifically as follows: The adjusted video is subjected to image correction and brightness adjustment. The adjusted video is divided into regions based on the core observation area and the auxiliary observation area. Corresponding image processing is performed on the different regions after division to obtain the reconstructed rear view.

8. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 7, characterized in that, In step S3, the display component is controlled to output the rearview display result according to the display control intent and the terminal operating status information. Specifically: The display layout of the reconstructed rear view is determined according to the display control intent, and the display parameters of the display components are adjusted in combination with the terminal operating status information to output a rear view display result that is adapted to the current rear view display status result.

9. The state perception and control method for an in-vehicle streaming media rearview mirror terminal according to claim 1, characterized in that, Step S4 specifically involves: The system compares the results of the rear view display status within a continuous sampling period. When the abnormal status continues to reach the preset conditions, the processing load is reduced. When the rear video is interrupted, the system controls the display component to output a first restricted prompt. When the rear view is continuously unavailable, the system controls the display component to output a second restricted prompt.

10. A vehicle-mounted streaming media rearview mirror terminal, characterized in that, The device includes a rearview camera component, a display component, a main control component, a vehicle signal interface component, a status perception component, and a storage component. The main control component is connected to the rearview camera component, the display component, the vehicle signal interface component, the status perception component, and the storage component, respectively, and is used to acquire vehicle operating status information and terminal operating status information, read installation parameters, display parameters, and control thresholds, and execute the status perception control method according to any one of claims 1 to 9.

Images