Control method, device and equipment of streaming rearview mirror and storage medium

Abstract

The application relates to the technical field of automobiles and provides a control method, device and equipment of a streaming media rearview mirror and a storage medium. The method comprises the following steps: determining a target scene in which a target vehicle is located; according to the target scene, controlling the streaming media rearview mirror to be adjusted to a target visual field position and controlling the streaming media rearview mirror to be adjusted to a target display mode corresponding to the target scene; wherein the target display mode comprises a physical rearview mirror display mode or a streaming media display mode. The application solves the problem that a rearview mirror cannot be applied to various environments.

Description

Technical Field

[0001] This application relates to the field of automotive technology, and in particular to a control method, device, equipment, and storage medium for a streaming media rearview mirror. Background Technology

[0002] Traditional rearview mirrors in vehicles are small, and most vehicles also have relatively small rear windshields. To obtain a complete view of the rear windshield, users need to manually and precisely adjust the rearview mirror. Furthermore, if the user's body posture changes while driving, the mirror position must be readjusted. Since user body movements are often very frequent, this leads to frequent rearview mirror adjustments, affecting driving safety. To address this issue, with the development of intelligent technology, streaming rearview mirrors have been proposed. These utilize a rearview camera to transmit images of the scene behind the vehicle onto the rearview mirror's display screen, thus providing a view of the rear of the vehicle.

[0003] However, since streaming rearview mirrors need to receive and display the transmitted images, there may be image delay issues. Furthermore, due to slight body movements and display frame rate issues, users may experience dizziness when viewing the images. Both image delay and dizziness can affect driving safety.

[0004] It is evident that the use of streaming media rearview mirrors in related technologies poses a risk to driving safety. Summary of the Invention

[0005] In view of this, embodiments of this application provide a control method, device, equipment, and storage medium for a streaming media rearview mirror to solve the problem that the use of streaming media rearview mirrors affects driving safety in related technologies.

[0006] A first aspect of this application provides a method for controlling a streaming media rearview mirror, including:

[0007] Determine the target scenario in which the target vehicle is located;

[0008] Based on the target scene, control the streaming media rearview mirror to adjust to the target field of view position, and control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene;

[0009] The target display modes include physical rearview mirror display mode or streaming media display mode.

[0010] A second aspect of this application provides a control device for a streaming media rearview mirror, comprising:

[0011] The determination module is used to determine the target scene in which the target vehicle is located;

[0012] The control module is used to control the streaming media rearview mirror to adjust to the target field of view position according to the target scene information, and to control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene;

[0013] The target display modes include physical rearview mirror display mode or streaming media display mode.

[0014] A third aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the above-described method.

[0015] A fourth aspect of this application provides a readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described method.

[0016] The beneficial effects of the embodiments of this application include at least the following:

[0017] By determining the target scenario of the target vehicle, and based on the scenario, controlling the streaming rearview mirror to adjust to the target field of view position, and controlling the streaming rearview mirror to adjust to the target display mode corresponding to the target scenario; wherein the target display mode includes physical rearview mirror display mode or streaming display mode. This achieves the determination of the streaming rearview mirror's field of view position and the determination of whether the display mode is physical rearview mirror display mode or streaming display mode based on the scenario, thereby realizing the adjustment and switching of the streaming rearview mirror's display mode in different scenarios. This ensures that the adjusted display mode meets the needs of the content displayed by the streaming rearview mirror in the corresponding scenario, avoiding the situation where the streaming rearview mirror is always in streaming display mode in different scenarios, thus preventing driver dizziness, enhancing driving safety, and solving the problem of the use of streaming rearview mirrors affecting driving safety in related technologies. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a flowchart illustrating the control method for a streaming media rearview mirror provided in an embodiment of this application;

[0020] Figure 2 This is a schematic diagram of the interaction between devices involved in the streaming media rearview mirror control process provided in the embodiments of this application;

[0021] Figure 3 This is a schematic diagram of the control device for the streaming media rearview mirror provided in an embodiment of this application;

[0022] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0023] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0024] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0025] Furthermore, it should be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0026] The control method and apparatus for the streaming media rearview mirror in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0027] Figure 1 This is a flowchart illustrating the control method for a streaming media rearview mirror provided in this application embodiment. The executing entity of this method can be a controller or processor of the streaming media rearview mirror on the target vehicle; this embodiment uses a controller as an example for explanation.

[0028] like Figure 1 As shown, the control method for this streaming media rearview mirror includes the following steps:

[0029] Step 101: Determine the target scene where the target vehicle is located.

[0030] Specifically, the target vehicle can be a vehicle equipped with a streaming rearview mirror, which is installed inside the vehicle and allows the driver to see the rear windshield through the physical display function of the streaming rearview mirror; in addition, the streaming rearview mirror can also serve as a display screen to show the images captured by the vehicle's camera.

[0031] The target scenario can be any scenario that the target vehicle experiences while driving, including but not limited to scenarios where children or pets in the target vehicle need to be monitored, scenarios where there is a blind spot in the rear windshield, scenarios where there is no blind spot in the rear windshield, rainy weather scenarios, and unsafe scenarios behind the vehicle.

[0032] Step 102: Based on the target scene, control the streaming media rearview mirror to adjust to the target field of view position, and control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene.

[0033] Specifically, the target field of view position refers to the position in the target scene where the streaming rearview mirror can reflect and display the target field of view.

[0034] The streaming media rearview mirror supports rotation, tilt, and left / right electric adjustment via three sets of motors, allowing the viewing position of the streaming media rearview mirror to be adjusted to any position.

[0035] The streaming rearview mirror is adjusted to the target field of view position according to the target scene, so that the driver can see the target field of view that meets the target scene through the streaming rearview mirror, thus satisfying the user's needs for the target field of view.

[0036] In addition, the target display modes include streaming media display mode and physical rearview mirror display mode. Streaming media display mode refers to displaying the content captured by the camera through the streaming media rearview mirror, while physical rearview mirror display mode refers to displaying the optically reflected image content through the reflection function of the streaming media rearview mirror.

[0037] By controlling the streaming rearview mirror to adjust to either the physical rearview mirror display mode or the streaming media display mode corresponding to the target scene, the adjusted display mode can meet the needs of the scene. This avoids the situation where the streaming rearview mirror is in streaming media display mode in different scenes, thereby avoiding dizziness caused by users watching video content for a long time and the problem of video stuttering, thus improving driving safety.

[0038] According to the technical solution provided in the embodiments of this application, by controlling the streaming media rearview mirror to adjust to the target field of view position according to the target scene, and controlling the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene, the display mode of the streaming media rearview mirror is adjusted and switched in different scenes. This allows the adjusted display mode to meet the needs of the content displayed by the streaming media rearview mirror in the corresponding scene, avoiding the situation where the streaming media rearview mirror is in streaming media display mode in different scenes. This satisfies the user's visual needs for the displayed content, enhances driving safety, and solves the problem of the use of streaming media rearview mirrors affecting driving safety in related technologies.

[0039] In some embodiments, determining the target scenario in which the target vehicle is located includes at least one of the following:

[0040] Firstly, if a child or pet is detected in the non-passenger seat of the target vehicle, the target scenario is determined to be a scenario where monitoring of the child or pet is required.

[0041] The non-passenger seat of the target vehicle can refer to the rear passenger seat of the target vehicle.

[0042] Specifically, in this embodiment, a gravity sensor can be used to identify whether a user or object has entered the vehicle in the non-passenger seat. When a user or object is detected, the Occupancy Monitoring System (OMS) is activated. When there is no user or object in the rear seat, the OMS system is in a low-power state.

[0043] The target vehicle can be detected by the OMS system to see if there are children or pets in the non-passenger seat. If children or pets are detected in the non-passenger seat, the target scenario can be determined as one where monitoring of children or pets is required.

[0044] Secondly: If the rear windshield view of the streaming media rearview mirror is detected to be obstructed by an object, then the target scene is determined to be a scene where there is a blind spot in the rear windshield view.

[0045] Specifically, this embodiment can use the OMS system to identify whether there is an object (item or person) in the rear seat or trunk of the target vehicle that obstructs the rear windshield view. When it is detected that the rear windshield view of the streaming rearview mirror is obstructed by an object, the driver cannot see the complete rear windshield view from the streaming rearview mirror, which means that there is a blind spot in the rear windshield view. At this time, the target scene can be determined to be a scene where there is a blind spot in the rear windshield view.

[0046] Thirdly: If the rear windshield view of the streaming media rearview mirror is not obstructed by any object, then the target scene is determined to be a scene where there is no blind spot in the rear windshield view.

[0047] When the rear windshield view of the streaming rearview mirror is not obstructed by any object, the driver can see the complete rear windshield view through the streaming rearview mirror. This means that there is no blind spot in the rear windshield view, and the target scene can be determined to be a scene where there is no blind spot in the rear windshield view.

[0048] Fourth: If the current weather is detected to be rainy, then the target scene is determined to be a rainy scene.

[0049] Specifically, in this embodiment, a rain sensor can be used to detect whether the current weather is rainy. If rainy weather is detected, the target scene can be determined to be a rainy scene.

[0050] Fifth: If a dangerous factor is detected behind the target vehicle, the target scenario is determined to be an unsafe scenario behind the vehicle.

[0051] Specifically, risk factors may include the risk of collision between a vehicle behind and the target vehicle, or the risk of collision between a pedestrian behind and the target vehicle.

[0052] This embodiment can detect whether there are dangerous factors behind the target vehicle through the sensors of the Advanced Driving Assistance System (ADAS). When a dangerous factor is detected behind the target vehicle, it can be determined that there is a safety hazard to the target vehicle. At this time, the target scenario can be determined as an unsafe scenario behind the vehicle.

[0053] It should be noted that by using gravity sensors, OMS systems, ADAS systems, and rain sensors to jointly determine the target scene, the accuracy of target scene determination is enhanced, providing effective information for subsequent control of the streaming media rearview mirror adjustment.

[0054] In this way, by detecting the non-passenger seat, weather, and rear environment of the target vehicle, this embodiment can divide the target scene into multiple scenarios, and these multiple scenarios cover various situations that the target vehicle may encounter, so that the display mode of the streaming media rearview mirror after adjustment can meet the needs of various scenarios.

[0055] In some embodiments, detecting a hazard behind the target vehicle includes:

[0056] Obtain the current distance between the target vehicle and the vehicles behind it, as well as the current speed of the target vehicle;

[0057] Based on the preset correspondence between driving speed and distance threshold, if the current distance is less than the distance threshold corresponding to the current driving speed, it is determined that there are dangerous factors behind the target vehicle.

[0058] Specifically, in this embodiment, the correspondence between driving speed and distance threshold can be preset.

[0059] For example, as an example, if the current driving speed is 60 km / h, the distance threshold can be 30 meters; if the current driving speed is 120 km / h, the distance threshold can be 60 meters; if the current driving speed is 20 km / h, the distance threshold can be 15 meters.

[0060] By mapping distance thresholds to driving speed, with the distance thresholds being directly proportional to driving speed, different driving speeds correspond to different criteria for judging dangerous factors, ensuring the accuracy of determining whether there are dangerous factors behind the target vehicle.

[0061] Furthermore, it should be noted that this embodiment can also classify the collision risk level according to the target vehicle's driving speed and the distance between the target vehicle and the following vehicle. The level can be divided into four levels: no danger, slight danger, moderate danger, and severe danger. Among them, no danger and slight danger can be determined as no dangerous factors behind the target vehicle, while moderate danger and severe danger can be determined as dangerous factors behind the target vehicle.

[0062] For example, as an example, if the current driving speed is 60 km / h, then:

[0063] If the distance between the vehicle behind and the target vehicle is 50 meters or more, the level is determined to be no danger.

[0064] When the distance between the vehicle behind and the target vehicle is 30 meters or more but less than 50 meters, the level is determined to be slightly dangerous.

[0065] When the distance between the vehicle behind and the target vehicle is 10 meters or more but less than 30 meters, the level is determined to be moderate danger.

[0066] When the distance between the vehicle behind and the target vehicle is 0 meters or more but less than 10 meters, the level is determined to be severe danger.

[0067] If the current driving speed is 120km / h, then:

[0068] If the distance between the vehicle behind and the target vehicle is 100 meters or more, the level is determined to be no danger;

[0069] When the distance between the vehicle behind and the target vehicle is 30 meters or more but less than 60 meters, the level is determined to be moderate danger.

[0070] When the distance between the vehicle behind and the target vehicle is 0 meters or more but less than 30 meters, the level is determined to be severe danger.

[0071] If the current driving speed is 20km / h, then:

[0072] If the distance between the vehicle behind and the target vehicle is 30 meters or more, the level is determined to be no danger.

[0073] When the distance between the vehicle behind and the target vehicle is 50 meters or more but less than 30 meters, the level is determined to be slightly dangerous.

[0074] When the distance between the vehicle behind and the target vehicle is 5 meters or more but less than 15 meters, the level is determined to be moderate danger.

[0075] When the distance between the vehicle behind and the target vehicle is 0 meters or more but less than 5 meters, the level is determined to be severe danger.

[0076] In this way, by using the current distance between the target vehicle and the vehicles behind it, as well as the current speed of the target vehicle, it is possible to determine whether there are any dangerous factors behind the target vehicle, thus achieving an accurate judgment on whether there are any dangerous factors behind it.

[0077] This embodiment also requires adjusting the streaming rearview mirror to a target field of view position that is suitable for the target scene, thereby meeting the visual requirements of the target scene. The specific adjustment process is described below.

[0078] In some embodiments, the streaming rearview mirror is controlled to adjust to the target field of view position according to the target scenario, including any of the following:

[0079] Firstly: Determine the current coordinates of the driver of the target vehicle within the target vehicle, including facial coordinates and eye coordinates; based on the preset correspondence between the driver's coordinates within the target vehicle, the mirror orientation position of the streaming rearview mirror, and the target field of view position, determine the target mirror orientation position corresponding to the current coordinates; control the streaming rearview mirror to adjust to the target mirror orientation position.

[0080] Specifically, in this method, based on changes in the driver's facial coordinates and eye coordinates, a pre-set coordinate value of the driver within the target vehicle and a preset correspondence between the mirror orientation position of the streaming rearview mirror and the target field of vision position can be invoked to adjust the mirror orientation position of the streaming rearview mirror in real time, so that the streaming rearview mirror can be adjusted to the target field of vision position.

[0081] Furthermore, the target vehicle can use a Driver Monitoring System (DMS) to identify the highest point of the driver's eyeballs protruding outwards, obtaining the eyeball coordinates, and then extend the scan to obtain the driver's facial coordinates. After receiving the current coordinates transmitted by the DMS, the controller can determine the target mirror orientation position of the streaming rearview mirror when the driver can see the target field of view at the current coordinates, based on a preset correspondence between the driver's coordinates within the target vehicle and the mirror orientation position of the streaming rearview mirror and the target field of view position. This ensures that the streaming rearview mirror can view the target field of view after being adjusted to the target mirror orientation position.

[0082] Specifically, the streaming media rearview mirror can be adjusted to the target mirror orientation position by using three sets of motors to support rotation, pitch and left and right electric adjustment.

[0083] It should be noted that when the driver looks at the streaming rearview mirror, the streaming rearview mirror re-determines the user's eye coordinates and performs position calibration to ensure the user has access to the target field of view. Furthermore, when the driver's body posture changes, the target mirror orientation corresponding to the driver's current coordinates is repeatedly determined, thereby acquiring the target field of view in real time.

[0084] It should also be noted that after the adjustment is completed, the DMS can continuously monitor the driver's emotional state and whether the driver manually makes a secondary adjustment to the position of the streaming rearview mirror. The DMS can also receive the adjustment amount of the rearview mirror detected by the DMS and link it to the user account, so that the system can continuously learn the user's personalized usage habits to provide more accurate adaptive adjustment results.

[0085] Secondly: Determine the current driving posture of the driver of the target vehicle; based on the preset correspondence between the driving posture, the mirror orientation position of the streaming media rearview mirror and the target field of view position, determine the target mirror orientation position corresponding to the current driving posture; control the streaming media rearview mirror to adjust to the target mirror orientation position.

[0086] This embodiment pre-sets a preset correspondence (also known as a memory position) between the driving posture, the mirror orientation position of the streaming rearview mirror, and the target field of view position. Specifically, users can manually set the above-mentioned preset correspondence of the streaming rearview mirror through the multimedia system (for example, up to 5 correspondences can be set under a single account).

[0087] As an example, when a user clicks the rearview mirror memory function in the multimedia system's streaming rearview mirror adjustment settings, the system will prompt the user to set "Memory Position 1". At this time, the user maintains their usual "Driving Posture 1". The DMS system identifies the coordinates of the user's head and shoulders in this driving posture and records them in the database. After the identification is complete, the multimedia system prompts the user, "Driving Posture 1 has been identified. Please adjust the rearview mirror to the appropriate field of view position 1". The user will manually adjust the rearview mirror to the appropriate "field of view position 1" and click save through the multimedia system. At this time, "Driving Posture 1", "Mirror Orientation Position", and "Field of View Position 1" will be matched and memorized, and the memory will be recorded in the driver's account. This completes the setting of the rearview mirror "Memory Position 1", that is, it establishes the correspondence between the driving posture, the mirror orientation position of the streaming rearview mirror, and the target field of view position.

[0088] It should be noted that after the streaming rearview mirror position memory setting is completed, the DMS system will recognize the user's driving posture in real time during driving. When the driving posture changes, the streaming rearview mirror will automatically adjust to the matching target position in the database via the controller. For example, when the user moves from "driving posture 1" to "driving posture 3", the rearview mirror will automatically adjust from "view position 1" to "view position 3". When the body adjusts to a driving posture not found in the database, and this posture has been maintained for more than a preset time, the multimedia system will prompt "A new driving posture has been recognized. Do you want to memorize this posture?" If the user selects "Yes", the database will record the posture data, and the multimedia system will prompt "Please adjust the rearview mirror to a suitable position. The system will record the position and match the current driving posture".

[0089] Furthermore, it should be noted that the switching and recognition of driving postures are determined by the head and shoulder coordinate data identified by the DMS system. Within ±2.5% of the set memory data, all are considered to be the same driving posture. When the driver is setting memory, if the difference between two driving posture data is within 5%, the multimedia system will prompt "Too similar to driving posture 1 data, please readjust driving posture". When the difference in driving posture is greater than 5%, the system will prompt "Driving posture recognition successful". When the user's driving posture changes, the above steps are repeated to ensure that the user can obtain the complete target field of vision position under different driving postures.

[0090] According to the technical solution provided in the embodiments of this application, the target mirror orientation position can be adjusted through any of the above methods, that is, the target field of view position can be adjusted, avoiding the need for the driver to manually adjust the rearview mirror angle while the target vehicle is in motion, thus enhancing driving safety.

[0091] In some embodiments, when the target scenario is a scenario where children or pets need to be monitored, the target field of view is a position where the child or pet can be fully displayed in the streaming rearview mirror;

[0092] In a scenario where there are no blind spots in the rear windshield view, the target view position is the position where the rear windshield view is fully displayed in the streaming rearview mirror.

[0093] In scenarios where the target scene has a blind spot in the rear windshield, is rainy, or is unsafe behind the vehicle, the target field of view is the current field of view.

[0094] Specifically, if the target scenario is a scenario where children or pets need to be monitored, then the streaming rearview mirror needs to display the image of the child or pet captured by the OMS camera. At this time, the target field of view is the position where the child or pet can be fully displayed in the streaming rearview mirror, that is, the streaming rearview mirror can reflect and display the child or pet, thus enabling the viewing of the child or pet.

[0095] If the target scene is a scene where there is no blind spot in the rear windshield view, that is, the rear windshield view can be reflected and displayed through the streaming media rearview mirror, then the target view position is the position where the rear windshield view is completely displayed in the streaming media rearview mirror. In other words, the streaming media rearview mirror can reflect and display the rear windshield view, realizing the mirror reflection viewing of the rear windshield view.

[0096] If the target scenario is a blind spot in the rear windshield, a rainy day, or an unsafe situation behind the vehicle, the field of view position of the streaming rearview mirror does not need to be adjusted. That is, the target field of view position is the current field of view position. This avoids the situation where the field of view position needs to be adjusted again when switching back to the physical rearview mirror display mode in these scenarios after using the streaming display mode.

[0097] According to the technical solution provided in the embodiments of this application, the streaming media rearview mirror can switch the corresponding target field of view position by changing different target scenes, thereby automatically providing the driver with the picture of the area to be observed and meeting the user's viewing needs for different scenes.

[0098] In some embodiments, controlling the streaming rearview mirror to adjust to a target display mode corresponding to the target scene includes at least one of the following:

[0099] Firstly, if the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy day scenario, or a scenario where there is an unsafe situation behind the vehicle, then control the streaming media rearview mirror to adjust to streaming media display mode.

[0100] Specifically, if the target scenario is a scenario where there is a blind spot in the rear windshield view, it means that the reflection function of the streaming rearview mirror cannot provide a complete view of the rear windshield view. In this case, the streaming rearview mirror can be controlled to switch to streaming display mode, thereby displaying the image captured by the rear camera of the vehicle and viewing the image behind the vehicle.

[0101] In addition, if the target scenario is a rainy day, the rear windshield may be covered with rainwater. In this case, the rear windshield view cannot be clearly seen through the reflection function of the streaming rearview mirror. You can control the streaming rearview mirror to adjust to streaming display mode, so as to see a clear view of the rear of the vehicle by displaying the image captured by the rear camera of the vehicle.

[0102] Additionally, if the target scenario is an unsafe situation behind the vehicle, the image is displayed through the reflection function of the streaming rearview mirror. However, since the streaming rearview mirror cannot reflect scenes at a long distance or the visible range is narrowed due to the small distance between vehicles, the driver may miss the situation behind, leading to driving hazards. In this case, the streaming rearview mirror can be controlled to adjust to streaming display mode, thereby expanding the driver's field of vision by displaying the image captured by the rear camera of the vehicle, thus increasing driving safety.

[0103] In this way, when the target scenario is a blind spot in the rear windshield, a rainy day, or an unsafe situation behind the vehicle, the streaming media rearview mirror is controlled to adjust to streaming media display mode, ensuring the driver's needs for the displayed content and ensuring driving safety.

[0104] Secondly: If the target scenario is one where there is no blind spot in the rear windshield view, then control the streaming media rearview mirror to switch to physical rearview mirror display mode.

[0105] If the target scenario is one where there is no blind spot in the rear windshield view, it means that the rear windshield view can be fully viewed through the reflection function of the streaming rearview mirror. At this time, the streaming rearview mirror can be controlled to switch to physical rearview mirror display mode, thereby avoiding the screen stuttering problem that may occur when it is always in streaming display mode, and also avoiding the dizziness caused by the driver watching the streaming video, thus improving driving safety.

[0106] Thirdly: If the target scenario is one where children or pets need to be monitored, then control the streaming rearview mirror to switch to physical rearview mirror display mode.

[0107] If the target scenario is one where children or pets need to be monitored, then since the monitoring is of the rear seat inside the vehicle, the reflection function of the streaming rearview mirror can fully show the children or pets. In this case, the streaming rearview mirror can be switched to physical rearview mirror display mode, thus avoiding the screen stuttering problem that may occur in streaming display mode, and also avoiding the dizziness caused by the driver watching the streaming video, thereby improving driving safety.

[0108] According to the technical solution provided in the embodiments of this application, by switching between physical rearview mirror display mode and streaming media display mode according to the target scene, a wide and safe unobstructed rearview field of vision is provided for the driver, while avoiding the problem of dizziness caused by the driver watching video screen for a long time, thus improving driving safety and reducing safety hazards caused by changes in the surrounding environment.

[0109] In some embodiments, controlling the streaming media rearview mirror to adjust to the target field of view position and controlling the streaming media rearview mirror to adjust to a target display mode corresponding to the target scene includes:

[0110] Control the target vehicle's multimedia system to display a prompt message, which prompts the user whether to activate the target display mode;

[0111] If the target scenario is one where children or pets need to be monitored, in response to the control command input by the user based on the prompt information, the streaming media rearview mirror is adjusted to the target field of view position and the streaming media rearview mirror is adjusted to the target display mode, wherein the control command is used to indicate the activation of the target display mode;

[0112] If the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy day scenario, or an unsafe scenario behind the vehicle, and no user instruction is received within a preset time period, the streaming media rearview mirror will be controlled to adjust to the target field of view position and the streaming media rearview mirror will be controlled to adjust to the target display mode.

[0113] Specifically, after determining the target scenario, the multimedia system can be controlled to display a prompt message to the user asking whether to activate the target display mode, thus enabling the user to choose whether to activate the target display mode based on the prompt message.

[0114] If the target scenario is one where monitoring of children or pets is required, and the user inputs a control command to activate the target display mode, the streaming rearview mirror will be adjusted to the target field of view position and the streaming rearview mirror will be adjusted to the target display mode. That is, the rearview mirror will be adjusted to a position where the child or pet can be fully displayed in the streaming rearview mirror, and the display mode will be the physical rearview mirror display mode. This allows the driver to see the scene in the back seat through the reflection of the streaming rearview mirror, thus realizing the monitoring of children or pets in the back seat.

[0115] In addition, the preset time period can be limited according to actual needs, for example, it can be 5 seconds.

[0116] When the OMS system detects that an object (item or person) in the rear seat or trunk of the vehicle is obstructing the rear windshield view, and this situation lasts for 10 seconds, it will prompt the user through a multimedia pop-up window whether to switch to streaming media display mode. If the user does not take any action after 5 seconds, it will automatically switch to streaming media display mode (the user can set the multimedia system to not require a pop-up window decision and directly execute the controller judgment).

[0117] When the rain sensor detects rain in the environment and the rain lasts for more than 30 seconds, a multimedia pop-up window will prompt the user whether to switch to the streaming media display mode. If the user does not operate after 5 seconds, the system will automatically switch to the streaming media display mode (the user can set the system to not require a pop-up window and directly execute the controller's judgment).

[0118] When the ADAS system detects a hazard approaching from behind the vehicle, and the hazard is classified as a medium or high risk, it will prompt the user via a multimedia pop-up window to switch to streaming media display mode. If the user does not take any action after 5 seconds, it will automatically switch to streaming media display mode (the user can set the system to not require a pop-up window and directly execute the controller's decision in the multimedia system).

[0119] According to the technical solution provided in the embodiments of this application, the adaptive adjustment effect of the streaming media rearview mirror is achieved through the combined action of prompt information and control commands, providing multiple ways to control the streaming media rearview mirror, enhancing the intelligence of control, and increasing driving safety.

[0120] Figure 2 This is a schematic diagram illustrating the interaction between devices involved in the control process of a streaming media rearview mirror provided in an embodiment of this application. Figure 2 As shown, the components involved in the control process of the streaming media rearview mirror include:

[0121] Rain sensors can determine the weather conditions in which a vehicle is driven and whether it is raining.

[0122] ADAS sensors can determine road hazards behind a vehicle (mainly vehicles behind), and classify them into four levels: no danger, minor danger, moderate danger, and severe danger based on the danger distance.

[0123] Seat sensors can detect whether there are objects in the rear seats;

[0124] The OMS system can determine whether an object in the back seat is a child, and the OMS system can collect and transmit images of the child's riding status in the back seat.

[0125] The DMS system can identify the driver's eye position, process the data through the controller, and obtain the corresponding adjustment parameter values ​​for the streaming rearview mirror, instructing the streaming rearview mirror to automatically adjust to the target mirror orientation position; it can also identify the driver's emotional state after the streaming rearview mirror adaptively adjusts and feed it back to the user center.

[0126] The rear-view camera can capture and transmit images of the road environment and the status of road users behind the vehicle;

[0127] The images captured by the rearview camera and OMS system can be displayed on the rearview mirror screen;

[0128] The various functions of the streaming rearview mirror can be controlled and managed through the multimedia system, including adaptive sensitivity control. After the vehicle detects changes in the scene, it can interact with the driver through the multimedia system, facilitating the driver to make decisions on function adjustments.

[0129] According to the technical solution provided in this application embodiment, the above components are interconnected. The vehicle can collect information about the environment and road participants behind the vehicle through the rearview camera and transmit it to the streaming media rearview mirror display screen for display. The vehicle can identify the driver's eye position through the DMS camera and collect coordinate information, which is transmitted to the controller. The controller instructs the streaming media rearview mirror to adjust to a position that provides the user with a complete rear windshield view under the drive of the motor. This process is adjusted in real time. The vehicle can identify whether there is someone sitting in the back seat through the seat sensor and whether there is a child in the back seat through the OMS sensor. If a child is identified, the driver can control the streaming media rearview mirror through the multimedia to display the monitoring image of the child in the back seat collected by the OMS camera. At this time, the streaming media... The rearview mirror will automatically adjust its position to a convenient viewing position for the user. After adaptive adjustment, the vehicle uses the DMS system to recognize the user's emotions and whether a secondary adjustment is needed, recording this information in the user's account to continuously learn the accuracy of adaptive adjustments. The vehicle can sense the ambient weather through a rain sensor. If it's raining and the user isn't using the streaming rearview mirror's streaming function, or if the user chooses to use the streaming rearview mirror to monitor the rear-seat children, the vehicle will remind the user to switch to streaming display mode. The vehicle can also sense hazards behind the vehicle through ADAS sensors. If a hazard is detected, the streaming rearview mirror will automatically adjust its position to observe the area behind the vehicle when used to monitor the rear-seat children; in rainy weather, it will automatically switch to streaming display mode. This process improves the accuracy of the streaming rearview mirror's automatic adjustment and enhances driving safety.

[0130] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0131] The following are embodiments of the apparatus of this application, which can be used to execute the embodiments of the method of this application. For details not disclosed in the embodiments of the apparatus of this application, please refer to the embodiments of the method of this application.

[0132] The following are embodiments of the apparatus of this application, which can be used to execute the embodiments of the method of this application. For details not disclosed in the embodiments of the apparatus of this application, please refer to the embodiments of the method of this application.

[0133] Figure 3 This is a schematic diagram of the control device for the streaming media rearview mirror provided in an embodiment of this application. Figure 3 As shown, the control device for the streaming rearview mirror includes:

[0134] The determination module 301 is used to determine the target scene in which the target vehicle is located;

[0135] The control module 302 is used to control the streaming media rearview mirror to adjust to the target field of view position according to the target scene information, and to control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene;

[0136] The target display mode includes a physical rearview mirror display mode or a streaming media display mode.

[0137] In some embodiments, the determining module 301 is specifically configured to perform at least one of the following:

[0138] If a child or pet is detected in the non-passenger seat of the target vehicle, the target scenario is determined to be a scenario where monitoring of the child or pet is required.

[0139] If the rear windshield view of the streaming media rearview mirror is detected to be obstructed by an object, the target scene is determined to be a scene where there is a blind spot in the rear windshield view.

[0140] If the rear windshield view of the streaming rearview mirror is not obstructed by an object, the target scene is determined to be a scene where there is no blind spot in the rear windshield view.

[0141] If the current weather is detected to be rainy, then the target scene is determined to be a rainy scene;

[0142] If a dangerous factor is detected behind the target vehicle, the target scenario is determined to be an unsafe scenario behind the vehicle.

[0143] In some embodiments, the determining module 301 is specifically used to obtain the current distance between the target vehicle and the vehicle behind it, as well as the current driving speed of the target vehicle; and, based on a preset correspondence between driving speed and distance threshold, determine that there is a dangerous factor behind the target vehicle when the current distance is less than the distance threshold corresponding to the current driving speed.

[0144] In some embodiments, the control module 302 is specifically configured to: determine the current coordinates of the driver of the target vehicle within the target vehicle, wherein the current coordinates include facial coordinates and eye coordinates; determine the target mirror orientation position corresponding to the current coordinates based on a preset correspondence between the driver's coordinates within the target vehicle, the mirror orientation position of the streaming rearview mirror, and the target field of vision position; and control the streaming rearview mirror to adjust to the target mirror orientation position; or, determine the current driving posture of the driver of the target vehicle; determine the target mirror orientation position corresponding to the current driving posture based on a preset correspondence between the driving posture, the mirror orientation position of the streaming rearview mirror, and the target field of vision position; and control the streaming rearview mirror to adjust to the target mirror orientation position.

[0145] In some embodiments, when the target scenario is a scenario where children or pets need to be monitored, the target field of view position is the position where the child or pet can be fully displayed in the streaming rearview mirror; when the target scenario is a scenario where there is no blind spot in the rear windshield view, the target field of view position is the position where the rear windshield view is fully displayed in the streaming rearview mirror; when the target scenario is a scenario where there is a blind spot in the rear windshield view, a rainy day scenario, or an unsafe scenario behind the vehicle, the target field of view position is the current field of view position.

[0146] In some embodiments, the control module 302 is specifically configured to perform at least one of the following:

[0147] If the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy day scenario, or a scenario where there is an unsafe area behind the vehicle, then control the streaming rearview mirror to switch to streaming media display mode; if the target scenario is a scenario where there is no blind spot in the rear windshield, then control the streaming rearview mirror to switch to physical rearview mirror display mode; if the target scenario is a scenario where children or pets need to be monitored, then control the streaming rearview mirror to switch to physical rearview mirror display mode.

[0148] In some embodiments, the control module 302 is specifically used to control the multimedia system of the target vehicle to display prompt information, the prompt information being used to prompt the user whether to activate the target display mode; if the target scenario is a scenario requiring monitoring of children or pets, in response to the control command input by the user based on the prompt information, the control module 302 controls the streaming media rearview mirror to adjust to the target field of view position and controls the streaming media rearview mirror to adjust to the target display mode, wherein the control command is used to instruct the activation of the target display mode; if the target scenario is a scenario with a blind spot in the rear windshield, a rainy day scenario, or an unsafe scenario behind the vehicle, and no user command is received within a preset time period, the control module 302 controls the streaming media rearview mirror to adjust to the target field of view position and controls the streaming media rearview mirror to adjust to the target display mode.

[0149] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0150] Figure 4 This is a schematic diagram of the electronic device provided in an embodiment of this application. For example... Figure 4 As shown, the electronic device of this embodiment includes: a processor 401, a memory 402, and a computer program 403 stored in the memory 402 and executable on the processor 401. When the processor 401 executes the computer program 403, it implements the steps in the various method embodiments described above. Alternatively, when the processor 401 executes the computer program 403, it implements the functions of each module / unit in the various device embodiments described above.

[0151] The electronic device can be a desktop computer, laptop, handheld computer, or cloud server, etc. The electronic device may include, but is not limited to, the processor 401 and the memory 402. Those skilled in the art will understand that... Figure 4 This is merely an example of an electronic device and does not constitute a limitation on the electronic device. It may include more or fewer parts than shown, or different parts.

[0152] The processor 401 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0153] Memory 402 can be an internal storage unit of an electronic device, such as a hard disk or RAM. Memory 402 can also be an external storage device of the electronic device, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Memory 402 can also include both internal and external storage units. Memory 402 is used to store computer programs and other programs and data required by the electronic device.

[0154] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0155] If an integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program may include computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. A computer-readable medium may include: any entity or device capable of carrying computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in a computer-readable medium can be appropriately added to or subtracted according to the requirements of legislation and patent practice in a jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0156] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A control method for a streaming media rearview mirror, characterized in that, include: Determine the target scenario in which the target vehicle is located; Based on the target scene, control the streaming media rearview mirror to adjust to the target field of view position, and control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene; The target display mode includes a physical rearview mirror display mode or a streaming media display mode; After controlling the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene, the method further includes: The Driver Monitoring System (DMS) identifies the driver's emotional state after the adaptive adjustment of the streaming rearview mirror and whether a secondary adjustment is made, and records this information in the user's account. This allows the system to continuously learn the user's personalized usage habits and the accuracy of the adaptive adjustment of the streaming rearview mirror's position.

2. The control method for a streaming media rearview mirror according to claim 1, characterized in that, Determining the target scenario where the target vehicle is located includes at least one of the following: If a child or pet is detected in the non-passenger seat of the target vehicle, then the target scenario is determined to be a scenario in which the child or pet needs to be monitored. If the rear windshield view of the streaming media rearview mirror is detected to be obstructed by an object, then the target scene is determined to be a scene where there is a blind spot in the rear windshield view. If it is detected that the rear windshield view of the streaming media rearview mirror is not obstructed by an object, then the target scene is determined to be a scene where there is no blind spot in the rear windshield view. If the current weather is detected to be rainy, then the target scene is determined to be a rainy scene; If a dangerous factor is detected behind the target vehicle, the target scenario is determined to be an unsafe scenario behind the vehicle.

3. The control method for a streaming media rearview mirror according to claim 2, characterized in that, The detection of a hazard behind the target vehicle includes: Obtain the current distance between the target vehicle and the vehicles behind it, as well as the current speed of the target vehicle; Based on a preset correspondence between driving speed and distance threshold, if the current distance is less than the distance threshold corresponding to the current driving speed, it is determined that there is a dangerous factor behind the target vehicle.

4. The control method for a streaming media rearview mirror according to claim 1, characterized in that, The step of controlling the streaming media rearview mirror to adjust to the target field of view position according to the target scene includes: Determine the current coordinates of the driver of the target vehicle within the target vehicle, wherein the current coordinates include facial coordinates and eye coordinates; determine the target mirror orientation position corresponding to the current coordinates based on a preset correspondence between the driver's coordinates within the target vehicle, the mirror orientation position of the streaming rearview mirror, and the target field of view position; control the streaming rearview mirror to adjust to the target mirror orientation position; or... Determine the current driving posture of the driver of the target vehicle; determine the target mirror orientation position corresponding to the current driving posture based on the preset correspondence between the driving posture, the mirror orientation position of the streaming media rearview mirror and the target field of view position; control the streaming media rearview mirror to adjust to the target mirror orientation position.

5. The control method for a streaming media rearview mirror according to claim 1 or 4, characterized in that, When the target scenario is one in which children or pets need to be monitored, the target field of view position is the position where the child or pet can be fully displayed in the streaming rearview mirror; When the target scenario is one in which there is no blind spot in the rear windshield view, the target view position is the position where the rear windshield view is fully displayed in the streaming media rearview mirror; In the case that the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy scenario, or an unsafe scenario behind the vehicle, the target field of view position is the current field of view position.

6. The control method for a streaming media rearview mirror according to claim 1, characterized in that, The control of adjusting the streaming media rearview mirror to a target display mode corresponding to the target scene includes at least one of the following: If the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy day scenario, or an unsafe scenario behind the vehicle, then control the streaming media rearview mirror to adjust to the streaming media display mode; If the target scenario is a scenario where there is no blind spot in the rear windshield view, then control the streaming media rearview mirror to adjust to the physical rearview mirror display mode; If the target scenario is one where children or pets need to be monitored, then the streaming media rearview mirror is controlled to switch to physical rearview mirror display mode.

7. The control method for a streaming media rearview mirror according to claim 1, characterized in that, The step of controlling the streaming media rearview mirror to adjust to the target field of view position and controlling the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene includes: The multimedia system of the target vehicle is controlled to display a prompt message, which prompts the user whether to activate the target display mode; If the target scenario is a scenario requiring monitoring of children or pets, in response to the control command input by the user based on the prompt information, the streaming media rearview mirror is controlled to adjust to the target field of view position, and the streaming media rearview mirror is controlled to adjust to the target display mode, wherein the control command is used to instruct the activation of the target display mode; If the target scenario is a scenario where there is a blind spot in the rear windshield, a rainy day scenario, or an unsafe scenario behind the vehicle, and no user instruction is received within a preset time period, the streaming media rearview mirror is controlled to adjust to the target field of view position and the streaming media rearview mirror is controlled to adjust to the target display mode.

8. A control device for a streaming media rearview mirror, characterized in that, include: The determination module is used to obtain target scene information; The control module is used to control the streaming media rearview mirror to adjust to the target field of view position according to the target scene information, and to control the streaming media rearview mirror to adjust to the target display mode corresponding to the target scene; The target display mode includes a physical rearview mirror display mode or a streaming media display mode; The control module is also used to: after controlling the streaming rearview mirror to adjust to the target display mode corresponding to the target scene, identify the driver's emotional state after the streaming rearview mirror is adaptively adjusted and whether a secondary adjustment is made through the driver monitoring system (DMS), and record it in the user center account so that the system can continuously learn the user's personalized usage habits and the adaptive adjustment accuracy of the streaming rearview mirror position.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 7.

10. A readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 7.

Images