Display Method, Device, Equipment, Medium and Vehicle Based on Streaming Media Rearview Mirror
The autonomous driving system obtains vehicle environment information and switches the display mode on the streaming rearview mirror, which solves the problem of limited field of view of the streaming rearview mirror, and achieves rich environmental information display and security improvement.
Patent Information
- Application Number
- CN202211478564.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-23
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2042-11-23
AI Technical Summary
The existing streaming rearview mirror has limited field of view and relatively single environmental information, which cannot provide sufficient driving information.
The acquisition device in the autonomous driving system is used to obtain the environmental information around the vehicle, and switch the environment information through the normal display mode and intelligent display mode of the streaming media rearview mirror. In the intelligent display mode, whether there is an abnormality in the environmental information is used to control the display content.
It expands the user's observation perspective, provides rich environmental information, improves driving experience and safety, and reduces vehicle production costs.
Smart Images

Figure CN115891838B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of vehicles, and in particular, to a display method, device, equipment, medium and vehicle based on a streaming media rearview mirror. Background Art
[0002] With the continuous development of the automotive industry, automobiles have become an indispensable part of people's lives and work. To meet the needs of users in different driving scenarios and expand the rear view of the vehicle during driving, corresponding display devices can be installed on the vehicle to meet the relevant requirements of users. Therefore, the streaming media rearview mirror came into being. Among them, as an output device, the streaming media rearview mirror can transmit the image of the rear of the vehicle to the streaming media rearview mirror through a camera installed at the rear of the vehicle to provide a wider field of view for users. However, in the related art, the acquisition angle of the environmental information of the vehicle by the streaming media rearview mirror is limited, and the content of the acquired environmental information is relatively single. Therefore, the compensation for the user's field of view is also relatively weak. Summary of the Invention
[0003] In view of this, the main purpose of the present application is to solve the technical problems that the field of view obtained by the streaming media rearview mirror in the existing vehicle is limited and the content of the environmental information is relatively single, and to provide a display method, device, equipment, medium and vehicle based on a streaming media rearview mirror.
[0004] Based on the above purpose, the present application provides a display method based on a streaming media rearview mirror, which is applicable to an autonomous driving system. The autonomous driving system includes a collection device. The display mode of the streaming media rearview mirror includes a normal display mode and an intelligent display mode. The method includes:
[0005] Obtain the environmental information of the vehicle collected by the collection device;
[0006] In response to the streaming media rearview mirror being in the normal display mode, determine a switching instruction and switch the displayed environmental information of the streaming media rearview mirror;
[0007] In response to the streaming media rearview mirror being in the intelligent display mode, determine whether the environmental information is abnormal, and control the display content of the environmental information of the streaming media rearview mirror according to the determination result.
[0008] Optionally, the determining the switching instruction includes:
[0009] Receiving the switching instruction issued by the user, or determining the switching instruction according to the change of the environmental information.
[0010] Optionally, the environmental information includes rear view information, front view information and side view information.
[0011] In response to the streaming rearview mirror being in the intelligent display mode, determining whether the environmental information is abnormal, and controlling the display content of the environmental information on the streaming rearview mirror according to the determination result, including:
[0012] In response to at least one of the rear view information, the front view information, and the side view information being abnormal, displaying the abnormal environmental information on the streaming rearview mirror.
[0013] Optionally, in response to the streaming rearview mirror being in the intelligent display mode, determining whether the environmental information is abnormal, and controlling the display content of the environmental information on the streaming rearview mirror according to the determination result, including:
[0014] In response to none of the rear view information, the front view information, and the side view information being abnormal, displaying the rear view information on the streaming rearview mirror;
[0015] In response to the rear view information being normal and at least one of the front view information and the side view information being abnormal, displaying the rear view information and the abnormal front view information and / or the side view information on the streaming rearview mirror;
[0016] In response to the rear view information being abnormal and the front view information and the side view information being normal, displaying the rear view information on the streaming rearview mirror;
[0017] In response to the rear view information being abnormal and at least one of the front view information and the side view information being abnormal, displaying the rear view information on the streaming rearview mirror and displaying the abnormal front view information and / or the side view information on the streaming rearview mirror.
[0018] Optionally, in response to the streaming rearview mirror being in the intelligent display mode, determining whether the environmental information is abnormal, and controlling the display content of the environmental information on the streaming rearview mirror according to the determination result, including:
[0019] In response to the rear view information being normal and at least one of the front view information and the side view information being abnormal, the display area of the front view information and / or the side view information is larger than the display area of the rear view information;
[0020] In response to the rear view information being abnormal and at least one of the front view information and the side view information being abnormal, the display area of the front view information and / or the side view information is less than or equal to the display area of the rear view information.
[0021] Optionally, in response to the streaming media rearview mirror being in the intelligent display mode, it is determined whether the environmental information is abnormal, and according to the determination result, the display content of the environmental information on the streaming media rearview mirror is controlled, including:
[0022] Display the abnormal environmental information on the streaming media rearview mirror and send a corresponding prompt signal.
[0023] Based on the same inventive concept, the present application also provides a display system, including:
[0024] An information acquisition module for the streaming media rearview mirror;
[0025] A first determination module for determining a switching instruction in response to the streaming media rearview mirror being in the normal display mode and switching the environmental information displayed on the streaming media rearview mirror;
[0026] A second determination module for determining whether the environmental information is abnormal in response to the streaming media rearview mirror being in the intelligent display mode and controlling the display content of the environmental information on the streaming media rearview mirror according to the determination result.
[0027] Based on the same inventive concept, the present application also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the method described in the above embodiments is implemented.
[0028] Based on the same inventive concept, the present application also provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method described in any one of the above embodiments.
[0029] Based on the same inventive concept, the present application also provides a vehicle, including the display system described in the above embodiments, and / or including the electronic device described in the above embodiments, and / or including the storage medium described in the above embodiments.
[0030] As can be seen from the above, the display method, device, equipment, medium, and vehicle based on the streaming media rearview mirror provided by the present application can utilize the acquisition device in the autonomous driving system to obtain the environmental information around the vehicle, without the need to additionally set up information acquisition components, saving production costs; and the streaming media rearview mirror has a normal display mode and an intelligent display mode, and the corresponding environmental information is displayed on the streaming media rearview mirror through different display modes, so that the user can obtain effective environmental information through the streaming media rearview mirror, facilitating the user to timely adjust the driving state of the vehicle; at the same time, it also broadens the user's observation perspective, improves the driving experience, and ensures driving safety. Description of the Drawings
[0031] To more clearly illustrate the technical solutions in the present application or related technologies, the following will briefly introduce the drawings required for use in the embodiments or related technology descriptions. Obviously, the drawings in the following descriptions are only the embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0032] Figure 1 It is a flowchart of the display method of the streaming media rearview mirror in the embodiments of the present application;
[0033] Figure 2 It is a schematic connection structure diagram of the display system in the embodiments of the present application;
[0034] Figure 3 It is a schematic diagram of the display system in one embodiment of the present application;
[0035] Figure 4 It is a schematic connection structure diagram of the electronic device in the embodiments of the present application. Specific Embodiments
[0036] To make the purpose, technical solutions, and advantages of the present application clearer and more understandable, the following will further elaborate on the present application in detail with reference to specific embodiments and the accompanying drawings.
[0037] It should be noted that unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should have the ordinary meaning understood by those of ordinary skill in the art to which the present application belongs. The "first", "second", and similar terms used in the embodiments of the present application do not indicate any order, quantity, or importance, but are only used to distinguish different components. "Including" or "comprising" and similar terms mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. "Connecting" or "being connected" and similar terms are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right", etc. are only used to represent relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.
[0038] In the related art, with the continuous development of the automotive industry, automobiles have become an indispensable part of people's lives and work. To meet the needs of users for different driving scenarios and expand the rear view of the vehicle during driving, a corresponding display device can be installed on the vehicle to meet the relevant requirements of users. Therefore, the streaming media rearview mirror came into being. Among them, as an output device, the streaming media rearview mirror has two relatively prominent features. One is that it can obtain a wider rear view, and the rear view will not be blocked by in-vehicle objects during observation. The other is that it looks cooler through digital display, thus enhancing the overall grade of the vehicle. The camera set at the rear of the vehicle can transmit the image of the rear of the vehicle to the streaming media rearview mirror to provide a wider view for users. However, in the related art, the streaming media rearview mirror needs to cooperate with corresponding information collection components such as cameras to obtain the environmental information of the vehicle, thus increasing the cost investment of the vehicle. Moreover, the collection angle of the environmental information of the streaming media rearview mirror for the vehicle is limited, the content of the obtained environmental information is relatively single, and the compensation for the user's view is relatively weak. Therefore, relying solely on the display content of the streaming media rearview mirror cannot provide sufficient driving information for users.
[0039] In some embodiments, based on the above problems, the present application provides a display method based on a streaming media rearview mirror, which is applicable to an autonomous driving system. The autonomous driving system includes a collection device, and the display mode of the streaming media rearview mirror includes a normal display mode and an intelligent display mode. The method includes:
[0040] Step 100, obtain the environmental information of the vehicle collected by the collection device;
[0041] In this step, the collection device in the autonomous driving system can be used to obtain the environmental information around the vehicle. Specifically, the environmental information at the rear can be obtained through the collection device set at the rear of the vehicle, the environmental information in the front can be obtained through the collection device of the vehicle set in the front, and the environmental information on the side can be obtained through the collection device set on the side of the vehicle. Moreover, collection devices can be set on both sides of the vehicle to obtain the environmental information on both sides of the vehicle respectively. By using the autonomous driving system to collect environmental information, the obtained environmental information is relatively rich, and there is no need to additionally adopt redundant information collection components, reducing the cost investment of the vehicle production.
[0042] Step 200, in response to the streaming media rearview mirror being in the normal display mode, determine a switching instruction and switch the environmental information displayed on the streaming media rearview mirror;
[0043] In this step, when the streaming media rearview mirror of the vehicle is in the normal display mode, the autonomous driving system can obtain the environmental information of the vehicle, and the streaming media rearview mirror can display the obtained environmental information; by inputting the corresponding switching instruction, the streaming media rearview mirror can display the corresponding environmental information according to the corresponding switching instruction, so that the user can select the display content of the streaming media rearview mirror according to the actual situation to enrich the user's observation field of view.
[0044] Step 300: In response to the streaming media rearview mirror being in the intelligent display mode, determine whether the environmental information is abnormal, and control the display content of the environmental information by the streaming media rearview mirror according to the determination result.
[0045] In this step, when the streaming media rearview mirror is in the intelligent display mode, it can analyze and judge the obtained environmental information of the vehicle to determine whether there is any abnormality around the vehicle that interferes with normal driving, and judge to make the streaming media rearview mirror display the corresponding environmental information, which is convenient for the user to observe and understand through the streaming media rearview mirror, so as to make corresponding adjustments to the driving state of the vehicle.
[0046] Among them, if the obtained environmental information of the vehicle is normal, one or more environmental information of the vehicle obtained by the acquisition device can be displayed through the streaming media rearview mirror to expand the user's observation angle and enrich the source of its environmental information; if there is an abnormality in the obtained environmental information of the vehicle, it means that there is abnormal environmental information around the vehicle in this driving state and there is a certain risk. At this time, the abnormal environmental information can be displayed through the streaming media rearview mirror so that the user can obtain effective environmental information to adjust the driving state of the vehicle.
[0047] It should be noted that the acquisition device in the autonomous driving system of the vehicle can be used to obtain the environmental information around the vehicle. Among them, the display modes of the streaming media rearview mirror include the normal display mode and the intelligent display mode. Through different display modes, the streaming media rearview mirror can display the corresponding environmental information; when the streaming media rearview mirror is in the normal display mode, the streaming media rearview mirror can be switched according to the switching instruction to display the environmental information corresponding to the switching instruction; when the streaming media rearview mirror is in the intelligent display mode, analyze and judge the obtained environmental information to determine whether there is a situation around the vehicle that affects the normal driving of the vehicle. If abnormal environmental information is detected around the vehicle, the abnormal environmental information will be transmitted to the streaming media rearview mirror, and the streaming media rearview mirror will display the abnormal environmental information so that the user can obtain the corresponding environmental information. Please refer to Figure 1; By adopting the display method in the present application, the observation angle of the user can be enlarged, and effective environmental information can be provided for the user according to the driving environment around the vehicle, enabling the user to adjust the driving state according to the environmental information, improving the driving experience, and ensuring driving safety, thereby enhancing the product grade invisibly.
[0048] It should be noted that the streaming media rearview mirror is arranged in the cab of the vehicle for the user to observe. At the same time, the streaming media rearview mirror is connected to the autonomous driving system and can use the information acquisition module in the autonomous driving system to obtain the environmental information around the vehicle. Compared with the traditional streaming media rearview mirror, it can collect the rearview information of the vehicle without adding redundant information acquisition components, reducing the cost investment of the vehicle while ensuring the display effect of the streaming media rearview mirror; moreover, the specific structure and working principle of the streaming media rearview mirror both belong to the prior art in this technical field, and the present application does not improve it, so no redundant elaboration is made here.
[0049] In some embodiments, determining the switching instruction includes:
[0050] Receiving the switching instruction issued by the user, or determining the switching instruction according to the change of the environmental information.
[0051] It should be noted that the environmental information around the vehicle is obtained by using the acquisition device in the autonomous driving system, and the driving state information of the vehicle is determined through the environmental information. When the streaming media rearview mirror is in the normal display mode, the user can actively send a switching instruction to the streaming media rearview mirror according to the actual situation. After receiving the switching instruction from the user, the streaming media rearview mirror can switch the corresponding display content to meet the driving needs of the user; for example, the user can send a control instruction to the streaming media rearview mirror through voice, gesture or control button to display the environmental information of the corresponding position of the vehicle on the streaming media rearview mirror.
[0052] In addition, the driving state information of the vehicle can also be determined by using the environmental information, so that the streaming media rearview mirror determines the switching instruction according to the change of the environmental information around the vehicle, making the environmental information displayed by the streaming media rearview mirror adapt to the driving state of the vehicle; among them, the driving state information of the vehicle can include lane change information, steering information and reverse information, providing the environmental information of the corresponding position for the user during lane change, steering and reversing, ensuring that the user obtains sufficient driving information.
[0053] For example, when the vehicle changes lanes, in response to the driving state information being lane-changing information, it is determined that the switching instruction is a lane-changing switching instruction, and the ambient information of the side and rear of the vehicle can be displayed on the streaming media rearview mirror so as to know whether there are interfering vehicles on the side and rear of the vehicle during the lane-changing process of the vehicle; for another example, when the vehicle turns, in response to the driving state information being turning information, it is determined that the switching instruction is a turning switching instruction, and the ambient information of the side and front of the vehicle can be displayed on the streaming media rearview mirror so as to know whether there are interfering vehicles or obstacles on the side and front of the vehicle during the turning process of the vehicle; for yet another example, when the vehicle is reversing, in response to the driving state information being reversing information, it is determined that the switching instruction is a reversing switching instruction, and the ambient information of the rear of the vehicle can be displayed on the streaming media rearview mirror so that the user can know whether there are obstacles or interfering vehicles behind the vehicle and ensure the safe parking of the vehicle.
[0054] In some embodiments, the ambient information includes rear-view information, front-view information, and side-view information. In response to the streaming media rearview mirror being in the intelligent display mode, it is determined whether the ambient information is abnormal, and the display content of the ambient information on the streaming media rearview mirror is controlled according to the determination result, including:
[0055] In response to at least one of the rear-view information, front-view information, and side-view information being abnormal, the abnormal ambient information is displayed on the streaming media rearview mirror.
[0056] It should be noted that by determining whether there are abnormal situations in the surrounding environment of the vehicle, effective driving information can be provided for the user so that the user can adjust the driving state according to the displayed ambient information; among them, the ambient information around the vehicle includes its rear-view information, front-view information, and side-view information, that is, it is possible to determine whether there are abnormal situations in the rear, front, and side of the vehicle through the rear-view information, front-view information, and side-view information of the vehicle; among them, if it is detected that there are abnormalities in the rear-view information, front-view information, and side-view information in the acquired ambient information, the abnormal ambient information needs to be transmitted to the streaming media rearview mirror for display so that the user can timely know the azimuth where the ambient information around the vehicle is abnormal.
[0057] For example, during the driving process of the vehicle, the rear-view information of the vehicle can be acquired by using the acquisition device. If it is detected that there is another vehicle with a too high speed and a too close distance behind, it is determined at this time that the rear-view information of the vehicle is abnormal and there is a risk of being rear-ended; the acquired rear-view information is transmitted to the streaming media rearview mirror and displayed through the streaming media rearview mirror so that the user can timely learn about the abnormal situation and adjust the driving state of the vehicle according to the rear-view information, such as avoiding the vehicle behind by changing lanes.
[0058] For another example, during the driving process of a vehicle, the rear view information of the vehicle can be obtained by using a collection device, and the side view information of the vehicle can also be obtained by using the collection device. If it is detected that there are other vehicles with too high a speed and a short distance behind the vehicle, and there are also other vehicles with a short distance on its side, at this time, it is determined that there is abnormal environmental information both behind and on the side of the vehicle, and the risk of rear-end collision cannot be avoided by changing lanes; the rear view information and the side view information are transmitted to the streaming media rearview mirror to display the rear view information and the side view information of the vehicle on the streaming media rearview mirror, so that the user can timely know that it is not easy to avoid the driving risk by changing lanes. At this time, the user can adjust the driving state of the vehicle, such as accelerating appropriately to increase the distance from the vehicle behind.
[0059] In some embodiments, in response to the streaming media rearview mirror being in the intelligent display mode, it is determined whether the environmental information is abnormal, and according to the determination result, the display content of the environmental information on the streaming media rearview mirror is controlled, including:
[0060] In response to the rear view information, the front view information, and the side view information all being normal, the rear view information is displayed on the streaming media rearview mirror;
[0061] In response to the rear view information being normal and at least one of the front view information and the side view information being abnormal, the rear view information and the abnormal environmental information among them are displayed on the streaming media rearview mirror;
[0062] In response to the rear view information being abnormal and the front view information and the side view information being normal, the rear view information is displayed on the streaming media rearview mirror;
[0063] In response to the rear view information being abnormal and at least one of the front view information and the side view information being abnormal, the rear view information is displayed on the streaming media rearview mirror, and the abnormal front view information and / or side view information is displayed on the streaming media rearview mirror.
[0064] It should be noted that after judging the environmental information, if the surrounding environmental information of the vehicle is abnormal, the streaming media rearview mirror needs to display the abnormal environmental information so that the user can know the orientation of the abnormal environmental information through the streaming media rearview mirror; at the same time, to enable the streaming media rearview mirror to have a rear view function, whether the rear view information of the vehicle is abnormal or normal, the rear view information of the vehicle can be displayed on the streaming media rearview mirror, that is, the streaming media rearview mirror can always display the rear view information of the vehicle, enabling the user to obtain the environmental information behind the vehicle in real time, and at the same time, the abnormal environmental information in other directions of the vehicle can also be displayed on the streaming media rearview mirror, expanding the user's observation angle, enabling it to obtain effective environmental information in real time through the streaming media rearview mirror, and improving the driving experience and driving safety.
[0065] For example, when the vehicle is in motion, if there are no abnormalities in the rear-view information, front-view information, and side-view information of the vehicle, the rear-view information of the vehicle can be displayed through the streaming media rear-view mirror, so that the streaming media rear-view mirror has the functions of the existing rear-view mirror, ensuring that the user can continuously obtain the rear view of the vehicle to ensure the user's safe driving of the vehicle.
[0066] For another example, when the vehicle is in motion, if there is no abnormality in the rear-view information of the vehicle and there are abnormalities in the front-view information and / or side-view information of the vehicle, at this time, in addition to displaying the rear-view information without abnormality, the streaming media rear-view mirror will also display the abnormal front-view information and / or side-view information on the streaming media rear-view mirror, so that the user can understand the orientation of the abnormal environment information of the vehicle; wherein, for the user to accurately obtain the orientation of the abnormal environment information, corresponding orientation markings and text markings can be displayed on the display screen of the streaming media rear-view mirror for the user to observe and understand.
[0067] For yet another example, when the vehicle is in motion, if there is an abnormality in the rear-view information of the vehicle and the front-view information and side-view information of the vehicle are normal, the abnormal rear-view information will be displayed through the streaming media rear-view mirror for the user to observe and refer to; wherein, for the user to intuitively understand whether there is an abnormality in the rear-view information of the vehicle and to distinguish between the abnormal and normal rear-view information, when the streaming media rear-view mirror displays the abnormal rear-view information, corresponding prompts can be made in the display area of the streaming media rear-view mirror. For example, when the rear-view information is abnormal, corresponding text markings can be displayed on the streaming media rear-view mirror for the user to distinguish.
[0068] For yet another example, when the vehicle is in motion, if there is an abnormality in the rear-view information obtained by the vehicle and there are also abnormalities in the front-view information and / or side-view information, the abnormal rear-view information can be displayed through the streaming media rear-view mirror, and the abnormal front-view information and / or rear-view information will also be displayed on the streaming media rear-view mirror, so that the user can adjust the driving state of the vehicle in combination with the abnormal environment information displayed by the streaming media rear-view mirror.
[0069] In some embodiments, in response to the streaming media rear-view mirror being in the intelligent display mode, it is determined whether the environment information is abnormal, and the display content of the environment information by the streaming media rear-view mirror is controlled according to the determination result, including:
[0070] In response to the rear-view information being normal and at least one of the front-view information and the side-view information being abnormal, the display area of the front-view information and / or the side-view information is larger than the display area of the rear-view information;
[0071] In response to the rear-view information being abnormal and at least one of the front-view information and the side-view information being abnormal, the display area of the front-view information and / or the side-view information is less than or equal to the display area of the rear-view information.
[0072] It should be noted that in order to enable users to clearly obtain the corresponding environmental information on the streaming media rearview mirror, corresponding display rules can be formulated to distinguish the importance of the environmental information displayed on the streaming media rearview mirror. Among them, the importance can be judged by the display area. The larger the display area, the clearer the display effect, and at the same time, it can also attract the user's attention more, so that the user can obtain the corresponding environmental information in time.
[0073] For example, when there is no abnormality in the rearview information in the streaming media rearview mirror and there is an abnormality in the front view information and / or the side view information, at this time, the environmental information with an abnormality in the front view information and the side view information is displayed on the streaming media rearview mirror; since there is no abnormality in the rearview information of the vehicle, at this time, for the vehicle, the risk existing in its front and / or side is relatively high. Therefore, the streaming media rearview mirror can preferentially display the front view information and / or the side view information with an abnormality. At this time, the display area of the side view information and / or the rearview information with an abnormality can be made larger than the display area of the rearview information without an abnormality to attract the user's attention, enable it to more clearly understand the environmental information with an abnormality, and timely adjust the driving state of the vehicle.
[0074] For another example, when there is an abnormality in the rearview information in the streaming media rearview mirror and there is also an abnormality in the front view information and / or the side view information, at this time, the environmental information with an abnormality is displayed on the streaming media rearview mirror. Since there is an abnormality in the rearview information of the vehicle; at this time, for the vehicle, the risk existing in the rear of the vehicle is relatively high, and at the same time, the function of the rearview mirror needs to be taken into account. Therefore, the streaming media rearview mirror can preferentially display the rearview information with an abnormality, and the display area of the rearview information with an abnormality can be made larger than or equal to the display area of the front view information and / or the side view information with an abnormality to enable the user to more clearly understand the environmental information with an abnormality and timely adjust the driving state of the vehicle.
[0075] In some embodiments, the step of, in response to at least one of the rearview information, the front view information, and the side view information being abnormal, displaying the environmental information with an abnormality on the streaming media rearview mirror includes:
[0076] Displaying the environmental information with an abnormality on the streaming media rearview mirror and emitting a corresponding prompt signal.
[0077] It should be noted that during the driving process of the vehicle, the user needs to pay attention to various information of the vehicle to ensure driving safety. When there is an abnormality in the environmental information around the vehicle, the abnormal environmental information needs to be transmitted to the streaming media rearview mirror for display for the user to observe. However, since the user pays attention to a lot of information during driving, the abnormal environmental information displayed on the streaming media rearview mirror may be ignored. Therefore, a prompt signal corresponding to the abnormal environmental information displayed on the streaming media rearview mirror can be issued to remind the user, attract the driver's attention to the abnormal environmental information that appears, or guide the user to adjust the driving state of the vehicle through the prompt signal. Among them, the corresponding prompt signal can be issued by the vehicle head unit, and the corresponding prompt signal can be a voice prompt signal or a light prompt signal.
[0078] For example, during the driving process of the vehicle, if there is an abnormality in the rear view information in the acquired environmental information, the rear view information is transmitted to the streaming media rearview mirror and displayed through the streaming media rearview mirror. To enable the user to know the abnormal environmental information, the streaming media rearview mirror can send a corresponding request to the vehicle head unit of the vehicle, and the vehicle head unit issues a voice message corresponding to the abnormal rear view information so that the user can adjust the vehicle.
[0079] It should be noted that the method of the embodiments of the present application can be executed by a single device, such as a computer or a server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In this case of a distributed scenario, one of the multiple devices can only execute one or more steps of the method of the embodiments of the present application, and these multiple devices will interact with each other to complete the method.
[0080] It should be noted that some embodiments of the present application have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the above embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0081] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application further provides a display system, including:
[0082] An information acquisition module 10, configured to acquire environmental information of the vehicle;
[0083] A first determination module 20, configured to determine a switching instruction in response to the streaming media rearview mirror being in a normal display mode, and switch the environmental information displayed on the streaming media rearview mirror;
[0084] A second determination module 30, configured to determine whether there is an abnormality in the environmental information in response to the streaming media rearview mirror being in the intelligent display mode, and control the display content of the environmental information by the streaming media rearview mirror according to the determination result.
[0085] Please refer to Figure 2 , in this application, by adopting the information acquisition module 10, the environmental information of the vehicle can be acquired. Among them, when the streaming media rearview mirror is in the normal display mode, the first determination module 20 is used to confirm the switching instruction. After the second determination module 20 receives the switching instruction, it can switch the display content of the streaming media rearview mirror so that the streaming media rearview mirror displays the corresponding environmental information, thereby enriching the user's observation field of view; when the streaming media rearview mirror is in the intelligent display mode, the second determination module 30 is used to determine the acquired environmental information, and determine whether there is an abnormality in the front view information, rear view information and side view information of the vehicle. If there is an abnormality, the abnormal environmental information is transmitted to the streaming media rearview mirror, and the streaming media rearview mirror is used to display the abnormal environmental information to provide effective environmental information for the user, so as to adjust the driving state of the vehicle according to the corresponding environmental information.
[0086] Among them, the information acquisition unit is applicable to the autonomous driving system, and may include a rear view camera 10a, a front view camera 10b, a side view camera 10c and a surround view camera 10d. The rear view camera 10a, the front view camera 10b, the side view camera 10c and the surround view camera 10d can be connected by a LVDS (Low Voltage Differential Signaling) harness to obtain the environmental information around the vehicle, thereby reducing the range of the visual blind area; among them, the surround view camera 10d can adopt a wide-angle camera covering a 360° field of view around the vehicle, and can collect environmental information in multiple directions at the same time. Please refer to Figure 3 ; in addition, the information acquisition unit may also include vehicle-mounted radars, such as millimeter wave radars, lidars and ultrasonic radars, which can obtain more environmental information and improve the accuracy of the acquired environmental information.
[0087] For the convenience of description, when describing the above device, various modules are described separately according to their functions. Of course, when implementing this application, the functions of each module can be implemented in one or more software and / or hardware.
[0088] The device in the above embodiment is used to implement the corresponding display method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be described herein again.
[0089] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the display method of any of the above embodiments is implemented.
[0090] Figure 4 FIG. shows a more specific schematic diagram of the hardware structure of the electronic device provided in this embodiment. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. Among them, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are communicatively connected to each other inside the device through the bus 1050.
[0091] The processor 1010 may be implemented in a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0092] The memory 1020 may be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When implementing the technical solutions provided in the embodiments of this specification through software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0093] The input / output interface 1030 is used to connect to an input / output module to implement information input and output. The input / output module may be configured as a component in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Among them, the input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0094] The communication interface 1040 is used to connect to a communication module (not shown in the figure) to implement communication interaction between this device and other devices. Among them, the communication module may communicate through a wired manner (such as USB, network cable, etc.) or through a wireless manner (such as a mobile network, WIFI, Bluetooth, etc.).
[0095] The bus 1050 includes a path for transmitting information between various components of the device, such as the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040.
[0096] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device may also only include the components necessary to implement the solution of the embodiments of this specification, and does not necessarily include all the components shown in the figure.
[0097] The electronic device of the above embodiment is used to implement the corresponding display method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.
[0098] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application also provides a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to execute the display method of any of the foregoing embodiments.
[0099] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device.
[0100] The computer instructions stored in the storage medium of the above embodiment are used to cause a computer to execute the display method of any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be elaborated here.
[0101] It should be noted that the embodiments of the present application can also be further described in the following manner:
[0102] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application further provides a vehicle, including the display system in the above embodiments, and / or, including the electronic device in the above embodiments, and / or, including the storage medium in the above embodiments; wherein, since the vehicle in the present application applies at least one of the display system, the electronic device, and the non-transitory computer-readable storage medium in the above embodiments, therefore, the vehicle has the corresponding beneficial effects of the above display system, electronic device, and non-transitory computer-readable storage medium, which will not be elaborated here.
[0103] Those of ordinary skill in the art should understand that: The discussion of any of the above embodiments is only exemplary and is not intended to imply that the scope of the present application (including the claims) is limited to these examples; Under the idea of the present application, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the embodiments of the present application as described above, and they are not provided in detail for the sake of brevity.
[0104] In addition, for simplicity of description and discussion, and in order not to make the embodiments of the present application difficult to understand, the well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. In addition, the device may be shown in block diagram form in order to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present application will be implemented (that is, these details should be completely within the understanding of those skilled in the art). In the case where specific details (such as circuits) are set forth to describe the exemplary embodiments of the present application, it will be apparent to those skilled in the art that the embodiments of the present application can be implemented without these specific details or with variations of these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0105] Although the present application has been described in connection with specific embodiments of the present application, many substitutions, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art based on the foregoing description. For example, other memory architectures (such as dynamic RAM (DRAM)) may be used with the embodiments discussed.
[0106] The embodiments of the present application are intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the embodiments of the present application shall be included within the protection scope of the present application.
Claims
1. A display method based on a streaming media rearview mirror, characterized in that, Applicable to an autonomous driving system, the streaming media rearview mirror is connected to the acquisition device of the autonomous driving system and uses the acquisition device of the autonomous driving system to obtain the environmental information of the vehicle. The display modes of the streaming media rearview mirror include a normal display mode and an intelligent display mode. The method includes: Obtain the environmental information of the vehicle collected by the acquisition device; In response to the streaming media rearview mirror being in the normal display mode, determine a switching instruction and switch the displayed environmental information of the streaming media rearview mirror; In response to the streaming media rearview mirror being in the intelligent display mode, determine whether the environmental information is abnormal, and control the display content of the environmental information on the streaming media rearview mirror according to the determination result, where the environmental information includes rear view information, front view information, and side view information; In response to at least one of the rear view information, the front view information, and the side view information being abnormal, display the abnormal environmental information on the streaming media rearview mirror; specifically including: in response to the rear view information being normal and at least one of the front view information and the side view information being abnormal, the display area of the front view information and / or the side view information is larger than the display area of the rear view information; in response to the rear view information being abnormal and at least one of the front view information and the side view information being abnormal, the display area of the front view information and / or the side view information is less than or equal to the display area of the rear view information.
2. The display method based on a streaming media rearview mirror according to claim 1, wherein The determination of the switching instruction includes: Receiving the switching instruction issued by the user, or determining the switching instruction according to the change of the environmental information.
3. The display method based on a streaming media rearview mirror according to claim 1, wherein The step of, in response to the streaming media rearview mirror being in the intelligent display mode, determining whether the environmental information is abnormal and controlling the display content of the environmental information on the streaming media rearview mirror according to the determination result includes: In response to all of the rear view information, the front view information, and the side view information being normal, display the rear view information on the streaming media rearview mirror; In response to the rear view information being normal and at least one of the front view information and the side view information being abnormal, display the rear view information and the abnormal front view information and / or the side view information on the streaming media rearview mirror; In response to the rear view information being abnormal and the front view information and the side view information being normal, display the rear view information on the streaming media rearview mirror; In response to the rear view information being abnormal and at least one of the front view information and the side view information being abnormal, display the rear view information on the streaming media rearview mirror and display the abnormal front view information and / or the side view information on the streaming media rearview mirror.
4. The display method based on a streaming media rearview mirror according to claim 2, wherein The step of, in response to at least one of the rear view information, the front view information, and the side view information being abnormal, displaying the abnormal environmental information on the streaming media rearview mirror includes: Display the abnormal environmental information on the streaming media rearview mirror and issue a corresponding prompt signal.
5. A display system, characterized in that, Including: An information acquisition module for obtaining the environmental information of the vehicle; The first judgment module is configured to determine a switching instruction in response to the streaming media rearview mirror being in the normal display mode, and switch the environmental information displayed by the streaming media rearview mirror; The second judgment module is configured to, in response to the streaming media rearview mirror being in the intelligent display mode, judge whether the environmental information is abnormal, and control the display content of the environmental information by the streaming media rearview mirror according to the judgment result, where the environmental information includes rearview information, frontview information, and sideview information; in response to at least one of the rearview information, the frontview information, and the sideview information being abnormal, display the abnormal environmental information on the streaming media rearview mirror; specifically including: in response to the rearview information being normal and at least one of the frontview information and the sideview information being abnormal, the display area of the frontview information and / or the sideview information is larger than the display area of the rearview information; in response to the rearview information being abnormal and at least one of the frontview information and the sideview information being abnormal, the display area of the frontview information and / or the sideview information is smaller than or equal to the display area of the rearview information.
6. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, the method described in any one of claims 1-4 is implemented.
7. A non-transitory computer-readable storage medium storing computer instructions, wherein The computer instructions are used to cause a computer to execute the method described in any one of claims 1-4.
8. A vehicle, characterized in that, It includes the display system described in claim 5, and / or includes the electronic device described in claim 6, and / or includes the storage medium described in claim 7.
Citation Information
Patent Citations
Image display method of electronic rearview mirror, vehicle, device and storage medium
CN114851966A