Information display method and system, controller, and vehicle

Abstract

This application discloses an information display method and system, a controller, and a vehicle, belonging to the field of electronic technology. The method is used in a controller in a vehicle, which also includes a camera and a display. The method includes: controlling the camera to capture an image outside the vehicle; when a target obstacle is present in the image, controlling the display to display the image at a target refresh rate; when the target obstacle is absent, controlling the display to display the image at an auxiliary refresh rate, wherein the target refresh rate is greater than the auxiliary refresh rate. This application addresses the issue of low image display flexibility in electronic rearview mirrors. This application is used for image display.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to an information display method and system, a controller, and a vehicle. Background Art

[0002] With the development of electronic technology, the requirements for the intelligence level of vehicles are becoming higher and higher.

[0003] In related technologies, vehicles can use electronic rearview mirrors instead of traditional optical rearview mirrors. These mirrors use cameras to capture images of traffic conditions outside the vehicle and display them on a monitor. The images displayed on the monitor allow the driver to understand traffic conditions outside the vehicle and react accordingly to ensure driving safety.

[0004] However, the image display flexibility of the electronic rearview mirror in the related art is relatively low. Summary of the Invention

[0005] This application provides an information display method and system, a controller, and a vehicle that can solve the problem of low image display flexibility in electronic rearview mirrors. The technical solution includes:

[0006] In one aspect, a method for displaying information is provided for use with a controller in a vehicle, the vehicle further comprising: a camera and a display, the method comprising:

[0007] Controlling the camera to capture images outside the vehicle;

[0008] When a target obstacle exists in the image, controlling the display to display the image at a target refresh rate;

[0009] When the target obstacle does not exist in the image, the display is controlled to display the image at an auxiliary refresh rate, and the target refresh rate is greater than the auxiliary refresh rate.

[0010] Optionally, the target refresh rate includes a first refresh rate and a second refresh rate, the first refresh rate being greater than the second refresh rate; and when a target obstacle is present in the image, controlling the display to display the image at the target refresh rate comprises:

[0011] When a target obstacle exists in the image, determining, based on multiple frames of images continuously captured by the camera, whether an absolute value of a relative speed of the target obstacle with respect to the vehicle is greater than a speed threshold;

[0012] When the absolute value of the relative speed is greater than the speed threshold, controlling the display to display the image captured by the camera at the first refresh rate;

[0013] When the absolute value of the relative speed is less than or equal to the speed threshold, the display is controlled to display the image captured by the camera at the second refresh rate.

[0014] Optionally, determining whether the absolute value of the relative speed between the target obstacle and the vehicle is greater than the speed threshold based on multiple frames of images continuously captured by the camera includes:

[0015] When the number of frames of the multiple frames of images containing the target obstacle is less than a number threshold, determining that the absolute value of the relative speed is greater than the speed threshold;

[0016] When the number of frames of the multiple frames of images containing the target obstacle is greater than or equal to the number threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0017] Optionally, determining whether the absolute value of the relative speed between the target obstacle and the vehicle is greater than the speed threshold based on multiple frames of images continuously captured by the camera includes:

[0018] When there is a position change of the target obstacle in adjacent frame images in the multiple frame images that is greater than a target threshold, determining that the absolute value of the relative speed is greater than the speed threshold;

[0019] When the position changes of the target obstacle in any adjacent frame images in the multiple frame images are less than or equal to the target threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0020] Optionally, the target obstacle includes at least one of a person and a vehicle.

[0021] Optionally, the controller is configured to control the display to display images at a frame length corresponding to any refresh rate when controlling the display to display images at any refresh rate;

[0022] The frame length corresponding to the target refresh rate is smaller than the frame length corresponding to the auxiliary refresh rate.

[0023] Optionally, controlling the camera to capture an image outside the vehicle includes:

[0024] Based on the driving state of the vehicle, the camera is controlled to collect images within a camera field of view corresponding to the driving state.

[0025] Optionally, the vehicle further includes an encoder and a decoder. After controlling the camera to capture an image outside the vehicle, the method further includes:

[0026] Controlling the encoder to encode the image captured by the camera;

[0027] Identifying the target obstacle based on the encoded image;

[0028] The decoder is controlled to decode the encoded image, and the image displayed on the display is the decoded image.

[0029] In another aspect, a controller in a vehicle is provided, the vehicle further comprising: a camera and a display, the controller comprising:

[0030] a first control module, configured to control the camera to capture images outside the vehicle;

[0031] a second control module, configured to control the display to display the image at a target refresh rate when a target obstacle exists in the image;

[0032] The third control module is configured to control the display to display the image at an auxiliary refresh rate when the target obstacle does not exist in the image, and the target refresh rate is greater than the auxiliary refresh rate.

[0033] Optionally, the target refresh rate includes a first refresh rate and a second refresh rate, the first refresh rate is greater than the second refresh rate; and the second control module includes:

[0034] a judgment unit, configured to judge, when a target obstacle exists in the image, whether an absolute value of a relative speed of the target obstacle relative to the vehicle is greater than a speed threshold based on multiple frames of images continuously captured by the camera;

[0035] a first control unit, configured to control the display to display the image captured by the camera at the first refresh rate when the absolute value of the relative speed is greater than the speed threshold;

[0036] The second control unit is configured to control the display to display the image captured by the camera at the second refresh rate when the absolute value of the relative speed is less than or equal to the speed threshold.

[0037] Optionally, the judging unit is configured to:

[0038] When the number of frames of the multiple frames of images containing the target obstacle is less than a number threshold, determining that the absolute value of the relative speed is greater than the speed threshold;

[0039] When the number of frames of the multiple frames of images containing the target obstacle is greater than or equal to the number threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0040] Optionally, the judging unit is configured to:

[0041] When there is a position change of the target obstacle in adjacent frame images in the multiple frame images that is greater than a target threshold, determining that the absolute value of the relative speed is greater than the speed threshold;

[0042] When the position changes of the target obstacle in any adjacent frame images in the multiple frame images are less than or equal to the target threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0043] Optionally, the target obstacle includes at least one of a person and a vehicle.

[0044] Optionally, the controller is configured to control the display to display images at a frame length corresponding to any refresh rate when controlling the display to display images at any refresh rate;

[0045] The frame length corresponding to the target refresh rate is smaller than the frame length corresponding to the auxiliary refresh rate.

[0046] Optionally, the first control module is configured to:

[0047] Based on the driving state of the vehicle, the camera is controlled to collect images within a camera field of view corresponding to the driving state.

[0048] Optionally, the vehicle further includes an encoder and a decoder. After controlling the camera to capture an image outside the vehicle, the controller further includes:

[0049] a fourth control module, configured to control the encoder to encode the image captured by the camera;

[0050] an identification module, configured to identify the target obstacle based on the encoded image;

[0051] The fifth control module is configured to control the decoder to decode the encoded image, and the image displayed on the display is the decoded image.

[0052] On the other hand, a controller in a vehicle is provided, the controller comprising a processing unit and a storage unit, the storage unit storing instructions, and the processing unit being configured to execute the instructions to implement the above-mentioned information display method.

[0053] On the other hand, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium. When the instructions are executed on a computer, the computer executes the above-mentioned information display method.

[0054] On the other hand, a computer program product comprising instructions is provided. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned information display method.

[0055] On the other hand, an information display system is provided, which includes: a controller, a camera and a display; the controller is the controller mentioned above.

[0056] Optionally, the information display system further includes: an encoder and a decoder.

[0057] On the other hand, a vehicle is provided, comprising a vehicle body and the above-mentioned information display system, wherein the information display system is fixed to the vehicle body.

[0058] The beneficial effects of the technical solution provided by this application include at least:

[0059] In this application, a controller in a vehicle adjusts the display's refresh rate based on the presence of obstacles in the image captured by the camera, improving the flexibility of displaying images outside the vehicle. Furthermore, when an obstacle is present in the image, the display is controlled to display at a high refresh rate. This allows for a more accurate and comprehensive display of the obstacle, reduces the latency in obtaining obstacle information, and ensures that the driver can respond promptly to the obstacle, thereby ensuring driving safety. When no obstacle is present, the display is controlled to operate at a low refresh rate, reducing power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0061] Figure 1 is a block diagram of an information display system provided by an embodiment of the present application;

[0062] Figure 2 is a block diagram of another information display system provided by an embodiment of the present application;

[0063] Figure 3 is a block diagram of a vehicle provided in an embodiment of the present application;

[0064] Figure 4 This is a flow chart of an information display method provided by an embodiment of the present application;

[0065] Figure 5 is a flowchart of another information display method provided by an embodiment of the present application;

[0066] Figure 6 This is a schematic diagram of the principle of a variable refresh rate technology provided by an embodiment of the present application;

[0067] Figure 7 This is a schematic diagram of image display at different refresh rates provided by an embodiment of the present application;

[0068] Figure 8 is a schematic structural diagram of a controller in a vehicle provided in an embodiment of the present application;

[0069] Figure 9 It is a structural diagram of another controller in a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0071] Driving safety is paramount in traffic scenarios. Currently, vehicles can utilize electronic rearview mirrors instead of traditional optical mirrors. These mirrors utilize cameras to capture clear images of the exterior and display them to the driver via a display. Image processing ensures a clear image even in rainy and foggy conditions, ensuring the driver has a clear view of the exterior and enhancing driving safety. The demand for vehicle intelligence is increasing. Beyond the requirements for electronic rearview mirrors, they also require high image display flexibility, low latency, and low power consumption.

[0072] The following embodiments of the present application provide an information display method, a controller for executing the method, including a camera, a display, an information display system of the controller, and a vehicle including the system. Based on this method, the controller controls the display to display images captured by the camera, which is equivalent to implementing variable refresh rate (VRR) technology on the display, thereby improving image display flexibility, reducing image display latency, and lowering power consumption.

[0073] The vehicle provided in the embodiments of the present application includes a vehicle body and an information display system, the information display system being fixed to the vehicle body. The information display system may be an electronic rearview mirror in the vehicle, configured to capture and display images outside the vehicle to the driver. The information display system may also be referred to as a rearview camera system. The electronic rearview mirror may directly replace a conventional optical rearview mirror in the vehicle, or may be provided in addition to the optical rearview mirror, which is not limited in the embodiments of the present application.

[0074] Figure 1This is a block diagram of an information display system provided by an embodiment of the present application. Figure 1 As shown, the information display system 10 may include a camera 101, a display 102, and a controller 103. The camera 101 and the display 102 are both connected to the controller 103 and receive certain control from the controller 103. For example, the camera 101 and the display 102 may operate under the control of the controller 103; or the camera 101 and the display 102 may only receive control from the controller 103 in certain situations, and may also operate independently in other situations.

[0075] The camera 101 is located outside the vehicle and is used to capture images outside the vehicle. For example, the camera 101 can be located at the position of a traditional optical rearview mirror. The camera 101 can include a charge coupled device (CCD) image sensor.

[0076] The display 102 can be located inside the vehicle to display the image captured by the camera 101 to the driver. For example, the display 102 can be located at the center console of the vehicle, or near the vehicle window; the display 102 can also be located outside the vehicle, such as at the position of a traditional optical rearview mirror. The display 102 can be a display screen, such as a liquid crystal display screen, an organic light-emitting diode (OLED) display screen, or any other type of display screen. The display 102 can also be a display that displays on the front windshield, such as the display 102 is a head-up display; or the display 102 can also be a display that projects an image onto the vehicle window for display. The specific implementation and setting location of the display 102 are not limited in the embodiments of the present application. It is only necessary to ensure that the image displayed by the display 102 can be viewed by the driver.

[0077] The controller 103 may include a processing unit and a storage unit (not shown in the figure). The controller 103 may specifically use the processing unit to control other components. The storage unit may store instructions, and the processing unit may execute the instructions to achieve corresponding control of other components. The controller 103 may process the images captured by the camera 101 and control the display 102 to display the corresponding images based on the processing results. For example, the storage unit of the controller 103 may cache several frames of images to be displayed by the display 102, so as to control the display 102 to display the images cached in the storage unit in sequence. The images cached in the storage unit can be continuously updated.

[0078] Optionally, Figure 2 This is a block diagram of another information display system provided by an embodiment of the present application. Figure 2 As shown, in Figure 1On the basis of the above, the information display system 10 may further include an encoder 104 and a decoder 105. The encoder 104 may be connected to the camera 101 and the controller 103, and the decoder 105 may be connected to the display 102 and the controller 103. The encoder 104 may encode the image captured by the camera 101, the controller 102 may process the encoded image, and the decoder 105 may decode the encoded image for display on the display 102.

[0079] In addition to the components in the information display system 10, the vehicle may also include other functional components. For example, Figure 3 This is a block diagram of a vehicle provided by an embodiment of the present application. As shown in 3, the vehicle includes Figure 2 Between the various components shown, a distance measuring component 201 and an alarm component 202 may also be included. The distance measuring component 201 may be located outside the vehicle to detect the distance between the vehicle and other objects (such as other vehicles or pedestrians). The alarm component 202 may be located inside the vehicle to display an alarm message to the driver for warning. Alternatively, the alarm component 202 may also be located outside the vehicle to display an alarm message to other vehicles or pedestrians. The distance measuring component 201 and the alarm component 202 may both be connected to the controller 103 to operate under the control of the controller 103. For example, the controller 103 may control the alarm component 202 to issue an alarm based on the distance detected by the distance measuring component 201. For example, when the distance is less than a distance threshold, the controller 103 controls the alarm component 202 to issue an alarm, so that the driver is informed that the vehicle is close to other objects and there is a risk of collision, which facilitates the driver to perform corresponding driving operations.

[0080] Please continue to refer to Figure 3 The distance measuring component 201 may include a transmitting unit 2011 and a receiving unit 2012. The controller 103 may control the transmitting unit 2011 to transmit a distance measuring pulse signal, and the receiving unit 2012 may receive a reflected signal after the signal is reflected. The controller 103 may calculate the distance based on the information received by the receiving unit 2012. The distance measuring component 201 may be an ultrasonic distance measuring component, an infrared distance measuring component, or a distance measuring component using other distance measuring methods.

[0081] The alarm component 202 can give an alarm in a variety of ways, such as by displaying a light (such as controlling the light to change color or flash at a specific frequency) or by issuing a voice alarm, so as to realize the visual display alarm and accurate voice alarm function. Figure 3The alarm component 202 may include a light alarm unit 2021 and a voice alarm unit 2022, and the two alarm units may be used to implement light alarms and voice alarms respectively. For example, the light alarm unit 2021 may include a light strip. The light alarm unit 2021 and the voice alarm unit 2022 may be set in the edge area of ​​the display 102, or may be set on the dashboard of the vehicle or any other location, and this embodiment of the application is not limited to this. The alarm component 202 may also include only one of the light alarm unit 2021 and the voice alarm unit 2022. Optionally, the display 102 may also be reused as the alarm component 202, and an alarm may be issued by displaying an alarm message on the display 102. Optionally, the vehicle may include multiple displays, and the display involved in the introduction of the alarm component 202 may be any one of the multiple displays, such as a display other than the display 102.

[0082] Figure 4 This is a flow chart of an information display method provided by an embodiment of the present application, which is used to Figures 1 to 3 The controller 103 of the information display system in the vehicle is shown in FIG. Figure 4 As shown, the method may include:

[0083] Step 401: Control the camera to capture images outside the vehicle.

[0084] The controller can identify target obstacles in the image captured by the camera, obtain an identification result indicating whether the target obstacle is present or absent in the image, and then perform different subsequent controls based on different identification results. For example, the display can be controlled to display images at different refresh rates based on different identification results. The target obstacle can be an object that affects driving safety, such as at least one of a person and a vehicle. The vehicle can include a car, truck, van, electric vehicle, bicycle, motorcycle, etc. The target obstacle can also include an animal or other object, which is not limited in the embodiments of the present application.

[0085] Step 402: When a target obstacle exists in the image, control the display to display the image at a target refresh rate.

[0086] Step 403: When there is no target obstacle in the image, control the display to display the image at the auxiliary refresh rate, and the target refresh rate is greater than the auxiliary refresh rate.

[0087] In summary, in the information display method provided in the embodiments of the present application, a controller in a vehicle adjusts the display's refresh rate based on the presence of obstacles in the image captured by the camera, thereby improving the display flexibility of images outside the vehicle. Furthermore, when an obstacle is present in the image, the display is controlled to display at a high refresh rate. This allows for a more accurate and comprehensive display of the obstacle, reduces the latency in obtaining obstacle information, and ensures that the driver can respond promptly to the obstacle, thereby ensuring driving safety. When no obstacle is present in the image, the display is controlled to operate at a low refresh rate, thereby reducing the display's power consumption.

[0088] Figure 5 This is a flowchart of another information display method provided by an embodiment of the present application, which can be used for Figure 3 The controller in the information display system of the vehicle shown. Figure 5 As shown, the method may include:

[0089] Step 501: Based on the driving state of the vehicle, control the camera to collect images within the camera field of view corresponding to the driving state.

[0090] In an embodiment of the present application, after the vehicle is started, the controller can initialize the various components connected to it (such as the various components in the information display system), such as setting the parameters required for each component to work, and then the controller can control the various components to perform corresponding work.

[0091] The controller can control the camera to capture images outside the vehicle. The camera's field of view can be fixed or adjustable under the control of the controller. For example, adjusting the camera's field of view can include adjusting the size and position of the field of view. The camera can include multiple sub-cameras, such as a standard sub-camera and a wide-angle sub-camera, each of which can rotate. For example, the controller can control the position of the camera's field of view by controlling the rotation direction and angle of the sub-cameras, and can control the size of the camera's field of view by controlling whether the wide-angle sub-camera is turned on.

[0092] For example, different vehicle driving states can correspond to different camera ranges. Based on the vehicle's driving state, the controller can control the camera to capture images within the camera's field of view corresponding to that driving state. This allows the vehicle to capture images within a relatively appropriate field of view and display them to the driver in each driving state, ensuring that the external conditions the driver sees meet the needs of the current driving scenario, thereby improving driving safety. For example, driving states can include starting, straight driving, turning, and parking. Parking states can include reversing into a garage or parallel parking.

[0093] Step 502: Determine whether there is a target obstacle in the image. If there is a target obstacle in the image, execute step 503; if there is no target obstacle in the image, execute step 504.

[0094] The controller can perform certain processing on the image captured by the camera, such as identifying the target obstacle, and then perform different operations based on different recognition results. The recognition result can indicate whether the target obstacle is included in the image or not, reflecting whether there is a target obstacle around the vehicle. The target obstacle can be a specific type of obstacle in the environment, such as an object that affects driving safety, such as a target obstacle can include at least one of a person, an animal, and a vehicle. When there is a target obstacle around the vehicle, the vehicle is at risk of colliding with the target obstacle. The controller can perform different operations for this situation and the situation where there is no target obstacle, respectively, to improve driving safety. For example, when there is a target obstacle in the image, the display is controlled to display the image at a higher refresh rate (such as the target refresh rate), reducing the delay of the image display, ensuring that the image display is free of lag and tearing, improving the image display effect, ensuring that the driver is aware of a more comprehensive and accurate understanding of the situation outside the vehicle, and reducing the risk of collision. When there is no target obstacle in the image, the display is controlled to display the image at a lower refresh rate (such as the auxiliary refresh rate). The power consumption of the display increases in direct proportion to the switching frequency. Reducing the refresh rate of the display can reduce the switching frequency, thereby reducing the power consumption of the display and saving energy for the vehicle.

[0095] When the controller identifies a target obstacle in an image captured by the camera, it can obtain the characteristics of the target obstacle and perform feature extraction on the image to compare the extracted characteristics with the characteristics of the target obstacle to achieve target obstacle identification in the image. The characteristics of the target obstacle can be stored in a storage unit of the controller, such as when the vehicle leaves the factory. The feature extraction of the image can be performed by the processing unit of the controller. Optionally, the characteristics of the target obstacle can also be obtained by the processor from other storage space or other devices, or can also be input by the user, which is not limited in the embodiments of the present application.

[0096] In an embodiment of the present application, when the controller determines that the image contains a target obstacle, it can directly control the display to display the image based on the set target refresh rate. Optionally, the controller can further analyze the image to determine the specific movement of the target obstacle, and perform corresponding operations based on the different movement conditions of the target obstacle to match appropriate operations for different traffic scenarios (such as controlling the display to display the image at a corresponding refresh rate). For example, the controller can further analyze the image based on the image containing the target obstacle through the following steps 503 to 505 and control the display based on the analysis results.

[0097] Step 503: Based on the multiple frames of images continuously captured by the camera, determine whether the absolute value of the relative speed of the target obstacle relative to the vehicle is greater than a speed threshold. If the absolute value of the relative speed is greater than the speed threshold, proceed to step 504; if the absolute value of the relative speed is less than or equal to the speed threshold, proceed to step 505.

[0098] Since the faster the target obstacle moves relative to the vehicle, the higher the risk of collision between the target obstacle and the vehicle, the controller can perform different controls based on the speed at which the target obstacle moves relative to the vehicle. The speed at which the target obstacle moves relative to the vehicle can be reflected by the absolute value of the relative speed of the target obstacle relative to the vehicle. After determining that the image contains the target obstacle, the controller can determine the absolute value of the relative speed of the target obstacle relative to the vehicle based on multiple frames of images continuously captured by the camera, and then perform different operations based on the absolute value. For example, the controller can perform different operations based on the relationship between the absolute value of the relative speed and the speed threshold.

[0099] The controller can use a variety of methods to determine whether the absolute value of the relative speed is greater than the speed threshold based on multiple frames of images continuously captured by the camera. Two optional methods are described below in the embodiments of the present application.

[0100] In the first approach, the controller can determine the absolute value of the relative speed of the target obstacle relative to the vehicle based on the number of frames in the multi-frame image that contain the target obstacle. The fewer the number of frames, the greater the absolute value of the relative speed. The number of frames can be the number of frames captured by the camera during the period from the appearance to the disappearance of the target obstacle in the camera's field of view. If the number of frames in the multi-frame image continuously captured by the camera that contain the target obstacle is less than a threshold number, the controller can determine that the absolute value of the relative speed is greater than a speed threshold. If the number of frames in the multi-frame image that contain the target obstacle is greater than or equal to the threshold number, the controller can determine that the absolute value of the relative speed is less than or equal to the speed threshold.

[0101] In the second method, the controller can determine the absolute value of the relative speed of the target obstacle with respect to the vehicle based on the position change of the target obstacle in adjacent frame images. The greater the position change, the greater the absolute value of the relative speed. The images captured by the camera are of the same shape and size, and the adjacent frame images can be mapped to the same area. The position change of the target obstacle in the adjacent frame images is the distance of the target obstacle in the adjacent frame images in the area. In the multiple frames of images continuously captured by the camera, when the position change of the target obstacle in the adjacent frame images is greater than the target threshold, the controller can determine that the absolute value of the relative speed is greater than the speed threshold; when the position change of the target obstacle in any adjacent frame images in the multiple frames is less than or equal to the target threshold, the controller can determine that the absolute value of the relative speed is less than or equal to the speed threshold. The target threshold can represent a position distance of a specific size in the image.

[0102] In the embodiments of this application, the controller directly determines the relationship between the absolute value of the relative speed and the speed threshold based on multiple image frames, without determining the specific value of the relative speed. Alternatively, the controller may determine the specific value of the relative speed based on the multiple image frames, and then determine the relationship between the absolute value of the relative speed and the speed threshold.

[0103] Step 504: Control the display to display images at a first refresh rate.

[0104] After step 503, if the controller determines that a target obstacle exists in the image captured by the camera and that the target obstacle is moving relatively quickly relative to the vehicle (i.e., the absolute value of the relative speed is greater than a speed threshold), the controller may control the display to display the image captured by the camera at a higher first refresh rate. This ensures that the display displays a more complete picture of traffic information outside the vehicle, reduces information omissions, facilitates the driver's timely response based on this traffic information, and ensures driving safety. Optionally, the first refresh rate may be the maximum refresh rate of the display.

[0105] Step 505: Control the display to display images at a second refresh rate, where the first refresh rate is greater than the second refresh rate.

[0106] After step 503, when the controller determines that there is a target obstacle in the image captured by the camera and that the target obstacle moves slowly relative to the vehicle (that is, the absolute value of the relative speed is less than or equal to the speed threshold), the controller can control the display to display the image captured by the camera at a lower second refresh rate, thereby reducing the power consumption of the display to a certain extent.

[0107] It should be noted that in the above embodiment of the present application, only one speed threshold is set for the relative speed of the target obstacle relative to the vehicle, and two speed intervals are divided based on the speed threshold, corresponding to the first refresh rate and the second refresh rate respectively. When the absolute value of the relative speed is greater than the speed threshold, the image is displayed at the first refresh rate, and when the absolute value of the relative speed is less than or equal to the speed threshold, the image is displayed at the second refresh rate. Optionally, multiple speed thresholds of different sizes can also be set for the relative speed, and more speed intervals can be divided based on the multiple speed thresholds, and each speed area corresponds to a refresh rate. Based on the speed interval in which the absolute value of the relative speed is located, the display is controlled to display the image at the refresh rate corresponding to the speed interval. The number of speed intervals divided can be determined based on the refresh rate supported by the display.

[0108] Step 506: Control the display to display images at the auxiliary refresh rate.

[0109] When the controller determines in step 502 that the target obstacle is not present in the image captured by the camera, it may control the display to display the image captured by the camera at a lower auxiliary refresh rate. For example, the auxiliary refresh rate may be the lowest refresh rate supported by the display to minimize the power consumption of the display. The auxiliary refresh rate is lower than the refresh rate of the display when the target obstacle is present. The first refresh rate and the second refresh rate may both be target refresh rates, and the target refresh rate is greater than the auxiliary refresh rate, i.e., both the first refresh rate and the second refresh rate are greater than the auxiliary refresh rate.

[0110] In the embodiment of the present application, the controller controls the display to display images using variable refresh rate technology. Figure 6 This is a schematic diagram of the principle of a variable refresh rate technology provided by an embodiment of the present application. Figure 6 As shown in the figure, in variable refresh rate technology, each frame is rendered and then displayed, with a vertical blanking (vblank) time between the display of two adjacent frames. Vblank is also called field blanking. Different vblank times result in different numbers of frames displayed per second, and thus different refresh rates. Figure 6 In the figure, Render0, Render1, etc. are used to represent each frame image after rendering, and Display0, Display1, etc. are used to represent each frame image displayed.

[0111] Figure 7 1 is a schematic diagram of an image display at different refresh rates provided by an embodiment of the present application, and the refresh rates of 60 Hz, 30 Hz and 20 Hz are used as examples for comparison. Figure 7As shown, when the refresh rate is 60 Hz, the display can sequentially display each frame of the image from the 0th frame (represented by Frame0 in the figure) to the 3rd frame (represented by Frame3 in the figure). When the refresh rate is 30 Hz, the time for displaying the 1st and 3rd frames is used as the vblank time, and the 1st and 3rd frames are no longer displayed. The 0th frame is kept displayed during the original display time of the 1st frame, and the 2nd frame is kept displayed during the original display time of the 3rd frame. This can reduce driving power and power consumption. When the refresh rate is 20 Hz, the time for displaying the 1st and 2nd frames is used as the vblank time, and the 1st and 2nd frames are no longer displayed. The 0th frame is kept displayed during the original display time of the 1st and 2nd frames.

[0112] The display has a timing controller (TCON). When the display displays an image, the TCON is used to perform corresponding timing control to enable the display to display the image at the required refresh rate. Each refresh rate supported by the display corresponds to a certain frame length (also called vtotal). The longer the frame length, the lower the refresh rate of the display. The frame length can be understood as the display duration of the same frame image captured by the camera. TCON adjusts the refresh rate of the display by adjusting the frame length, and in the process, the line length (also called htotal) and the frequency of the pixel clock signal (pixel clock frequency, pixel CLK) are fixed. The frame length corresponding to the above-mentioned target refresh rate can assist the frame length corresponding to the refresh rate, and the frame length corresponding to the first refresh rate is smaller than the frame length corresponding to the second refresh rate.

[0113] Optionally, in embodiments of the present application, the controller may further perform specific processing on the image before controlling the display to display the image, and then control the display to display the processed image to improve the image display quality. For example, the controller may perform high-definition processing on the image and control the display to display the processed image to improve the clarity of the displayed image.

[0114] Optionally, the vehicle in the embodiment of the present application may further include an encoder and a decoder. For such a vehicle, after step 501, the controller may control the encoder to encode the image captured by the camera to reduce the number of images and ensure that the subsequent transmission processing rate is faster. The encoded image may be transmitted to the controller, and then the controller executes steps 502 and 503. Since the amount of data in the encoded image is small, the speed of processing the image may be faster, such as the speed of identifying target obstacles in the encoded image is faster. Optionally, the camera may transmit the captured image to the encoder, and the encoder may encode all received images by default without being controlled by the controller, and then transmit the encoded image to the controller. Optionally, the controller may perform high-definition processing on the encoded image.

[0115] After analyzing the image through steps 502 and 503 (identifying the target obstacle and determining the absolute value of the relative speed), the controller also needs to control the decoder to decode the image to be displayed on the display; then, based on the analysis results, step 504, step 505 or step 506 is executed to control the display to display the decoded image at an appropriate refresh rate.

[0116] In an embodiment of the present application, after the information display system in a vehicle is powered on, the controller first initializes the various components in the system, such as setting the codec registers; then controls the camera to begin image acquisition; after each frame of image acquired by the camera, the encoder encodes the image and sends it to the processing unit in the controller for processing, such as target obstacle recognition and high-definition processing; then, at least one frame of image to be displayed is cached in the controller's storage unit; then, the image most recently displayed in the at least one frame of image is sent to the decoder for decoding, and the decoded image is sent to the display for display. In this way, the controller controls the display to display images using variable refresh rate technology based on the images acquired by the camera.

[0117] In the embodiment of the present application, in addition to controlling the camera and the display, the controller can also control other components in the vehicle to perform corresponding operations. For example, the vehicle also includes a distance measuring component and an alarm component, see the above Figure 3 The controller uses the distance measurement component to detect the distance between the vehicle and surrounding obstacles. When the distance falls below a threshold, it controls the warning component to display a warning message. This enables blind spot warnings and obstacle reminders, alerting drivers to potential dangers while driving, further enhancing driver safety and comfort.

[0118] The operating processes of the various components in the vehicle of the present application embodiment can be modularized. For example, the vehicle can include a main program, a range-finding system subroutine, a rear-view camera subroutine, and a voice reminder subroutine. The controller can connect to the various components through the main program, control the range-finding components through the range-finding system subroutine, control the camera and display through the rear-view camera subroutine, and control the voice warning unit through the voice reminder subroutine. Each program can be independently implemented, ensuring program flexibility, hierarchy, and scalability.

[0119] In summary, in the information display method provided in the embodiments of the present application, a controller in a vehicle adjusts the display's refresh rate based on the presence of obstacles in the image captured by the camera, thereby improving the display flexibility of images outside the vehicle. Furthermore, when an obstacle is present in the image, the display is controlled to display at a high refresh rate. This allows for a more accurate and comprehensive display of the obstacle, reduces the latency in obtaining obstacle information, and ensures that the driver can respond promptly to the obstacle, thereby ensuring driving safety. When no obstacle is present in the image, the display is controlled to operate at a low refresh rate, thereby reducing the display's power consumption.

[0120] Figure 8 This is a schematic diagram of the structure of a controller in a vehicle provided by an embodiment of the present application. The vehicle also includes: a camera and a display. The controller here can be Figures 1 to 3 Any controller 103 shown. Figure 8 As shown, the controller 80 includes:

[0121] The first control module 801 is used to control the camera to capture images outside the vehicle.

[0122] The second control module 802 is configured to control the display to display the image at a target refresh rate when a target obstacle exists in the image.

[0123] The third control module 803 is configured to control the display to display the image at an auxiliary refresh rate when there is no target obstacle in the image, and the target refresh rate is greater than the auxiliary refresh rate.

[0124] In summary, the controller in the vehicle of the present embodiment can adjust the display's refresh rate based on the presence of obstacles in the image captured by the camera, thereby increasing the flexibility of displaying images outside the vehicle. Furthermore, when an obstacle is present in the image, the controller controls the display to display at a high refresh rate. This allows for a more accurate and comprehensive display of the obstacle, reduces the latency in obtaining obstacle information, and ensures that the driver can respond promptly to the obstacle, thereby ensuring driving safety. When no obstacle is present in the image, the controller controls the display to operate at a low refresh rate, thereby reducing the display's power consumption.

[0125] Optionally, the target refresh rate includes a first refresh rate and a second refresh rate, and the first refresh rate is greater than the second refresh rate; the second control module 802 may include:

[0126] a judgment unit, configured to judge, when a target obstacle exists in the image, whether an absolute value of a relative speed of the target obstacle relative to the vehicle is greater than a speed threshold based on multiple frames of images continuously captured by the camera;

[0127] a first control unit, configured to control the display to display the image captured by the camera at a first refresh rate when the absolute value of the relative speed is greater than a speed threshold;

[0128] The second control unit is used to control the display to display the image captured by the camera at a second refresh rate when the absolute value of the relative speed is less than or equal to the speed threshold.

[0129] Optionally, the judging unit is configured to:

[0130] When the number of frames of the multiple frames of images containing the target obstacle is less than a number threshold, determining that the absolute value of the relative speed is greater than a speed threshold;

[0131] When the number of frames containing the target obstacle in the multiple frames of images is greater than or equal to the number threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0132] Optionally, the judging unit is configured to:

[0133] When a position change of a target obstacle in adjacent frame images in the multiple frame images is greater than a target threshold, determining that the absolute value of the relative speed is greater than a speed threshold;

[0134] When the position changes of the target obstacle in any adjacent frame images in the multiple frame images are all less than or equal to the target threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

[0135] Optionally, the target obstacle includes at least one of a person and a vehicle.

[0136] Optionally, the controller is used to control the display to display images at a frame length corresponding to any refresh rate when controlling the display to display images at any refresh rate; wherein the frame length corresponding to the target refresh rate is smaller than the frame length corresponding to the auxiliary refresh rate.

[0137] Optionally, the first control module is configured to:

[0138] Based on the driving state of the vehicle, the camera is controlled to collect images within the camera field of view corresponding to the driving state.

[0139] Optionally, Figure 9This is a schematic diagram of the structure of another controller provided in an embodiment of the present application. Figure 9 As shown, in Figure 9 On the basis of, the controller 80 further includes:

[0140] A fourth control module 804 is configured to control the camera to encode the captured image after the camera captures the image outside the vehicle;

[0141] Identification module 805, used to identify target obstacles based on the encoded image;

[0142] The fifth control module 806 is configured to control the display to decode the encoded image, and the image displayed on the display is the decoded image.

[0143] In summary, the controller in the vehicle of the present embodiment can adjust the display's refresh rate based on the presence of obstacles in the image captured by the camera, thereby increasing the flexibility of displaying images outside the vehicle. Furthermore, when an obstacle is present in the image, the controller controls the display to display at a high refresh rate. This allows for a more accurate and comprehensive display of the obstacle, reduces the latency in obtaining obstacle information, and ensures that the driver can respond promptly to the obstacle, thereby ensuring driving safety. When no obstacle is present in the image, the controller controls the display to operate at a low refresh rate, thereby reducing the display's power consumption.

[0144] The embodiment of the present application further provides a controller in a vehicle, the controller comprising a processing unit and a storage unit, the storage unit storing instructions, the processing unit being configured to execute the instructions stored in the storage unit to implement the above-mentioned information display method, such as Figure 4 or Figure 5 method.

[0145] The embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the above-mentioned information display method, such as Figure 4 or Figure 5 The computer-readable storage medium may be any available medium that can be accessed by a computer, such as a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium, or a semiconductor medium (e.g., a solid-state drive).

[0146] The embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the above-mentioned information display method, such as Figure 4 or Figure 5 method.

[0147] It should be noted that the method embodiments provided in the embodiments of the present application can be referenced with the corresponding device embodiments, and the embodiments of the present application are not limited thereto. The order of the steps of the method embodiments provided in the embodiments of the present application can be appropriately adjusted, and the steps can be increased or decreased accordingly according to the circumstances. Any method that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application, and therefore will not be described in detail.

[0148] It should be noted that in the embodiments of the present application, the terms "first", "second" and "third" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The term "at least one" refers to one or more. The term "plurality" refers to two or more, unless otherwise clearly defined. The term "at least one of A and B" in this application is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, at least one of A and B may represent: A exists alone, A and B exist at the same time, and B exists alone. The terms "including" and "having" and any variations thereof in this application are intended to cover but not exclude inclusion. For example, a product or device that includes a series of components is not necessarily limited to those components clearly listed, but may include other components that are not clearly listed or inherent to these products or devices. The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that can perform the functions associated with the element.

[0149] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. An information display method, characterized in that: A controller for a vehicle, the vehicle further comprising: a camera and a display, the camera comprising a normal sub-camera and a wide-angle sub-camera, the method comprising: controlling the camera to capture images outside the vehicle; the field of view of the camera is adjusted under the control of the controller, the position of the field of view of the camera is adjusted by the controller by controlling the rotation direction and angle of the ordinary sub-camera and the wide-angle sub-camera, and the size of the field of view of the camera is adjusted by the controller by controlling whether the wide-angle sub-camera is turned on; Acquire features of a target obstacle and perform feature extraction on the image; compare the extracted features with features of the target obstacle to determine whether the target obstacle exists in the image; the target obstacle is an object that affects driving safety; When the target obstacle exists in the image, controlling the display to display the high-definition processed image at a target refresh rate; When the target obstacle does not exist in the image, controlling the display to display the image after high-definition processing at an auxiliary refresh rate, the target refresh rate being greater than the auxiliary refresh rate; In which, the controller is used to control the display to display images at a frame length corresponding to any refresh rate when controlling the display to display images at the target refresh rate; the frame length corresponding to the target refresh rate is less than the frame length corresponding to the auxiliary refresh rate; the frame length is the display time of the same frame image captured by the camera, the refresh rate of the display is adjusted by adjusting the frame length, and in the process of adjusting the refresh rate of the display, the line length of the display and the frequency of the pixel clock signal are fixed.

2. The method according to claim 1, characterized in that The target refresh rate includes a first refresh rate and a second refresh rate, and the first refresh rate is greater than the second refresh rate; When a target obstacle exists in the image, controlling the display to display the image at a target refresh rate includes: When a target obstacle exists in the image, determining, based on multiple frames of images continuously captured by the camera, whether an absolute value of a relative speed of the target obstacle with respect to the vehicle is greater than a speed threshold; When the absolute value of the relative speed is greater than the speed threshold, controlling the display to display the image captured by the camera at the first refresh rate; When the absolute value of the relative speed is less than or equal to the speed threshold, the display is controlled to display the image captured by the camera at the second refresh rate.

3. The method according to claim 2, characterized in that Determining, based on multiple frames of images continuously captured by the camera, whether an absolute value of a relative speed between the target obstacle and the vehicle is greater than a speed threshold, includes: When the number of frames of the multiple frames of images containing the target obstacle is less than a number threshold, determining that the absolute value of the relative speed is greater than the speed threshold; When the number of frames of the multiple frames of images containing the target obstacle is greater than or equal to the number threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

4. The method according to claim 2, characterized in that Determining, based on multiple frames of images continuously captured by the camera, whether an absolute value of a relative speed between the target obstacle and the vehicle is greater than a speed threshold, includes: When there is a position change of the target obstacle in adjacent frame images in the multiple frame images that is greater than a target threshold, determining that the absolute value of the relative speed is greater than the speed threshold; When the position changes of the target obstacle in any adjacent frame images in the multiple frame images are less than or equal to the target threshold, it is determined that the absolute value of the relative speed is less than or equal to the speed threshold.

5. The method according to any one of claims 1 to 4, characterized in that: The target obstacle includes at least one of a person and a vehicle.

6. The method according to any one of claims 1 to 4, characterized in that: Controlling the camera to capture an image outside the vehicle includes: Based on the driving state of the vehicle, the camera is controlled to collect images within a camera field of view corresponding to the driving state.

7. The method according to any one of claims 1 to 4, characterized in that: The vehicle further includes an encoder and a decoder. After controlling the camera to capture an image outside the vehicle, the method further includes: Controlling the encoder to encode the image captured by the camera; Identifying the target obstacle based on the encoded image; The decoder is controlled to decode the encoded image, and the image displayed on the display is the decoded image.

8. A controller in a vehicle, characterized in that: The vehicle further includes: a camera and a display, the camera including a normal sub-camera and a wide-angle sub-camera, and the controller includes: a first control module, configured to control the camera to capture images outside the vehicle; the field of view of the camera is adjusted under the control of the controller, the position of the field of view of the camera is adjusted by the controller by controlling the rotation direction and angle of the ordinary sub-camera and the wide-angle sub-camera, and the size of the field of view of the camera is adjusted by the controller by controlling whether the wide-angle sub-camera is turned on; a fourth control module, configured to obtain features of a target obstacle and perform feature extraction on the image; compare the extracted features with features of the target obstacle to determine whether the target obstacle exists in the image; the target obstacle is an object that affects driving safety; a second control module, configured to control the display to display the image at a target refresh rate when a target obstacle exists in the image; a third control module, configured to control the display to display the image at an auxiliary refresh rate when the target obstacle does not exist in the image, the target refresh rate being greater than the auxiliary refresh rate; A fifth control module is used to control the display to display images at a frame length corresponding to any refresh rate when controlling the display to display images at the target refresh rate; the frame length corresponding to the target refresh rate is less than the frame length corresponding to the auxiliary refresh rate; the frame length is the display time of the same frame image captured by the camera, the refresh rate of the display is adjusted by adjusting the frame length, and in the process of adjusting the refresh rate of the display, the line length of the display and the frequency of the pixel clock signal are fixed.

9. A controller in a vehicle, characterized in that: The controller includes a processing unit and a storage unit, wherein the storage unit stores instructions, and the processing unit is configured to execute the instructions to implement the information display method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores instructions, and when the instructions are executed on a computer, the computer executes the information display method according to any one of claims 1 to 7.

11. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is enabled to execute the information display method according to any one of claims 1 to 7.

12. An information display system, characterized in that: The information display system includes: a controller, a camera and a display; the controller is the controller according to claim 8 or 9.

13. The information display system according to claim 12, characterized in that: The information display system further includes: an encoder and a decoder.

14. A vehicle, characterized in that: The vehicle includes a vehicle body, and the information display system according to claim 12 or 13, wherein the information display system is fixed to the vehicle body.

Images