Display control method and apparatus for vehicle, electronic device and storage medium
By obtaining driving-related information of vehicles and combining automotive radar and V2X technology, intelligently selecting and displaying the area images that need attention, solving the problem of single image switching method of display devices in the prior art, improving driving safety and user experience.
Patent Information
- Application Number
- PCT/CN2024/096637
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-01
- Filing Date
- 2024-05-31
- Publication Date
- 2024-12-05
AI Technical Summary
The display equipment of existing vehicles has a single image switching method during driving, which cannot meet users' viewing needs, lacks intelligence and flexibility, and cannot effectively monitor the driver's blind spots and surrounding environment.
By obtaining driving-related information of vehicles, determining the areas that need to be paid attention to, and controlling the display device to display the images collected by the image acquisition device in the corresponding area, realizing intelligent selection and display of images, combining automotive radar and V2X technology to obtain road conditions information, intelligently Select the camera image.
It improves the intelligence and flexibility of the display, meets users' viewing needs during driving, enhances the possibility of safe driving of vehicles, and reduces the risk of accidents.
Smart Images

Figure CN2024096637_05122024_PF_FP_ABST
Abstract
Description
Display control method and device for transportation, electronic device and storage medium Technical Field
[0001] The present disclosure relates to the field of intelligent transportation technology, and in particular to a display control method and device for a vehicle, an electronic device, and a storage medium. Background Art
[0002] Currently, vehicles such as passenger cars are equipped with multiple cameras, such as a front camera, a rear camera, a left blind spot camera, and a right blind spot camera. A display screen is set in the position of a traditional rearview mirror, or a display screen is installed in front of the driver to display the images obtained by the cameras installed on the vehicle.
[0003] Summary of the Invention
[0004] The present disclosure provides a display control method, apparatus, device, and storage medium for a vehicle.
[0005] A first aspect of the present disclosure provides a display control method for a vehicle, wherein the vehicle has a display device, and the method includes:
[0006] obtaining information related to driving of the vehicle;
[0007] determining an area requiring attention around the vehicle based on information related to driving of the vehicle;
[0008] Determining an image acquisition device that can acquire an image of the area requiring attention;
[0009] The display device is controlled to display the image captured by the determined image capture device.
[0010] A second aspect of the present disclosure provides a display control apparatus for a vehicle, wherein the vehicle has a display device, including:
[0011] An acquisition module, configured to acquire information related to the driving of the vehicle;
[0012] an area determination module, configured to determine an area requiring attention around a vehicle based on information related to the driving of the vehicle;
[0013] A device determining module, configured to determine an image acquisition device capable of acquiring an image of the area requiring attention;
[0014] The display module is used to control the display device to display the image captured by the determined image capture device.
[0015] A third aspect of the present disclosure provides an electronic device, including:
[0016] at least one processor;
[0017] a memory having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to the first aspect;
[0018] At least one I / O interface is connected between the processor and the memory and is configured to implement information interaction between the processor and the memory.
[0019] A fourth aspect of the present disclosure provides a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] FIG1 is a flow chart of a display control method for a vehicle according to an embodiment of the present disclosure;
[0021] FIG2 is a flow chart of a method for performing display control on a vehicle equipped with multiple image acquisition devices according to an embodiment of the present disclosure;
[0022] FIG3 is a schematic diagram of a scenario in which road condition information is detected by a car radar according to an embodiment of the present disclosure;
[0023] FIG4 a is a schematic diagram of a structure for selecting a camera image using information detected by a car radar according to an embodiment of the present disclosure;
[0024] FIG4 b is a schematic diagram of a process for intelligently selecting camera images using information detected by a car radar according to an embodiment of the present disclosure;
[0025] FIG5 is a schematic diagram of a scenario of obtaining road condition information through V2X according to an embodiment of the present disclosure;
[0026] FIG6 a is a schematic diagram of a structure for intelligently selecting camera images using V2X information according to an embodiment of the present disclosure;
[0027] FIG6 b is a schematic diagram of a process for intelligently selecting camera images using V2X information according to an embodiment of the present disclosure;
[0028] FIG7 is a schematic diagram of control logic for intelligently selecting camera images according to an embodiment of the present disclosure;
[0029] FIG8 is a schematic structural diagram of a display control device for a vehicle according to an embodiment of the present disclosure; and
[0030] FIG9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0031] The following describes the specific embodiments of the present disclosure in detail with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present disclosure and are not intended to limit the present disclosure.
[0032] As used in this disclosure, the term "and / or" includes any and all combinations of one or more of the associated listed items.
[0033] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the present disclosure.As used in the present disclosure, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
[0034] When the terms “comprising” and / or “made of…” are used in the present disclosure, it specifies the existence of the stated features, integers, steps, operations, elements and / or components, but does not preclude the existence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.
[0035] Unless otherwise defined, all terms (including technical and scientific terms) used in this disclosure have the same meanings as those commonly understood by those skilled in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning unless expressly defined in this disclosure.
[0036] The current method of selecting images from images captured by multiple cameras for display is not intelligent enough. The image of the front camera is displayed by default during vehicle driving, which cannot meet the user's viewing needs during vehicle driving.
[0037] In order to solve the problem that the display switching mode of the display device of a vehicle is single and cannot meet the needs of the user during driving, the embodiment of the present disclosure provides a display control method for a vehicle, which includes a car, a bus, a coach, a ship, etc. The display control method can be executed by a processing device installed on the vehicle, and the processing device can acquire images of the surrounding area of the vehicle and control the display device to display the images, and can obtain information related to the driving of the vehicle (such as left turn, right turn, driving speed, merging left, merging right, etc.). The processing device only needs to have software program processing capabilities, and there is no restriction on the specific implementation form. For example, the processing can be a central processing unit, a central control computer, a central control chip, etc.
[0038] FIG1 is a flow chart of a display control method for a vehicle according to an embodiment of the present disclosure. The vehicle has a display device. The method mainly includes steps 101 to 104 .
[0039] In step 101 , information related to driving of a vehicle is acquired.
[0040] In some embodiments, obtaining information related to driving of a vehicle includes at least one of the following steps: obtaining information about objects around the vehicle; obtaining driving operation information of the vehicle; and obtaining driving data information of the vehicle.
[0041] In some embodiments, obtaining information about objects around a vehicle includes at least one of the following: obtaining information about objects around the vehicle through a radar device; obtaining information about other vehicles around the vehicle through vehicle-to-vehicle (V2X) communication with other vehicles; obtaining information about objects around the vehicle through an image acquisition device. The image acquisition device may refer to an image acquisition device of another device or an image acquisition device installed on the vehicle itself. It should be noted that this is only an example, and other ways of obtaining information about objects around the vehicle are also included, such as information about objects around the vehicle obtained through the Internet of Things.
[0042] In some embodiments, obtaining vehicle driving operation information includes obtaining information regarding changes in the vehicle's driving direction or an impending change in direction. For example, information regarding a vehicle merging left, merging right, turning left, turning right, driving straight, or reversing is also provided. It should be noted that this is merely an example, and other methods for obtaining vehicle driving operation information are also encompassed.
[0043] In some embodiments, there are multiple ways to obtain driving data information of a vehicle, such as obtaining road condition information of the vehicle through the Internet of Things, including traffic light status, road maintenance information, road traffic congestion, etc.
[0044] In step 102 , an area requiring attention around the vehicle is determined based on information related to the driving of the vehicle.
[0045] In some embodiments, determining the area requiring attention around the vehicle based on information related to the driving of the vehicle includes at least one of the following: based on information about objects around the vehicle, determining an area where objects are located at a distance from the vehicle that is less than a preset threshold as an area requiring attention; based on driving operation information of the vehicle, determining an area to which the driving direction of the vehicle or the driving direction to be switched is pointed as an area requiring attention; based on driving data information of the vehicle, determining a real-time driving blind spot area of the vehicle (i.e., an area that the driver cannot observe through his line of sight, including an area that cannot be observed through the center rearview mirror and the side rearview mirror) as an area requiring attention; based on driving data information of the vehicle, determining an area to which the driving direction of the vehicle is pointed when the real-time physical speed exceeds a preset threshold as an area requiring attention; based on information about objects around the vehicle, determining an area where objects are located that are approaching the vehicle at a relative speed that exceeds the threshold as an area requiring attention.
[0046] It should be noted that this is just an example, and other areas where driving hazards may exist, areas with obstacles or other poor road conditions, etc. can all be determined as areas that require attention.
[0047] In some embodiments, obtaining information indicating that a vehicle is about to change direction includes obtaining information about the vehicle's turn signal. It should be noted that this is merely an example, and other information that can predict an impending change in direction is also included. For example, if the vehicle's lane is a left-turn, right-turn, or U-turn lane, this can also predict the vehicle's impending change in direction.
[0048] In some embodiments, based on the driving operation information of the vehicle, determining the area pointed by the driving direction of the vehicle or the driving direction to be switched to as the area that needs attention includes at least one of the following: based on the driving operation information of the vehicle, determining the area pointed by the merging direction of the vehicle as the area that needs attention; based on the driving operation information of the vehicle, determining the area where the turn indicator light of the vehicle is indicated as the area that needs attention.
[0049] For example, the left area where the vehicle points when merging left is determined as the area that needs attention; the right area where the vehicle points when merging right is determined as the area that needs attention; the left area where the left turn indicator light of the vehicle indicates the direction is determined as the area that needs attention; and the right area where the right turn indicator light of the vehicle indicates the direction is determined as the area that needs attention.
[0050] In some embodiments, determining the area requiring attention around the vehicle based on information related to the driving of the vehicle includes at least one of the following: obtaining relative position information of the objects around the vehicle and the vehicle based on information about objects around the vehicle, and determining the area where the objects fall into the monitoring area of the vehicle as the area requiring attention; obtaining relative position information of the objects around the vehicle and the vehicle based on information about objects around the vehicle, determining that the object does not fall into the monitoring area of the vehicle and the distance to the monitoring area is within a set range, and when the relative movement speed value of the vehicle and the object exceeds the set speed value, determining the monitoring area closest to the object as the area requiring attention.
[0051] In some embodiments, obtaining relative position information of objects around the vehicle and the vehicle based on information of objects around the vehicle includes: determining, based on the position information of objects around the vehicle and the position information of at least one monitoring area of the vehicle, that the relative position information of objects around the vehicle and the vehicle is at least one of the following: the objects around the vehicle fall within at least one monitoring area of the vehicle; the objects around the vehicle do not fall within any monitoring area of the vehicle, and the distance from at least one monitoring area of the vehicle is within a set range; the objects around the vehicle do not fall within any monitoring area of the vehicle, and the distance from any monitoring area of the vehicle is not within a set range.
[0052] Objects around a vehicle may be other vehicles (cars, electric vehicles, motorcycles, bicycles, ships, etc.), pedestrians, etc.
[0053] In some embodiments, obtaining information that the driving direction of a vehicle has changed or is about to change includes: obtaining information that the vehicle is reversing or is about to reverse; obtaining information that the vehicle is turning or is about to turn; obtaining information that the vehicle is merging or is about to merge.
[0054] In step 103, an image acquisition device that can acquire an image of the area requiring attention is determined.
[0055] There is no restriction on the format of images captured by the image acquisition device, including but not limited to video images. The format of video images is not limited to color, black and white, infrared, radar, etc.
[0056] In some embodiments, determining an image acquisition device that can capture images of an area requiring attention includes: determining the relative orientation of the area requiring attention and a vehicle; and determining the image acquisition device that captures images of the relative orientation as an image acquisition device whose range of captured images includes the area requiring attention.
[0057] For example, the relative position of the area requiring attention and the vehicle may be the left front, left, right front, right, left rear, rear, right rear, front, etc. of the vehicle.
[0058] In step 104 , the display device is controlled to display the image captured by the determined image capturing device.
[0059] There are many ways to display the image captured by the determined image acquisition device, such as turning off the display of images captured by other image acquisition devices and only displaying the image captured by the determined image acquisition device; flashing the image captured by the determined image acquisition device; displaying the image captured by the determined image acquisition device in a frame; superimposing corresponding text while displaying the image captured by the determined image acquisition device, etc.
[0060] The display device is installed in a position on the vehicle that is convenient for the driver to observe, for example, it can be installed in front of the driver or in the position of a traditional rearview mirror.
[0061] In some embodiments, controlling the display device to display the image captured by the determined image acquisition device includes at least one of the following: closing the currently displayed image and displaying the image captured by the determined image acquisition device; displaying the currently displayed image and the images captured by the determined image acquisition device in partitions; if there are multiple determined image acquisition devices, displaying the images captured by each of the determined image acquisition devices in partitions; if there are multiple determined image acquisition devices, displaying a portion of the images captured by each of the determined image acquisition devices according to the priority of each of the determined image acquisition devices.
[0062] In some embodiments, controlling the display device to display the image captured by the determined image acquisition device includes: controlling the display device to display the image captured by the determined image acquisition device in a prominent manner; obtaining and determining the area with the greatest possibility of a dangerous situation or the area with the highest priority of the dangerous situation in the area requiring attention, and controlling the display device to display the image of the area in a prominent manner; selecting locally important image blocks from the overall image captured by the determined image acquisition device, and controlling the display device to display the locally important image blocks.
[0063] In some embodiments, the display control method further includes: displaying an alarm message when it is determined that the currently acquired driving-related information of the vehicle meets a pre-set dangerous situation.
[0064] In some embodiments, when it is judged that the currently acquired driving-related information of the vehicle meets the predetermined dangerous situation, the displayed alarm information includes at least one of the following: judging based on the driving-related information of the vehicle that the physical distance between the vehicle and the surrounding objects is less than a preset threshold value, which meets the predetermined dangerous situation, and displaying the alarm information; judging based on the driving-related information of the vehicle that another vehicle or pedestrian appears in the driver's blind spot area around the vehicle (i.e., the area that the driver cannot observe through his line of sight, including the area that cannot be observed through the center rearview mirror and the side rearview mirror) which meets the predetermined dangerous situation, and displaying the alarm information; judging based on the driving-related information of the vehicle that the real-time physical speed of the vehicle exceeds the preset threshold value, which meets the predetermined dangerous situation, and displaying the alarm information; judging based on the driving-related information of the vehicle that the vehicle approaches the surrounding objects at a relative speed that exceeds the threshold value, which meets the predetermined dangerous situation, and displaying the alarm information.
[0065] It should be noted that if the currently acquired driving information of the vehicle is judged to meet the pre-defined dangerous situation, an audible alarm can also be issued. In addition to the audible alarm, it can also force the switch from manual driving to automatic driving, taking over the steering wheel and automatically driving to prevent dangerous behavior.
[0066] In the embodiment of the present disclosure, by obtaining information related to the driving of a vehicle, an area requiring attention around the vehicle is determined based on the information related to the driving of the vehicle, an image acquisition device that can acquire images of the area requiring attention is determined, and a display device is controlled to display images acquired by the determined image acquisition device. This allows the image acquired by the image acquisition device that is required to be viewed to be selected based on the information related to the driving of the vehicle, thereby meeting the viewing needs of the user during driving, improving the intelligence and flexibility of the monitoring display, and providing the possibility for safe driving of the vehicle.
[0067] FIG2 is a flow chart of a method for performing display control on a vehicle equipped with multiple image acquisition devices according to an embodiment of the present disclosure. As shown in FIG2 , the flow chart of the method for performing display control on a vehicle equipped with multiple image acquisition devices includes steps 201 to 203 .
[0068] In step 201 , road condition information of a road section where a vehicle is located is obtained, wherein the vehicle is provided with at least two image acquisition devices.
[0069] In some embodiments, traffic information about the road section on which a vehicle is located can be obtained in a variety of ways, such as through radar detection installed on the vehicle, or through interaction between a V2X module installed on the vehicle and the outside world (other nearby vehicles, etc.). It should be noted that these are merely examples, and other methods for obtaining such traffic information are also included, such as images captured by an active image acquisition device, or traffic information obtained through the Internet of Things.
[0070] In some embodiments, the vehicle is provided with at least two of the following image acquisition devices: a front image acquisition device, a rear image acquisition device, a left image acquisition device (which may include at least one of a left front image acquisition device and a left rear image acquisition device), and a right image acquisition device (which may include at least one of a right front image acquisition device and a right rear image acquisition device).
[0071] In some embodiments, obtaining traffic condition information for the road section on which the vehicle is located includes obtaining traffic condition information for a road section that matches the current driving behavior. For example, upon detecting a merging driver, traffic condition information for the road section on the vehicle's side of the merging direction is obtained; or upon detecting a turning driver, traffic condition information for the road section on the vehicle's side of the turning direction is obtained.
[0072] In step 202, an area requiring attention is determined based on the road condition information, wherein the area requiring attention is within a preset range centered on the vehicle.
[0073] In some embodiments, the road condition information includes relative position information between the vehicle and surrounding objects. Accordingly, determining the area requiring attention based on the road condition information includes: determining the area requiring attention based on the relative position information and position information of at least one monitored area of the vehicle.
[0074] In some embodiments, determining the area requiring attention based on the relative position information and the position information of at least one monitoring area of the vehicle includes: determining the positional relationship between surrounding objects and the at least one monitoring area based on the relative position information and the position information of at least one monitoring area of the vehicle, and selecting the area requiring attention from the at least one monitoring area based on the positional relationship.
[0075] In some embodiments, the positional relationship between the surrounding objects and at least one monitoring area is determined based on the relative position information and the position information of at least one monitoring area of the vehicle, including: performing the following processing for any monitoring area: when it is determined that the surrounding objects fall within the range of the monitoring area based on the relative position information and the position information of the monitoring area, the positional relationship between the surrounding objects and the monitoring area is determined to be "belonging to"; when it is determined that the surrounding objects do not fall within the range of the monitoring area based on the relative position information and the position information of the monitoring area, and the distance between the surrounding objects and the monitoring area is within a set range, the positional relationship between the surrounding objects and the monitoring area is determined to be "adjacent"; when it is determined that the surrounding objects do not fall within the range of the monitoring area based on the relative position information and the position information of the monitoring area, and the distance between the surrounding objects and the monitoring area is within or outside the set range, the positional relationship between the surrounding objects and the monitoring area is determined to be "not belonging to and not adjacent".
[0076] Accordingly, based on the positional relationship, an area requiring attention is selected from at least one monitoring area, including but not limited to the two cases listed below. One of the following two cases can be selected to obtain the area requiring attention, or the results selected from the following two cases can be used together as the final area requiring attention:
[0077] Case 1: From at least one monitoring area, a monitoring area with a position relationship of "belongs" is selected as an area requiring attention.
[0078] Case 2: From at least one monitoring area, select a monitoring area with a "nearby" position relationship, obtain the relative movement speed value of the surrounding objects and vehicles, and when the relative movement speed value exceeds the set speed value, the selected monitoring area will be regarded as an area that needs attention.
[0079] The surrounding objects can be other vehicles (cars, electric vehicles, motorcycles, bicycles, ships, etc.), pedestrians, etc.
[0080] In step 203, an image captured in real time by an image capture device for capturing an area requiring attention is acquired and displayed.
[0081] The display screen used to display the image captured by the image capture device in real time is installed in a position on the vehicle that is convenient for the driver to observe, for example, it can be installed in front of the driver or at the position of a traditional rearview mirror.
[0082] In some embodiments, when the number of areas requiring attention is at least two, at least two image acquisition devices corresponding to the at least two areas requiring attention are determined, and images acquired in real time by the at least two image acquisition devices are simultaneously displayed in different display areas of the display screen.
[0083] In some embodiments, the acquisition and display of real-time images captured by an image acquisition device used to capture areas of concern also includes the issuance of an audible alarm to alert the driver to the presence of danger in the area of concern. In addition to the audible alarm, the system can also forcibly switch from manual to automated driving, taking over the steering wheel to prevent dangerous behavior.
[0084] Figure 3 is a schematic diagram of a scenario in which a vehicle radar detects road condition information according to an embodiment of the present disclosure. The process of intelligently selecting camera images based on the information detected by the vehicle radar is as follows.
[0085] When Car A's radar (Radar A) detects Car B approaching from the right rear of Car A, Car A's central control computer analyzes the information detected by Radar A and intelligently activates Car A's right-side camera (or the right blind spot camera that images the driver's right blind spot), namely Camera A, and displays the image from this camera (Camera A) on the display in front of the driver. If necessary, an appropriate sound alarm can be issued to alert the driver of the oncoming vehicle to his or her right rear.
[0086] Figure 4a is a schematic diagram of a structure for selecting camera images using information detected by a vehicle's radar, according to an embodiment of the present disclosure. As shown in Figure 4a, the radar, camera, and display are each connected to a central control computer. Each of these operates under the control of the central control computer, which acquires radar detection information, analyzes it, activates the camera, and displays it on the display.
[0087] FIG4 b is a schematic diagram of a process for intelligently selecting camera images using information detected by a car radar according to an embodiment of the present disclosure, wherein the process includes steps 401 to 405 .
[0088] In step 401, a radar installed on a car detects road condition information. For example, the road condition information indicates that there is an oncoming vehicle behind the right side of the car.
[0089] In step 402, the radar transmits the road condition information to the central control computer.
[0090] In step 403, the central control computer analyzes the road condition information transmitted by the radar and determines the camera that needs to be turned on based on the analysis result.
[0091] In step 404, the central control computer generates a command to turn on the camera, sends the command to the camera to be turned on, and controls the camera to turn on. This step is optional and is not required if the selected camera is already turned on.
[0092] In step 405, the central control computer sends a display command to the display screen to control the display screen to display the image of the camera.
[0093] FIG5 is a schematic diagram of a scenario in which road condition information is obtained through V2X according to an embodiment of the present disclosure. The process of intelligently selecting camera images based on the road condition information obtained through V2X is as follows.
[0094] When the distance between Car A and Car B falls below a certain distance (the effective V2X communication range), Car A and Car B begin communicating via V2X. Car A's central control computer analyzes the information obtained through V2X communication and determines that a vehicle (Car B) is approaching from behind Car A's right. At this point, Car A's central control computer intelligently activates Car A's right-side camera (or the right blind spot camera that captures the driver's right blind spot), namely Camera A, and displays the image from this camera (Camera A) on the display in front of the driver. If necessary, an appropriate audible alarm can be issued to alert the driver of the oncoming vehicle.
[0095] Figure 6a is a schematic diagram of a method for intelligently selecting camera images using V2X information, according to an embodiment of the present disclosure. As shown in Figure 6a, in vehicle A, the V2X module (V2X-A), camera, and display are each connected to a central control computer. Each of these functions operates under the control of the central control computer. Vehicle A's V2X-A exchanges information with vehicle B's V2X module (V2X-B). Vehicle A's central control computer analyzes the information exchanged between V2X-A and V2X-B, activates the camera, and displays the information on the display.
[0096] FIG6 b is a schematic diagram of a process for intelligently selecting camera images using V2X information according to an embodiment of the present disclosure, wherein the process includes steps 601 to 605 .
[0097] In step 601, the V2X of the own vehicle communicates with the V2X of another vehicle to obtain the relative position information of the two vehicles.
[0098] In step 602, the vehicle's V2X sends the relative position information to the central control computer.
[0099] In step 603, the central control computer analyzes and processes the relative position information.
[0100] In step 604, the central control computer sends a command based on the analysis result to turn on a camera. If the camera is already turned on, this step is omitted.
[0101] In step 605, the central control computer controls the display screen to display the image captured by the camera.
[0102] Figure 7 is a schematic diagram of the control logic for intelligently selecting camera images according to an embodiment of the present disclosure. As shown in Figure 7, on-board sensors such as vehicle radar and V2X are used to detect the presence of other vehicles around the vehicle, as well as the relative distance and speed of the other vehicle to the vehicle. This embodiment uses the presence of another vehicle to the right of the vehicle as an example. The control logic for other vehicles to the left of the vehicle is similar. If there is at least one other vehicle within the range (-20 meters, +5 meters) to the right of the vehicle (i.e., within 20 meters to the right rear of the vehicle and within 5 meters to the right front of the vehicle, including those parallel to the vehicle), the camera image of the right side of the vehicle is displayed. If there is no other vehicle within this range, the system checks to see if there is another vehicle within the range (-50 meters, -20 meters) to the right of the vehicle (i.e., between 20 and 50 meters to the right rear of the vehicle) with a relative speed greater than +2 meters per second (i.e., the other vehicle is traveling in the same direction as the vehicle but at least 2 meters per second faster than the vehicle). If so, the camera image of the right side of the vehicle is displayed. If not, the camera image of the right side of the vehicle is not displayed. It is worth noting that if it is determined according to this control flow that both the images of the right camera and the left camera should be displayed, the display screen can be divided into left and right halves to display the images of the left and right cameras respectively.
[0103] In some embodiments, obtaining the road condition information of the road section where the vehicle is located includes: obtaining the road condition information of the road section that matches the current driving behavior. After obtaining the road condition information that matches the current driving behavior, the image of the image acquisition device that matches the driving behavior can be directly displayed. For example, after monitoring the driving behavior of merging, the road condition information of the road section on the side of the vehicle in the merging direction is obtained, or after detecting the driving behavior of turning, the road condition information of the road section on the side of the vehicle in the turning direction is obtained. After monitoring the driving behavior of merging, the image of the camera on the side of the merging direction is directly displayed. For example, if merging to the left, the image of the camera used to capture the left area of the vehicle is directly displayed; if merging to the right, the image of the camera used to capture the right area of the vehicle is directly displayed; after monitoring the driving behavior of turning, the image of the camera on the side of the turning direction is directly displayed. For example, if turning to the left, the image of the camera used to capture the left area of the vehicle is directly displayed; if turning to the right, the image of the camera used to capture the right area of the vehicle is directly displayed.
[0104] The display control method provided by the embodiment of the present disclosure is different from the existing display control method in which the image of the wide-angle camera in front of the vehicle is displayed by default, and the switching method of displaying the image of the camera behind the vehicle when reversing is used. It can select a matching area that needs attention from a preset range centered on the vehicle according to the road condition information of the section where the vehicle is located, and display the image of the image acquisition device of the area that needs attention, so as to realize intelligent selection and display of images, meet the viewing needs of users during driving, improve the intelligence and flexibility of the display, and provide possibilities for safe driving of vehicles.
[0105] By utilizing some new technologies that have emerged in the trend of intelligent and electronic vehicles, such as combining emerging technologies such as automotive radar and V2X with the needs of automotive intelligent control and intelligent display, a display control method for vehicles is provided. The disclosed embodiment can fully utilize the information obtained by various sensors of the vehicle, analyze and process it through processing equipment such as the central control computer in the vehicle, and intelligently turn on or off or switch the display of camera images, greatly improving the driver's comfort, safety and driving experience, and improving driving safety, which can further reduce the accident rate. For example, in certain specific dangerous situations, such as when it is detected that the driver plans to merge or turn, and there are other vehicles or pedestrians in the blind spot or on the side of the vehicle, by switching the displayed camera image, the driver can pay attention to the dangerous area in time, and further alarm prompts can be issued to provide protection for safe driving, enhance the driver's driving experience, and effectively avoid some dangerous driving situations, thereby improving road safety.
[0106] The display control method in the embodiment of the present disclosure is applied to vehicles including but not limited to family cars, buses, engineering vehicles, trucks, motorcycles, etc., and can also be applied to various types of ships. This is only an example, and the possibility of application to other vehicles is not excluded.
[0107] The steps of the various methods above are divided only for clarity of description. During implementation, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this disclosure. Adding insignificant modifications or introducing insignificant designs to the algorithm or process without changing the core design of the algorithm and process are all within the scope of protection of this disclosure.
[0108] In an embodiment of the present disclosure, a display control device for a vehicle is provided. The vehicle has a display device. The specific implementation of the display control device can be found in the relevant description of the method embodiment and will not be repeated here. FIG8 shows a schematic structural diagram of the display control device. As shown in FIG8, the display control device includes: an acquisition module 801, a region determination module 802, a device determination module 803, and a display module 804.
[0109] The acquisition module 801 is used to acquire information related to the driving of a vehicle.
[0110] The area determination module 802 is used to determine an area around the vehicle that requires attention based on information related to the driving of the vehicle.
[0111] The device determination module 803 is used to determine an image acquisition device that can acquire an image of the area requiring attention.
[0112] The display module 804 is used to control the display device to display the image captured by the determined image capture device.
[0113] The functions or modules included in the apparatus provided in the embodiments of the present disclosure can be used to execute the method described in the method embodiments. The specific implementation and technical effects thereof can be referred to the description of the above method embodiments, and will not be repeated here for the sake of brevity.
[0114] It should be noted that all modules involved in this embodiment are logical modules. In practical applications, a logical unit can be a physical unit, a portion of a physical unit, or a combination of multiple physical units. Furthermore, to highlight the innovations of this disclosure, this embodiment does not include units that are not closely related to solving the technical problems proposed by this disclosure. However, this does not mean that other units do not exist in this embodiment.
[0115] FIG9 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Referring to FIG9 , an electronic device according to an embodiment of the present disclosure includes: at least one processor 901 , a memory 902 , and at least one I / O interface 903 .
[0116] At least one program is stored in the memory 902 . When the at least one program is executed by the at least one processor 901 , the at least one processor 901 implements the above-mentioned display control method.
[0117] At least one I / O interface 903 is connected between the at least one processor 901 and the memory 902 , and is configured to implement information interaction between the at least one processor 901 and the memory 902 .
[0118] At least one processor 901 is a device with data processing capabilities, including but not limited to a central processing unit (CPU). Memory 902 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically, SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH). At least one I / O interface (read / write interface) 903 is connected between the processor 901 and the memory 902 to enable information exchange between the at least one processor 901 and the memory 902, including but not limited to a data bus.
[0119] In some embodiments, at least one processor 901 , memory 902 , and at least one I / O interface 903 are connected to each other via a bus, and further connected to other components of the computing device.
[0120] This embodiment further provides a computer-readable medium on which a computer program is stored. When the program is executed by a processor, the method provided in this embodiment is implemented. To avoid repeated description, the specific steps of the method are not repeated here.
[0121] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods applied for above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0122] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.
[0123] Those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features from different embodiments is meant to be within the scope of the present embodiment and to form different embodiments.
[0124] It is understood that the above embodiments are merely exemplary embodiments for illustrating the principles of the present disclosure, and the present disclosure is not limited thereto. Those skilled in the art may make various modifications and improvements without departing from the spirit and substance of the present disclosure, and such modifications and improvements are also considered to be within the scope of protection of the present disclosure.
Claims
1. A display control method for a vehicle, wherein the vehicle has a display device, the method comprising: Acquiring information related to driving of the vehicle; determining an area of concern around the vehicle based on information related to driving of the vehicle; Determine an image acquisition device that can acquire an image of the area requiring attention; as well as The display device is controlled to display the image captured by the determined image capture device.
2. The display control method for a vehicle according to claim 1, wherein: Acquiring information related to the driving of the vehicle includes at least one of the following: Acquiring information about objects around the vehicle; Acquiring driving operation information of the vehicle; Acquire driving data information of the vehicle.
3. The display control method for a vehicle according to claim 2, wherein: Determining the area around the vehicle that needs attention based on the information related to the driving of the vehicle includes at least one of the following: According to the information of the objects around the vehicle, an area where there are objects whose distance from the vehicle is less than a preset threshold is determined as an area requiring attention; According to the driving operation information of the vehicle, determining the area pointed by the driving direction of the vehicle or the driving direction to be switched to as an area requiring attention; According to the driving data information of the vehicle, determining the real-time driving blind spot area of the vehicle as an area requiring attention; According to the driving data information of the vehicle, the area to which the driving direction of the vehicle points when the real-time physical speed exceeds a preset threshold is determined as an area requiring attention; as well as According to the information of the objects around the vehicle, the objects that exist around the vehicle The area of the object approaching at a relative speed exceeding the threshold is determined as the area requiring attention.
4. The display control method for a vehicle according to claim 1, wherein: The image acquisition device that determines that the image of the area requiring attention can be acquired includes: Determining the relative position of the area requiring attention and the vehicle; The image acquisition device that acquires the image of the relative orientation is determined to be an image acquisition device whose image acquisition range includes the area requiring attention.
5. The display control method for a vehicle according to claim 1, wherein: Controlling the display device to display the image acquired by the determined image acquisition device includes at least one of the following: Close the currently displayed image and display the image acquired by the determined image acquisition device; Displaying the currently displayed image and the image acquired by the determined image acquisition device in partitions; When there are multiple determined image acquisition devices, the images acquired by each determined image acquisition device are displayed in sections; When there are multiple determined image acquisition devices, images acquired by a portion of the determined image acquisition devices are displayed according to the priority of each of the determined image acquisition devices.
6. The display control method for a vehicle according to claim 1, wherein: Controlling the display device to display the image acquired by the determined image acquisition device comprises: Controlling the display device to display the image captured by the determined image acquisition device in a prominent manner; Acquire and determine the area with the greatest possibility of a dangerous situation or the area with the highest priority of dangerous situations in the area requiring attention, and control the device to display an image of the area in a prominent manner; Select a locally important image block from the overall image acquired by the determined image acquisition device, and control the display device to display the locally important image block.
7. The display control method for a vehicle according to claim 1, further comprising: When it is determined that the currently acquired driving-related information of the vehicle meets the pre-set dangerous situation, an alarm message is displayed.
8. The display control method for a vehicle according to claim 2, wherein: Acquiring information about objects around the vehicle includes at least one of the following: Acquiring information about objects around the vehicle by using a radar device; Acquire information of other vehicles around the vehicle through V2X communication with other vehicles; The information of objects around the vehicle is obtained through an image acquisition device.
9. The display control method for a vehicle according to claim 2, wherein: Acquiring the driving operation information of the vehicle includes: The information that the driving direction of the vehicle has changed or is about to change is obtained.
10. The display control method for a vehicle according to claim 9, wherein: Obtaining information about the vehicle's driving direction to be changed, including: Obtain turn signal information of the vehicle.
11. The display control method for a vehicle according to claim 9, wherein: Acquiring information that the driving direction of the vehicle has changed or is about to change, including: Obtaining information that the vehicle is reversing or about to reverse; Obtain information about the vehicle turning or about to turn The information of the vehicle merging or about to merge is obtained.
12. The display control method for a vehicle according to claim 3, wherein: Determining, according to the driving operation information of the vehicle, the area pointed by the driving direction of the vehicle or the driving direction to be switched to as the area requiring attention includes at least one of the following: According to the driving operation information of the vehicle, determining the area pointed by the merging direction of the vehicle as the area requiring attention; According to the driving operation information of the vehicle, an area where the direction indicated by the turn indicator light of the vehicle is located is determined as an area requiring attention.
13. The display control method for a vehicle according to claim 2, wherein: Determining the area around the vehicle that needs attention based on the information related to the driving of the vehicle includes at least one of the following: According to the information of the objects around the vehicle, the relative position information of the objects around the vehicle and the vehicle is obtained, and the area where the objects falling into the monitoring area of the vehicle are located is determined as the area requiring attention; Based on the information of objects around the vehicle, the relative position information of the objects around the vehicle and the vehicle is obtained to determine that the object has not fallen into the monitoring area of the vehicle and the distance from the monitoring area is within a set range. When the relative movement speed value of the vehicle and the object exceeds the set speed value, the monitoring area closest to the object is determined as the area that needs attention.
14. The display control method for a vehicle according to claim 13, wherein: According to the information of the object around the vehicle, obtaining the relative position information of the object around the vehicle and the vehicle includes: According to the position information of the objects around the vehicle and the position information of at least one monitoring area of the vehicle, it is determined that the relative position information of the objects around the vehicle and the vehicle is at least one of the following: An object around the vehicle falls into at least one monitoring area of the vehicle; The objects around the vehicle do not fall into any monitoring area of the vehicle, and the distance from at least one monitoring area of the vehicle is within a set range; Objects around the vehicle do not fall into any monitoring area of the vehicle and the distance to any monitoring area of the vehicle is not within the set range.
15. A display control device for a vehicle, the vehicle having a display device, the display control device comprising: an acquisition module, configured to acquire information related to the driving of the vehicle; An area determination module, configured to determine an area around a vehicle that needs attention based on information related to driving of the vehicle; A device determining module, configured to determine an image acquisition device that can acquire an image of the area requiring attention; as well as The display module is configured to control the display device to display the image captured by the determined image capture device.
16. An electronic device, comprising: at least one processor; A memory having one or more programs stored thereon, which, when the one or more programs are executed by the one or more processors, enables the one or more processors to implement the display control method according to any one of claims 1 to 14; At least one I / O interface is connected between the at least one processor and the memory, and is configured to implement information interaction between the at least one processor and the memory.
17. A computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the display control method according to any one of claims 1 to 14.
Citation Information
Patent Citations
AR-HUD display method and system fusing V2X information
CN111731101A
Vehicle blind area detection method and device, electronic equipment and storage medium
CN113022441A
Vehicle auxiliary driving method and device, electronic equipment and storage medium
CN115123283A
Display method and display system for head-up display device of vehicle
CN117922440A
VEHICLE DISPLAY DEVICE, VEHICLE DISPLAY CONTROL SYSTEM AND VEHICLE DISPLAY CONTROL METHOD
DE102020135098A1
