Content display method and system, vehicle, and electronic device

Abstract

A content display method and system, a vehicle, and an electronic device, relating to the field of image display. The method comprises: displaying a first display picture corresponding to a first field of view range; detecting whether external traveling environment information of a vehicle satisfies a preset condition; and when the external traveling environment information of the vehicle satisfies the preset condition, displaying a third display picture, wherein the third display picture comprises the first display picture and a second display picture corresponding to a second field of view range, and the second field of view range is different from the first field of view range.

Description

Content display method, system, vehicle and electronic device

[0001] The present disclosure claims priority to the Chinese patent application No. 2024108709096, filed on June 28, 2024, and entitled "Content display method, system, vehicle and electronic device", the entire content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] Embodiments of the present application relate to the field of image display, in particular, to a content display method, system, vehicle and electronic device. BACKGROUND

[0003] With the continuous development of electronic and intelligent vehicles, the electronic rearview mirror (Camera Monitor System, CMS) is gradually replacing the traditional optical rearview mirror. Compared with the traditional optical rearview mirror, the electronic rearview mirror has the advantages of wider field of view, reduced blind area, automatic light compensation, less environmental impact, and can effectively reduce wind resistance and wind noise, and achieve energy saving and emission reduction.

[0004] However, under the premise of considering focal length and depth of field, in order to make the rearview mirror meet the safety requirements, the electronic rearview mirror usually matches with an ordinary camera with small field of view but larger focal length for image acquisition, which makes it difficult for the electronic rearview mirror to quickly and efficiently realize multi-angle observation of different field of view ranges in scenarios requiring larger field of view ranges. Therefore, how to conveniently, quickly and efficiently display image information of different field of view ranges has become a problem to be solved in the field. SUMMARY

[0005] Embodiments of the present application provide a content display method, system, vehicle and electronic device, aiming to solve the problem of how to conveniently, quickly and efficiently display image information of different field of view ranges.

[0006] In a first aspect, the present application provides a content display method, comprising:

[0007] displaying a first display picture of a first field of view range;

[0008] detecting whether a driving environment information outside the vehicle meets a preset condition;

[0009] in a case where the driving environment information outside the vehicle meets the preset condition, displaying a third display picture, the third display picture comprising the first display picture and a second display picture of a second field of view range, the second field of view range being different from the first field of view range.

[0010] In an optional implementation, the detection of whether the out-of-vehicle driving environment information meets the preset condition comprises at least one of the following:

[0011] The detection of whether the out-of-vehicle driving environment information represents that the current position of the vehicle is in the target region.

[0012] The detection of whether the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle.

[0013] The detection of whether the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle, and the target object does not exist in the first display picture.

[0014] In an optional implementation, the second field of view range is greater than the first field of view range; and the detection of whether the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle comprises:

[0015] The detection of whether the target object exists in the second display picture of the second field of view range.

[0016] In an optional implementation, the method further comprises:

[0017] Obtaining display mode information of the second display picture, the display mode information comprising at least one of the following: transmittance, superimposed position;

[0018] Superimposing the second display picture on the first display picture according to the display mode information to obtain the third display picture.

[0019] In an optional implementation, the first display picture is obtained based on a first image of a first view angle;

[0020] Before displaying the third display picture, the method further comprises:

[0021] Obtaining a second image of a second view angle;

[0022] Adjusting the view angle of the second image based on the first view angle to obtain a second image after view angle adjustment;

[0023] Obtaining a second display picture based on the second image after view angle adjustment.

[0024] In an optional implementation, the method further comprises:

[0025] Obtaining a display parameter value of the second display picture, the display parameter value comprising at least one of the following: display size, display shape, and clipping position;

[0026] Obtaining a second display picture based on the second image after view angle adjustment, comprising:

[0027] According to the display parameter value, the second image adjusted based on the perspective is cropped to obtain a second display picture.

[0028] In an optional implementation, after the third display picture is displayed, the method further includes:

[0029] In a case where the out-of-vehicle driving environment information does not satisfy the preset condition, the first display picture is displayed again.

[0030] In an optional implementation, the display mode of the second display picture includes a superimposed position.

[0031] The superimposed position of the second display picture is obtained, including:

[0032] In a case where the out-of-vehicle driving environment information indicates that a current position of the vehicle is within a target area, the superimposed position is determined as a first superimposed position.

[0033] In a case where the out-of-vehicle driving environment information indicates that there is another vehicle within a preset range of the vehicle, the superimposed position is determined as a second superimposed position, and the second superimposed position is different from the first superimposed position.

[0034] In an optional implementation, the method further includes:

[0035] In response to a triggering operation of a user, a third display picture is displayed, the third display picture including the first display picture and a second display picture of a second field of view range, and the second field of view range is different from the first field of view range.

[0036] In an optional implementation, in a case where the out-of-vehicle driving environment information indicates that there is a target object within a preset range of the vehicle, and the target object does not exist in the first display picture, after the third display picture is displayed, the method further includes:

[0037] A distance between the target object and the vehicle is detected.

[0038] During the distance being greater than a preset distance threshold, a display area of the second display picture in the third display picture is adjusted according to the detected distance.

[0039] In a case where the distance is less than the preset distance and / or a proportion of the display area of the second display picture in the third display picture is greater than a preset proportion, the first display picture is displayed again.

[0040] In an optional implementation, after the third display picture is displayed, the method further includes:

[0041] obtaining a relative position reference of the first display picture and the second display picture along a target direction;

[0042] performing display adjustment on the first display picture and the second display picture respectively in response to a display adjustment operation of a user, the display adjustment comprising at least one of the following: angle adjustment, display picture zoom-in, display picture zoom-out, display picture keeping unchanged;

[0043] obtaining a corresponding third display picture based on the first display picture after display adjustment and the second display picture after display adjustment according to the relative position reference.

[0044] In an alternative implementation, after displaying the third display picture, the method further comprises:

[0045] obtaining a relative position reference of the first display picture and the second display picture along a target direction;

[0046] performing display adjustment on the first display picture and the second display picture synchronously in response to a display adjustment operation of a user, the display adjustment comprising at least one of the following: angle adjustment, display picture zoom-in, display picture zoom-out;

[0047] obtaining a corresponding third display picture based on the first display picture after display adjustment and the second display picture after display adjustment according to the relative position reference and the relative proportion.

[0048] In an alternative implementation, the display adjustment comprises at least one of the following: display picture zoom-in, display picture zoom-out; the first display picture is obtained based on a first image within a first viewfinder window, and the second display picture is obtained based on a second image within a second viewfinder window; performing display adjustment on the first display picture and the second display picture synchronously in response to a display adjustment operation of a user comprises:

[0049] performing adjustment on the first viewfinder window and the second viewfinder window synchronously in response to a display adjustment operation of a user.

[0050] In an alternative implementation, the display adjustment comprises: angle adjustment; the first display picture is obtained based on a first image captured by a first image capturing device, and the second display picture is obtained based on a second image captured by a second image capturing device; performing display adjustment on the first display picture and the second display picture synchronously in response to a display adjustment operation of a user comprises:

[0051] performing adjustment on the field of view of the first image capturing device and the field of view of the second image capturing device synchronously in response to a display adjustment operation of a user.

[0052] In an optional implementation, the second display picture has a higher definition than the first display picture; and / or

[0053] The second field of view is smaller than the first field of view.

[0054] In an optional implementation, after displaying the third display picture, the method further includes:

[0055] In response to a user's moving operation on the second display picture, adjusting the position of the second display picture in the third display picture, and / or adjusting the second field of view.

[0056] The second aspect of the embodiments of the present application provides a content display system, which at least includes: a display device, a first image acquisition device, a second image acquisition device, and a controller;

[0057] The first image acquisition device is configured to acquire a first image of a first field of view.

[0058] The second image acquisition device is configured to acquire a second image of a second field of view, the second field of view being different from the first field of view.

[0059] The controller is configured to generate a first display picture based on the first image, generate a second display picture based on the second image, control the display device to display the first display picture, and detect whether a driving environment information outside the vehicle satisfies a preset condition; in a case where the driving environment information outside the vehicle satisfies the preset condition, control the display device to display a third display picture, the third display picture including the first display picture and the second display picture.

[0060] In an optional implementation, the system further includes at least one of the following:

[0061] A distance sensor configured to detect a distance between a target object and the vehicle.

[0062] A position sensor configured to acquire a current position of the vehicle.

[0063] In an optional implementation, the system further includes:

[0064] A third image acquisition device, a field of view of the third image acquisition device being smaller than a field of view of the second image acquisition device, and a definition of a second image acquired by the third image acquisition device being higher than a definition of a second image acquired by the second image acquisition device.

[0065] The controller is configured to control the third image acquisition device to acquire an image when the distance is greater than a preset distance threshold.

[0066] In an alternative implementation, the system further comprises:

[0067] The touch device is configured to receive a triggering operation of a user and generate a triggering instruction based on the triggering operation and send the triggering instruction to the controller.

[0068] The controller is configured to control the display device to display the third display screen in response to the triggering instruction.

[0069] In an alternative implementation, the touch device is a master control screen.

[0070] In an alternative implementation, the display device is a rearview mirror display screen.

[0071] The third aspect of the embodiments of the present application provides a vehicle, the vehicle comprising a controller, the controller being configured to perform the steps of the content display method according to any one of the first aspect of the embodiments of the present application.

[0072] The fourth aspect of the embodiments of the present application provides an electronic device, the electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions being executed by the processor to implement the steps of the content display method according to any one of the first aspect of the embodiments of the present application. Advantages:

[0073] The embodiments of the present application provide a content display method, system, vehicle and electronic device, the method comprising: displaying a first display screen of a first field of view; detecting whether vehicle external driving environment information meets a preset condition; and displaying a third display screen when the vehicle external driving environment information meets the preset condition, the third display screen comprising the first display screen and a second display screen of a second field of view, the second field of view being different from the first field of view. The embodiments of the present application pre-acquire the first display screen and the second display screen of different fields of view, and combine the first display screen and the second display screen to display the third display screen when the vehicle meets the preset condition, so that the vehicle can automatically display the display screen of different fields of view under the preset condition, and the driver can conveniently and quickly and efficiently acquire the image information of different fields of view by directly observing the third display screen, thereby improving the driving experience.

[0074] The above description is only a summary of the technical solutions of the present application. In order to make the technical means of the present application more clearly understood and implemented according to the content of the description, and in order to make the above and other purposes, characteristics and advantages of the present application more obvious and easy to understand, the following will specifically describe the embodiments of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0075] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings needed to be used in the embodiment or related technology description. Obviously, the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to these drawings without creating any creative labor.

[0076] Fig. 1 is a schematic diagram of the field of view range of a main outside mirror according to an embodiment of the present application;

[0077] Fig. 2 is a schematic diagram of the field of view range of a wide-angle outside rearview mirror according to an embodiment of the present application;

[0078] Fig. 3 is a schematic diagram of the step flow of a content display method according to an embodiment of the present application;

[0079] Fig. 4 is a schematic diagram of the processing flow of a content display method according to an embodiment of the present application;

[0080] Fig. 5 is a schematic diagram of a first display picture according to an embodiment of the present application;

[0081] Fig. 6 is a schematic diagram of a third display picture according to an embodiment of the present application;

[0082] Fig. 7 is a schematic diagram of acquiring a first display picture based on a first image according to an embodiment of the present application;

[0083] Fig. 8 is a schematic diagram of the processing flow of a content display method for generating a second display picture with different superimposed positions according to an embodiment of the present application;

[0084] Fig. 9 is a schematic diagram of a second display picture displayed at a first superimposed position according to an embodiment of the present application;

[0085] Fig. 10 is a schematic diagram of a second display picture displayed at a second superimposed position according to an embodiment of the present application;

[0086] Fig. 11 is a schematic diagram of the processing flow of a content display method for generating a second display picture with different display areas according to an embodiment of the present application;

[0087] Fig. 12 is a schematic diagram of respectively displaying adjustment of a first display picture and a second display picture according to an embodiment of the present application;

[0088] FIG. 13a is a schematic diagram of an adjustment before a first display screen and a second display screen are synchronously displayed according to an embodiment of the present application;

[0089] FIG. 13b is a schematic diagram of an adjustment after a first display screen and a second display screen are synchronously displayed according to an embodiment of the present application;

[0090] FIG. 14a is a schematic diagram of an adjustment before a position of a second display screen is adjusted according to an embodiment of the present application;

[0091] FIG. 14b is a schematic diagram of an adjustment during a position of a second display screen is adjusted according to an embodiment of the present application;

[0092] FIG. 14c is a schematic diagram of an adjustment after a position of a second display screen is adjusted according to an embodiment of the present application;

[0093] FIG. 15a is a schematic diagram of a position of a second display screen and a second field of view before adjustment according to an embodiment of the present application;

[0094] FIG. 15b is a schematic diagram of a position of a second display screen and a second field of view after adjustment according to an embodiment of the present application;

[0095] FIG. 16 is a schematic diagram of a position of a second display screen adjusted in a preset superimposed area according to an embodiment of the present application;

[0096] FIG. 17 is a schematic diagram of a system architecture according to an embodiment of the present application;

[0097] FIG. 18 is a schematic diagram of a content display system according to an embodiment of the present application;

[0098] FIG. 19 is a schematic diagram of a vehicle-mounted display screen according to an embodiment of the present application;

[0099] FIG. 20 is a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0100] In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the following will be combined with the accompanying drawings for the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0101] In the drawings, the size, the thickness of a layer, or a region of a constituent element shown in some cases can be exaggerated for the purpose of making the present disclosure clear. Therefore, the present disclosure is not necessarily limited to the size, the shape of a component shown in the drawings and the actual scale. Further, the drawings schematically show ideal examples, and the present disclosure is not limited to the shape or numerical value shown in the drawings.

[0102] During driving, it is often necessary to provide various indirect view devices on the vehicle to provide real-time image information of different viewing angles and / or viewing ranges for the driver and passengers, so as to help the driver and passengers better understand the current state of the vehicle based on the image information displayed by the indirect view device without changing the driving line of sight, enrich the information acquisition of the driver and passengers, and thus drive more safely. The indirect view device generally refers to an optical physical mirror, which reflects light of each viewing range into the eyes of the driver and passengers through optical reflection principle, and the driver sees the image information in the corresponding viewing range in the optical physical mirror.

[0103] Conventional indirect view devices are classified into I-class mirrors (inside mirrors), II-class and III-class mirrors (main outside mirrors), IV-class mirrors (wide-angle outside rearview mirrors), V-class mirrors (blind-filling outside rearview mirrors), VI-class mirrors (front mirrors), VII-class mirrors (mirrors used in L-class vehicles in which the driver's cab is partially enclosed), and the like according to performance and installation requirements. For general passenger vehicles (such as M1-class vehicles, vehicles with at least 4 wheels or 3 wheels and a maximum total mass exceeding 1 ton, and passenger vehicles with no more than 8 passenger seats in addition to the driver's seat), and cargo vehicles (such as N1-class vehicles, cargo vehicles with a maximum design total mass of not more than 3500 kg), the image information of different viewing ranges at the rear of the vehicle is mainly provided by setting main outside mirrors and wide-angle outside rearview mirrors. FIG. 1 shows a schematic view of the viewing range of a main outside mirror according to an embodiment of the present disclosure, and FIG. 2 shows a schematic view of the viewing range of a wide-angle outside rearview mirror according to an embodiment of the present disclosure. As shown in FIGS. 1 and 2, the wide-angle outside rearview mirror has a wider viewing range (the viewing width in the vertical direction in FIGS. 1 and 2) than the main outside mirror, but has a shorter viewing distance (the viewing length in the horizontal direction in FIGS. 1 and 2). Therefore, the difference in viewing range between the wide-angle outside rearview mirror and the main outside mirror makes each of them have advantages, and can provide different image information for the driver and passengers.

[0104] With the continuous development of electronic and intelligent direction of the automobile, the electronic rearview mirror (Camera Monitor System, CMS) as a product that has recently emerged is gradually replacing the traditional optical rearview mirror. Compared with the traditional optical rearview mirror, the electronic rearview mirror has the advantages of wider field of view, reduced blind area, automatic light compensation, less affected by the environment, and can effectively reduce wind resistance and wind noise, and achieve energy saving and emission reduction.

[0105] As described above, for the field of view range of the wide-angle outside rearview mirror and the main outside rearview mirror, the electronic rearview mirror needs different image acquisition devices to obtain the wide-angle picture corresponding to the wide-angle outside rearview mirror and the narrow-angle picture corresponding to the main outside rearview mirror. However, under the premise of considering the focal length and the depth of field, in order to make the rearview mirror meet the safety requirements, the electronic rearview mirror usually matches with an ordinary camera with a smaller field of view range but a larger focal length for image acquisition, which makes it difficult for the electronic rearview mirror to quickly and efficiently realize multi-angle observation of different field of view ranges in a scene that requires a larger field of view range. Even if the vehicle is equipped with a wide-angle camera, the electronic rearview mirror needs the driver or the passenger to manually operate to switch the field of view range of the electronic rearview mirror, but the driver himself needs to drive during the driving process, which undoubtedly increases the driving burden of the driver and forces to change the driving habit; on the other hand, the driver manually switches the wide-angle picture based on his own sensory judgment, which has a large hysteresis and inaccuracy, and the driver cannot timely and efficiently obtain different image information in some scenes that require more image information of the field of view range.

[0106] Therefore, an embodiment of the present application provides a content display method, and FIG. 3 shows a step flow diagram of a content display method according to an embodiment of the present application. As shown in FIG. 3, the method comprises the following steps:

[0107] S101, display a first display picture of a first field of view range.

[0108] S102, detect whether the out-of-vehicle driving environment information meets a preset condition.

[0109] S103, in the case that the out-of-vehicle driving environment information meets the preset condition, display a third display picture.

[0110] In the case that the out-of-vehicle driving environment information meets the preset condition, a third display picture is displayed, and the third display picture comprises the first display picture and a second display picture of a second field of view range, and the second field of view range is different from the first field of view range.

[0111] In the embodiments of the present application, the display picture refers to a real-time image picture for display on a display device of a vehicle, and the display picture is configured to provide image information inside and outside the vehicle to a driver and a passenger, wherein the display picture at least includes a first display picture corresponding to an image of a first field of view range and a second display picture corresponding to an image of a second field of view range, the first field of view range is different from the second field of view range, and the first display picture of the first field of view range or the second display picture of the second field of view range is displayed on the display device to provide different image information to the driver and the passenger, so as to enrich the information domain that the driver and the passenger can obtain.

[0112] The different field of view ranges refer to the width of the angle of view of the image acquisition device used to acquire the first display picture and the image acquisition device used to acquire the second display picture. The greater the width of the angle of view, the greater the range of the scene that the image acquisition device can capture, so that the display picture of the greater field of view range can provide more image information to the driver. Exemplarily, the different field of view ranges include but are not limited to the field of view range of a standard lens, the field of view range of a wide-angle lens, the field of view range of an ultra-wide-angle lens, and the like.

[0113] In the embodiments of the present application, the display picture further includes a third display picture, the third display picture is configured as a combination of the first display picture and the second display picture, and is used to simultaneously display multiple image information of different field of view ranges on the display device. The third display picture is triggered and displayed under the preset condition, and the preset condition refers to that the vehicle is in or will be in a scenario in which the driver needs to perform a driving operation based on image information of multiple field of view ranges. In the scenario corresponding to the preset condition, the vehicle performs or is about to perform a dangerous behavior or a vehicle dynamic behavior. The dangerous behavior includes a behavior in which the vehicle is at risk of being damaged by other vehicles and / or obstacles, for example, the dangerous behavior includes but is not limited to that the vehicle is about to be collided with, scratched, and the like. The vehicle dynamic behavior includes a behavior in which the vehicle changes the current driving state, and in the process of the vehicle dynamic behavior, the driver needs to rely on more image information to perform more complex driving operations, for example, the vehicle dynamic behavior includes but is not limited to parking, reversing, lane changing, and the like.

[0114] In the embodiment of the present application, the preset condition is determined based on the out-of-vehicle driving environment information, the out-of-vehicle driving environment information is configured to represent the environment information of the current driving state of the vehicle, and the out-of-vehicle driving environment information at least includes the position information of the vehicle and the near distance detection information of the vehicle, and the near distance detection information is the target detection result around the vehicle. Whether the vehicle meets the preset condition is determined through the out-of-vehicle driving environment information, so as to determine whether the vehicle needs to display the display screens of multiple different visual field ranges.

[0115] In the case where the vehicle does not meet the preset condition, it is indicated that the vehicle performs a vehicle static behavior, at this time, the driver can only drive safely and effectively through the image information of a single visual field range, at this time, only the first display screen of the first visual field range is displayed, wherein the vehicle static behavior refers to a safe behavior performed by the vehicle and / or a behavior without complex operation, for example, the vehicle static behavior includes but is not limited to the vehicle being in a stop state, performing straight-line driving, and the like.

[0116] The embodiment of the present application sets the preset condition, distinguishes the case where the display screen of multiple different visual field ranges needs to be displayed from the case where the display screen of multiple visual field ranges does not need to be displayed through the preset condition, so that during the driving of the vehicle, whether the vehicle meets the preset condition is automatically detected based on the out-of-vehicle driving environment information, in the case where the preset condition is met, the display screen is automatically switched to the third display screen containing multiple different visual field ranges without additional operation of the driver, so that the first display screen containing the first visual field range and the second display screen containing the second visual field range are conveniently and efficiently displayed for the driver and the passenger in the scene corresponding to the preset condition, the driver can conveniently and quickly and efficiently obtain the image information of different visual field ranges by directly observing the third display screen, and the driving experience is improved.

[0117] In order to enable those skilled in the art to better understand the content display method proposed in the present application, FIG. 4 shows a processing flow diagram of a content display method according to an embodiment of the present application, and the content display method will be described in detail in combination with FIG. 4:

[0118] In the step S101, the first image is acquired. The first image is an image acquired by a first image acquisition device at a first view angle. The view angle refers to a shooting view angle of the image acquisition device for acquiring the image. The first view angle is a preset view angle in line with the habit of the driver, so as to ensure that the driver will not break the thinking habit when observing the first display screen based on the first image. For example, when the first image acquisition device is a camera corresponding to the position of the right rearview mirror of the vehicle, the first view angle is a shooting view angle in which the right rearview mirror of the vehicle shoots the right rear side of the vehicle. When the driver observes the first display screen of the first view angle displayed by the right display device, the first view angle is considered as the view angle of the traditional optical right rearview mirror according to the thinking habit. The first image is configured to provide the first display screen of the first field of view. The field of view of the first image is greater than or equal to the first field of view.

[0119] FIG. 7 shows a schematic diagram of acquiring the first display screen based on the first image according to an embodiment of the present application. As shown in FIG. 7, after the first image is obtained, the first display screen is acquired based on the first image. The first display screen is at least a partial region of the first image. This is because the display device for displaying the first display screen on the vehicle is usually a special-shaped screen. The first display screen smaller than the first image is displayed on the display device. The first display screen can be processed by the part of the first image outside the first display screen, so as to eliminate the influence of the special-shaped screen on the picture.

[0120] In some optional embodiments, the first display screen is acquired in the following manner. First, a display parameter value of the first display screen is acquired. The display parameter value is used to determine a first framing window in the first image. The first image is cropped based on the first framing window. The image content in the first framing window is taken as the content of the first display screen. The field of view of the scene contained in the first framing window is the first field of view corresponding to the first display screen.

[0121] Optionally, the display parameter value comprises at least one of a display size, a display shape, and a cropping position, wherein the display size is used to represent an area proportion of the first viewfinder occupying the first image, the display shape is used to represent a shape of the first viewfinder occupying the first image, and the cropping position is used to represent a target position of the first viewfinder relative to the first image. The target position can be a first preset point in the first viewfinder representing a position of the first viewfinder, for example, the first preset point can be a center point of the first viewfinder. The cropping position can be represented by a relative position of the first preset point and a first calibration point in the first image. It is to be understood that the first preset point can also be other point positions of the first viewfinder, such as various edge top points of the first viewfinder. The specific target position can be determined according to actual conditions, and the application does not limit this.

[0122] In the embodiments of the application, the first field of view range corresponding to the first display picture includes but is not limited to a field of view range of a standard lens, a field of view range of a wide-angle lens, a field of view range of an ultra-wide-angle lens, and the like. The specific first field of view range can be preset according to a specific use scenario. For example, in a driving scenario, in order to ensure that the first display picture obtained by the driver is consistent with the image field of view range obtained based on a traditional optical rearview mirror, and to avoid damaging the driving habits of the driver based on the traditional optical rearview mirror, the first field of view range can be set as the same normal lens field of view range as the traditional optical rearview mirror. In a reversing scenario, the driver needs to obtain more image information outside the vehicle. At this time, the first field of view range can be a field of view range of a wide-angle lens or a field of view range of an ultra-wide-angle lens. The embodiments of the application set the first field of view range as the same field of view range as the image field of view range obtained by the traditional optical rearview mirror, so that the first field of view range is unified with the default field of view range in the driver's mind, and the brain of the driver cannot keep up with the line of sight due to the difference between the first field of view range of the first display picture received by the line of sight of the driver and the field of view range of the optical rearview mirror in the mind of the driver by default, which affects the sensory experience of the driver.

[0123] Exemplarily, the first image collection device corresponds to the position of a traditional optical left rearview mirror, and the display region of the first display screen is located at the left side of the display device. At this time, the driver subconsciously equates the first display screen to the image in the traditional optical left rearview mirror, i.e., considers that the first display screen should display the same information as the field of view range of the traditional optical left rearview mirror. Therefore, the first field of view range of the first display screen is preset to be the same as the field of view range of the traditional optical left rearview mirror according to the thinking habit of the driver (for example, the first field of view range includes image information of a wheel at the left rear of the vehicle, a lane, a vehicle, etc.), so as to ensure that the thinking habit of the driver is not broken through the first field of view range, effectively improve the sensory experience of the driver, and reduce the thinking conversion cost of the driver.

[0124] It is easy to understand that, in the embodiment of the application, since the first field of view range corresponds to the field of view range of the traditional optical rearview mirror, the field of view range of the traditional optical rearview mirror is preset before the first display screen is displayed (for example, when the product is factory-set), and a mapping relationship between the first field of view range and the preset field of view range of the traditional optical rearview mirror is established. The first field of view range is obtained through pre-adjustment based on the mapping relationship.

[0125] FIG. 5 shows a schematic diagram of a first display screen according to an embodiment of the application. As shown in FIG. 5, after the first display screen is generated, the first display screen of the first field of view range is displayed as a reference screen of the display device of the vehicle, used to provide the driver and the passenger with image information based on the first field of view range in a case where a preset condition is not met, and used to provide the driver and the passenger with image information corresponding to the first field of view range in a case where the preset condition is met.

[0126] In some optional embodiments, when the first display screen is displayed, the first display screen can be displayed on the display device in full screen, or the first display screen can be windowed and displayed in a preset display region of the display device.

[0127] In the step S102, after displaying the first display picture as a reference picture on the display device, the driving environment information outside the vehicle is acquired, and it is determined whether the current vehicle meets the specific scene corresponding to the preset condition based on the driving environment information outside the vehicle. If the preset condition is met, it indicates that the current vehicle is in the specific scene in which the image information of different visual field range needs to be displayed, and the state of displaying only the first display picture needs to be adjusted. Optionally, the detection of whether the driving environment information outside the vehicle meets the preset condition comprises at least one of the following: detecting whether the driving environment information outside the vehicle represents that the current position of the vehicle is in the target area; detecting whether the driving environment information outside the vehicle represents that there is a target object in the preset range of the vehicle; and detecting whether the driving environment information outside the vehicle represents that there is a target object in the preset range of the vehicle and the target object is not present in the first display picture.

[0128] In some optional embodiments, the driving environment information outside the vehicle is used to represent the relative position relationship between the current position of the vehicle and the target area, and specifically comprises representing that the current position of the vehicle is in the target area or representing that the current position of the vehicle is not in the target area. The target area refers to a geographical area bound by a specific scene of the vehicle, and when it is detected that the current position of the vehicle is in the target area, the vehicle has a high probability of performing or about to perform a dangerous behavior or a vehicle dynamic behavior. When the driving environment information outside the vehicle represents that the current position of the vehicle is in the target area, it is determined that the driving environment information outside the vehicle meets the preset condition; and when the driving environment information outside the vehicle represents that the current position of the vehicle is not in the target area, it is determined that the driving environment information outside the vehicle does not meet the preset condition.

[0129] Optionally, the target area can be a preset fixed geographical area, in which the vehicle has a high probability of performing or about to perform a dangerous behavior or a vehicle dynamic behavior. For example, the target area includes but is not limited to a parking lot area, a large-angle curve area, etc. Illustratively, the target area can be a parking lot area, when the current position of the vehicle is in the parking lot area, it indicates that the vehicle performs or is about to perform a parking behavior, at this time, it is determined that the driving environment information outside the vehicle meets the preset condition, and the originally displayed first display picture is insufficient to provide sufficient image information for the driver to perform the parking operation, and therefore image information of different visual field range needs to be displayed.

[0130] In some optional embodiments, the out-of-vehicle driving environment information is used to represent a relative position relationship between a preset range of the vehicle and a target object, and specifically includes that the target object exists in the preset range of the vehicle and that the target object does not exist in the preset range of the vehicle. The target object refers to a target that may pose a threat to the safety of the vehicle, for example, the target object can be other vehicles, obstacles, animals, pedestrians, and the like. When the target object is close to the vehicle, a dangerous situation may occur. The preset range refers to a region within a preset distance threshold from the vehicle. The preset distance threshold is a limit distance at which the vehicle and the target object may have a dangerous behavior. When the distance between the vehicle and the target object is less than or equal to the preset distance threshold (i.e., the target object is located in the preset range), it is considered that the target object is close to the vehicle and may have a dangerous behavior such as collision or scratching. When the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle, it is determined that the out-of-vehicle driving environment information satisfies the preset condition. When the out-of-vehicle driving environment information represents that the target object does not exist in the preset range of the vehicle, it is determined that the out-of-vehicle driving environment information does not satisfy the preset condition.

[0131] For example, the target object is other vehicles, the preset distance threshold is 40 m, and the preset range is a region within 40 m from the vehicle. When the relative position between the other vehicles and the vehicle is within a range of less than or equal to 40 m, it is considered that the other vehicles and the vehicle have a possibility of having a dangerous behavior. At this time, it is determined that the out-of-vehicle driving environment information satisfies the preset condition. In order to avoid the dangerous behavior, the originally displayed single field of view range display screen is switched to a display screen including multiple different field of view ranges, thereby providing more abundant image information for the driving operation of the driver and helping the driver to make accurate operation to avoid the dangerous behavior.

[0132] In some optional embodiments, the out-of-vehicle driving environment information is used to represent a relative position relationship between a preset range of the vehicle and the target object, and specifically includes that the target object exists in the preset range of the vehicle and that the target object does not exist in the preset range of the vehicle. The position of the target object can be determined according to a target detection algorithm. When the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle, if the originally displayed first display screen contains the target object, it indicates that the first display screen has already provided the image information of the target object for the driver and the passenger, and at this time, the target object that may cause dangerous behavior does not need to be repeatedly displayed in other image information of the field of view, and the original first display screen can provide the core image information (the image information of the target object) for the driver. Therefore, it is determined that the out-of-vehicle driving environment information does not meet the preset condition, and the first display screen can be continuously maintained. On the contrary, when the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle, and the first display screen does not contain the target object, it is considered that the core image information (the image information of the target object) that may cause dangerous behavior is not output to the driver and the passenger. At this time, it is determined that the out-of-vehicle driving environment information meets the preset condition, and the first display screen that does not contain the target object needs to be adjusted, and the display screen of a different field of view containing the target object is combined with the first display screen to display, so that the image information of the target object is timely displayed to the driver and the passenger through the display screen of the different field of view.

[0133] In the embodiments of the present application, before it is determined whether the out-of-vehicle driving environment information represents that the target object exists in the preset range of the vehicle, a second display screen different from the field of view of the first display screen needs to be obtained. When the out-of-vehicle driving environment information meets the preset condition, the second display screen is used to provide the image information of the first field of view of the first display screen for the driver and the passenger.

[0134] Specifically, first, a second image is acquired, the second image being an image captured by a second image capturing device at a second view angle, the second view angle being determined by a shooting view angle of the second image capturing device, and the second view angle being different from a first view angle due to a difference in position between the second image capturing device and the first image capturing device. Since the first view angle is a preset view angle in line with the driver's habit, in order to ensure that the second view angle is also in line with the driver's habit, the second image is adjusted in view angle based on the first view angle, to obtain a second image after view angle adjustment, the view angle of the second image after view angle adjustment being substantially the same as the first view angle. For example, the first view angle is a shooting view angle corresponding to a traditional optical right rearview mirror, and then the second view angle of the second image is also adjusted to a shooting view angle corresponding to a traditional optical right rearview mirror, to obtain the second image after view angle adjustment.

[0135] The second image is configured to provide a second display picture of a second field of view, and the field of view of the second image is greater than or equal to the second field of view. After the second image is obtained, the second display picture is acquired based on the second image, the second display picture being at least a partial region of the second image, so as to eliminate the picture influence caused by the special-shaped screen.

[0136] In some optional embodiments, the second display picture is acquired in the following manner: first, a display parameter value of the second display picture is acquired, the display parameter value being used to determine a second framing window in the second image, and the second image is cropped based on the second framing window, and the image content within the second framing window is taken as the content of the second display picture. The field of view in which the scene contained in the second framing window is located is the second field of view corresponding to the second display picture. It should be noted that the display parameter value of the second display picture has the same meaning as the display parameter value of the first display picture, and specific details can be referred to the foregoing description of the display parameter value of the first display picture, which will not be repeated here.

[0137] In some optional embodiments, the second field of view range is greater than the first field of view range, that is, the second display picture contains more image information than the first display picture, for example, the second display picture is a wide-angle picture, and the first display picture is a standard lens picture (narrow-angle picture). When detecting whether the vehicle driving environment information represents that there is a target object in the preset range of the vehicle, the second display picture containing more image information can be directly detected, and it is determined whether the vehicle driving environment information represents that there is the target object in the preset range of the vehicle. Specifically, whether there is a target object in the second display picture of the second field of view range is detected. Since the second field of view range is greater than the first field of view range, it means that the second display picture has a smaller focal length (field of view length) than the first display picture. Therefore, if there is a target object in the second display picture of the second field of view range, it is determined that the target object is located in the preset range of the vehicle. At this time, it is considered that the preset condition is met, and the second display picture of the second field of view range containing the target object needs to be provided for the driver. On the contrary, if there is no target object in the second display picture, the target object only exists in the first display picture, or the target object does not exist in both the first display picture and the second display picture. In these two cases, it can be determined that the relative position between the target object and the vehicle is far away. The first display picture originally displayed can provide sufficient image information for the driver and the passenger. It is determined that the vehicle driving environment information does not meet the preset condition, and the first display picture is continued to be displayed.

[0138] Specifically, in step S103, when the vehicle driving environment information meets the preset condition, it indicates that the vehicle is in a specific scenario that requires a display picture with a different field of view range to provide more abundant image information. At this time, a third display picture is displayed, and the third display picture includes the first display picture and the second display picture.

[0139] In some optional embodiments, FIG. 6 shows a schematic diagram of a third display picture according to an embodiment of the present application. As shown in FIG. 6, the third display picture is a combination of the first display picture and the second display picture. The area of the second display picture is smaller than the area of the first display picture, and the second display picture is overlaid on the first display picture. Specifically, the display mode information of the second display picture is first obtained, and the second display picture is superimposed on the first display picture according to the display mode information, to obtain the third display picture.

[0140] The display mode information includes at least one of the following: a light transmittance configured to represent a transparency of the second display picture, and an overlapping position configured to represent a position of the second display picture relative to the first display picture. By setting the light transmittance, unnecessary occlusion of the first display picture content at the overlapping position caused by the second display picture overlaid on the first display picture is avoided, thereby meeting the user's demand for observing the first display picture at the bottom layer. Optionally, the overlapping position can be determined according to a point relative position, wherein the second display picture includes a second preset point, the first display picture includes a second calibration point, and the overlapping position is a position of the second preset point relative to the second calibration point. For example, the second preset point can be a center point of the second display picture, and the second calibration point can be a center point of the first display picture. The overlapping position is determined by the position of the second preset point relative to the second calibration point. It should be noted that the above example is only given to facilitate understanding of the scheme of the present application to determine a specific overlapping position. The positions of the second preset point and the second calibration point can be determined according to actual conditions, and the present application does not limit this.

[0141] In some optional embodiments, FIG. 8 shows a content display method processing flow diagram for generating a second display picture with different overlapping positions according to an embodiment of the present application. As shown in FIG. 8, different overlapping positions are set in different specific scenarios, so that in different specific scenarios, the overlapping position of the second display picture in the third display picture does not affect the observation of the image information in the first display picture in the specific scenario. Specifically, in a case where the vehicle outside driving environment information represents that the current position of the vehicle is in a target area, the overlapping position is determined as a first overlapping position; in a case where the vehicle outside driving environment information represents that there is another vehicle within a preset range of the vehicle, the overlapping position is determined as a second overlapping position, and the second overlapping position is different from the first overlapping position.

[0142] Exemplarily, FIG. 9 shows a schematic diagram of a second display screen displayed at a first superimposed position according to an embodiment of the present application. As shown in FIG. 9, the view angle of the first display screen and the second display screen is the view angle corresponding to the right rearview mirror. In the case that the target area is a parking lot area, the first superimposed position is that the second display screen is superimposed on the upper right of the first display screen. At this time, the lane line image information in the first display screen is located at the lower left of the first display screen, which effectively avoids the occlusion of the second display screen to the lane line image information in the first display screen. FIG. 10 shows a schematic diagram of a second display screen displayed at a second superimposed position according to an embodiment of the present application. As shown in FIG. 10, the view angle of the first display screen and the second display screen is the view angle corresponding to the right rearview mirror. In the case that the out-of-vehicle driving environment information indicates that there is another vehicle within the preset range of the vehicle, when the vehicle performs right lane changing operation, the second superimposed position is that the second display screen is superimposed on the lower left of the first display screen, so as to prevent the second display screen from causing occlusion to the image information of the other vehicle on the upper right of the first display screen.

[0143] In addition, in the embodiments of the present application, the initial shape, initial size and initial superimposed position of the second display screen in the third display screen can be pre-set. When the third display screen is started to be displayed, the second display screen is displayed according to the pre-set initial shape, initial size and initial superimposed position. Alternatively, the pre-set initial shape, initial size and initial superimposed position can be system pre-set values, or can be adaptively set according to the operation of the user. In addition, the superimposed position of the second display screen can be changed based on the movement operation of the user (corresponding to the third superimposed position in FIG. 8). The details of the modulation of the position of the second display screen based on the movement operation of the user will be described below in the scheme of adjusting the position of the second display screen in the third display screen based on the movement operation of the user, which will not be repeated herein.

[0144] In some optional embodiments, in the case that the out-of-vehicle driving environment information does not satisfy the preset condition, the first display screen is displayed by default, but when the user performs a trigger operation, even if the preset condition is not satisfied, the third display screen can be directly displayed in response to the trigger operation of the user.

[0145] In some optional embodiments, after the third display screen is displayed, it is continuously detected whether the out-of-vehicle driving environment information still satisfies the preset condition, and in the case that the out-of-vehicle driving environment information does not satisfy the preset condition, it is determined that the display screen of different visual field ranges is not needed at this time, and then the first display screen is displayed again. Optionally, the continuous detection can be real-time detection, periodic detection or other detection manners, and the specific continuous detection manner is not limited in the application.

[0146] In some optional embodiments, in the case that the out-of-vehicle driving environment information represents that there is a target object in a preset range of the vehicle, and the target object does not exist in the first display screen, in this specific scenario, the relative position between the target object and the vehicle can be further reduced after the third display screen is displayed, that is, the vehicle gradually approaches the target object. In the embodiments of the application, in order to avoid dangerous behaviors such as scratching or collision of the vehicle in this specific scenario, it is necessary to adjust the display area of the second display screen, and the change of the display area of the second display screen represents the change of the relative position between the target object and the vehicle. Specifically, the distance between the target object and the vehicle is detected; and during the distance is greater than a preset distance threshold, the display area of the second display screen in the third display screen is adjusted according to the detected distance, and the preset distance threshold refers to the minimum distance between the target object and the vehicle when the vehicle is located in the preset range and the second display screen displays a gradually approaching picture.

[0147] FIG. 11 shows a content display method processing flow diagram for generating a second display screen with different display areas according to an embodiment of the application. As shown in FIG. 11, when the distance between the target object and the vehicle gradually decreases, the display area of the second display screen in the third display screen is gradually increased (corresponding to a first specific scenario). For example, the target object is a static obstacle, and the out-of-vehicle driving environment information represents that the static obstacle exists in a preset range of the vehicle when the vehicle is performing a parking operation, and the static obstacle does not exist in the first display screen. At this time, the preset condition is satisfied, the third display screen is displayed, and the image information of the static obstacle is provided through the second display screen of the second visual field range; during the parking process, the vehicle gradually approaches the static obstacle, and at this time, the display area of the second display screen is gradually increased, and the static obstacle in the second display screen is gradually increased, thereby providing more intuitive display for the driver on the change of the relative position between the static obstacle and the vehicle.

[0148] Further, in order to avoid the second display picture after the display area changes from excessively shielding the first display picture, the proportion of the display area of the enlarged second display picture in the third display picture is limited by a maximum display threshold. When the proportion of the display area of the second display picture in the third display picture is less than the maximum display threshold, the display area of the second display picture can continue to increase. When the proportion of the display area of the second display picture in the third display picture is equal to the maximum display threshold, the display area of the second display picture remains unchanged. For example, the maximum display threshold is 50%, when the proportion of the display area of the second display picture in the third display picture increases to 50%, even if the distance between the target object and the vehicle continues to decrease, the area of the second display picture no longer continues to increase, but maintains 50% of the area of the third display picture.

[0149] When the distance between the target object and the vehicle gradually increases, the display area of the second display picture in the third display picture gradually decreases (corresponding to a second specific scene). When the relative position between the target object and the vehicle gradually increases, the target object will gradually be enlarged and presented in the first display picture. At this time, the image information provided by the first display picture contains the target object. The embodiments of the present application determine that only the target object in the first display picture can provide sufficient image information for the driver with respect to the target object based on a preset proportion. That is, in the case that the distance between the target object and the vehicle is less than the preset distance and / or the proportion of the display area of the target object in the first display picture to the area of the first display picture is greater than the preset proportion, it is considered that only the first display picture can provide sufficient core image information (image information of the target object). It is considered that at this time, there is no need to display the third display picture containing different field of view ranges, and the first display picture is directly restored.

[0150] When the out-vehicle driving environment information represents that there is a target object within a preset range of the vehicle, and the target object is not present in the first display picture, it is detected whether the out-vehicle driving environment information represents that there is a target object within an extended range of the vehicle, the extended range being greater than the preset range. When the out-vehicle driving environment information represents that there is a target object within the extended range of the vehicle, and the target object is not present in the first display picture (corresponding to the third specific scenario), it is considered that the target object is far away from the vehicle, but still within the second field of view range of the second display picture, and the first display picture has no obvious effect on providing image information of the target object. At this time, the second display picture of the second field of view range is displayed (i.e., the third display picture is displayed, and the proportion of the display area of the second display picture in the third display picture is 100%), so as to ensure driving safety. For example, the preset range is a distance range of 40 m around the vehicle, and the extended range is a distance range of 80 m around the vehicle. When the distance between the target object and the vehicle is less than or equal to 80 m and greater than 40 m, and the target object is not present in the first display picture, the second display picture is directly displayed.

[0151] In some optional embodiments, after the third display picture is displayed, the first display picture and the second display picture can be respectively adjusted in display in response to a display adjustment operation of a user. The adjustment type, adjustment direction, and adjustment amplitude of the first display picture and the second display picture can be the same or different. For example, the display adjustment of the first display picture and the second display picture can be that the first display picture is enlarged and the second display picture is reduced, the first display picture is enlarged and the second display picture is kept unchanged, the first display picture is reduced at a first ratio and the second display picture is reduced at a second ratio, and the like. The adjustment type includes but is not limited to adjustment of a field of view range of the display picture, a display picture size, and the like. The display picture size refers to a size of a taking window corresponding to the display picture relative to an image, i.e., the content of the display picture is scaled, and the relative size of the display picture relative to the third display picture remains unchanged. The adjustment direction refers to expansion adjustment (such as expansion of a view angle, enlargement of a picture, and the like), contraction adjustment (such as contraction of a view angle, reduction of a picture, and the like). The adjustment amplitude includes a ratio of expansion adjustment or contraction adjustment relative to the display picture before adjustment. When the ratio is 0, it is considered that the display adjustment is unchanged adjustment.

[0152] The display adjustment comprises at least one of the following: perspective adjustment, display picture enlargement, display picture reduction, and display picture keeping unchanged, wherein the perspective adjustment refers to expanding or shrinking the field of view of the display picture. Since the first display picture and the second display picture are adjusted independently of each other and do not affect each other, when the display adjustment of the first display picture and the second display picture is different, the relative position between the adjusted first display picture and the second display picture changes, which destroys the operation habit of the driver and causes the brain of the driver to fail to keep up with the line of sight. Therefore, in the embodiment of the application, the first display picture and the second display picture after adjustment are corrected according to the relative position reference of the first display picture and the second display picture before adjustment, so as to maintain the consistent relative position and avoid destroying the operation habit of the driver.

[0153] Specifically, FIG. 12 shows a schematic diagram of adjusting the first display picture and the second display picture respectively according to an embodiment of the application. As shown in FIG. 12, the relative position reference of the first display picture and the second display picture along a target direction is obtained, the target direction can be a horizontal direction, a vertical direction or other preset direction, and the relative position reference refers to the reference line of the first display picture and the second display picture in the target direction; in response to the display adjustment operation of the user, the first display picture and the second display picture are adjusted respectively; then, the relative position of the first display picture after display adjustment and the second display picture after display adjustment is adjusted according to the relative position reference, so as to keep consistent with that before adjustment; finally, the corresponding third display picture is obtained based on the first display picture after display adjustment and the second display picture after display adjustment.

[0154] Exemplarily, taking FIG. 12 as an example, the left side edge of the second display picture before adjustment is aligned with the first display picture, and then it is determined that the relative position reference is the reference line of the left side edge alignment in the horizontal direction, and then the first display picture is adjusted by one time of display picture enlargement and the second display picture is adjusted by three times of display picture reduction; according to the relative position reference, the relative position of the first display picture after adjustment and the second display picture after adjustment is adjusted, so that the left side edges of the two in the horizontal direction are adjusted to be aligned to align the reference line, and the corresponding third display picture is obtained.

[0155] In some optional embodiments, after displaying the third display screen, the first display screen and the second display screen can be synchronously adjusted in response to a display adjustment operation, wherein the synchronous adjustment means that the adjustment type, the adjustment direction and the fixed adjustment proportion of the first display screen and the second display screen are consistent, that is, the first display screen and the second display screen are synchronously adjusted at a fixed adjustment proportion. Since the first display screen and the second display screen are synchronously adjusted, in order to simplify the operation of the user, the display adjustment operation of the user can be to adjust any one of the first display screen and the second display screen, and the other one is automatically adjusted synchronously based on the adjusted display screen. Meanwhile, in order to ensure that the third display screen after adjustment does not destroy the operation habit of the driver, the first display screen and the second display screen after adjustment need to be corrected based on the relative position reference of the first display screen and the second display screen before adjustment.

[0156] Specifically, FIG. 13a shows a schematic diagram of synchronous display adjustment of the first display screen and the second display screen before adjustment according to an embodiment of the present application. As shown in FIG. 13a, the relative proportion of the first display screen and the second display screen and the relative position reference in the target direction are obtained, the relative proportion means the area proportion of the second display screen relative to the third display screen, and the relative position reference means the reference line of the first display screen and the second display screen in the target direction. In response to the display adjustment operation of the user, the first display screen and the second display screen are synchronously adjusted, wherein the display adjustment includes at least one of the following: field of view adjustment, display screen enlargement, and display screen reduction. FIG. 13b shows a schematic diagram of synchronous display adjustment of the first display screen and the second display screen after adjustment according to an embodiment of the present application. As shown in FIG. 13b, the relative position of the first display screen after display adjustment and the second display screen after display adjustment is adjusted according to the relative position reference, so as to keep consistent with that before adjustment. Meanwhile, based on the relative proportion, the first display screen after display adjustment and the second display screen after display adjustment are adjusted, so that the area proportion of the first display screen and the second display screen after display adjustment relative to the third display screen is the same as that before display adjustment, and the corresponding third display screen is obtained.

[0157] It should be noted that when the display-adjusted first display picture and the second display picture are adjusted based on the relative proportion and the relative position reference, the area proportion of the display-adjusted second display picture relative to the third display picture can be adjusted, including cutting part of the second display picture, so that the display-adjusted first display picture and the second display picture simultaneously satisfy the relative position reference and the relative proportion.

[0158] Optionally, the first display picture and the second display picture are preconfigured with multiple sets of corresponding display adjustment proportions, for example, when the first display picture is enlarged by 1.1 times, the second display picture is correspondingly enlarged by 1.2 times. The display adjustment operation of the user is to perform a display adjustment operation on any one of the first display picture and the second display picture based on a first display adjustment proportion, and the other one based on the display adjustment operation of the user for the adjusted display picture, to determine a second display adjustment proportion corresponding to the first display adjustment proportion, and to automatically perform synchronous display adjustment according to the second display adjustment proportion. For example, in the preconfigured display adjustment proportion, the first display adjustment proportion of the first display picture includes a 1° view angle expansion, and the second display adjustment proportion of the second display picture corresponding thereto is a 5° view angle expansion. When the user performs a display adjustment of a 1° view angle expansion on the first display picture, a synchronous display adjustment operation of a 5° view angle expansion is automatically performed on the second display picture.

[0159] In an embodiment, the display adjustment operation is a zooming process, specifically including at least one of display picture enlargement and display picture reduction. The zooming process refers to adjusting the size of the viewfinder window (including the first viewfinder window corresponding to the first display picture and the second viewfinder window corresponding to the second display picture) for obtaining the display picture. Taking the first display picture as an example, when the size of the first viewfinder window changes, the image region obtained by cropping the first image based on the first viewfinder window will change, and when it is displayed in the first display picture with an unchanged area proportion relative to the third display picture, the image information in the first display picture realizes zooming. In response to the display adjustment operation (zooming operation) of the user, the first viewfinder window and the second viewfinder window are synchronously adjusted, the first image is cropped based on the adjusted first viewfinder window to obtain a display-adjusted first display picture, and the second image is cropped based on the adjusted second viewfinder window to obtain a display-adjusted second display picture. The area proportions of the first display picture and the second display picture relative to the third display picture are unchanged, and the image information in the display-adjusted first display picture is different from the image information in the display-adjusted first display picture.

[0160] In an embodiment, the display adjustment is a field of view adjustment, the first display picture is obtained based on a first image captured by a first image capturing device, and the second display picture is obtained based on a second image captured by a second image capturing device. When the display adjustment operation of the user is received, the field of view of the first image capturing device and the field of view of the second image capturing device are adjusted synchronously in response to the display adjustment operation of the user, and the first image and the second image with the adjusted field of view are obtained. Then, the first image with the adjusted field of view and the second image with the adjusted field of view are respectively cropped based on the first viewfinder and the second viewfinder, and the first display picture and the second display picture with the adjusted field of view are obtained.

[0161] Further, when the display adjustment operation of the user for the field of view adjustment is responded to, the second display picture has a higher definition than the first display picture, and / or the second field of view is smaller than the first field of view. In the embodiment, when the field of view adjustment is performed, the second display picture contains image information with a smaller field of view and / or higher definition, and the first display picture contains image information with a larger field of view and / or lower definition. Therefore, when the third display picture containing the first display picture and the second display picture is displayed, the first display picture provides the user with image information for a global overview, and the second display picture provides the user with image information for a local detail. Thus, the user can freely control the second display picture and / or the first display picture through the field of view adjustment function, and can observe details to meet the needs of a driving scenario (for example, a situation where a parking space reversing line needs to be observed in detail in a parking lot reversing into a garage scenario).

[0162] In some optional embodiments, after the third display picture is displayed, the position of the second display picture in the third display picture can be adjusted in response to a movement operation of the user, so as to realize a drag operation of the user on the second display picture. Specifically, the user performs a movement operation on the second display picture of the display device, the movement direction and distance of the movement operation of the user are obtained in response to the movement operation of the user on the second display picture, the second display picture is adjusted based on the movement direction and distance, and the first display picture remains unchanged. The adjustment of the second display picture includes adjusting the position of the second display picture in the third display picture and / or adjusting the second field of view of the second display picture. Based on the movement operation of the user, only the position of the second display picture can be adjusted, only the second field of view of the second display picture can be adjusted, or the position of the second display picture and the second field of view of the second display picture can be adjusted simultaneously.

[0163] Exemplarily, FIG. 14a shows an adjustment-before schematic view of adjusting the position of the second display picture, FIG. 14b shows an adjustment-in schematic view of adjusting the position of the second display picture, and FIG. 14c shows an adjustment-after schematic view of adjusting the position of the second display picture, as shown in FIGS. 14a-14c, the user performs a moving operation of moving the second display picture to the right by pressing and dragging, keeps the first display picture unchanged, and the second display picture moves to the right by a corresponding distance according to the user moving direction and distance. Since the first display picture is unchanged, the relative position between the first display picture and the second display picture gradually changes in the process of moving the position of the second display picture to the right.

[0164] Exemplarily, FIG. 15a shows an adjustment-before schematic view of the position of the second display picture and the second field of view, and FIG. 15b shows an adjustment-after schematic view of the position of the second display picture and the second field of view, as shown in FIGS. 15a and 15b, the user performs a moving operation of moving the second display picture to the right by pressing and dragging, keeps the first display picture unchanged, and the second display picture moves to the right by a corresponding distance according to the user moving direction and distance; meanwhile, the second display picture expands the field of view of the corresponding second image acquisition device to the right and up by a corresponding distance according to the user moving direction and distance, so that the second display picture after adjustment displays image information (the vertical line on the right side of the second display picture in FIG. 15b) that the second display picture before adjustment does not display.

[0165] Further, FIG. 16 is a schematic diagram of adjusting a second display screen position in a preset superimposed area according to an embodiment of the present application. As shown in FIG. 16, in order to avoid the superimposed position of the second display screen from being contrary to the habit of the driver (for example, when the display screen corresponds to the right rearview mirror view angle, the driver thinks that the lane line in the first display screen is located at the lower left by default, and thus the default superimposed position of the second display screen is the upper right), the movement of the second display screen needs to be regionally limited. Specifically, a preset superimposed area of the second display screen in the third display screen is obtained, the preset superimposed area is an area of the third display screen where the initial superimposed position is located, for example, the preset superimposed area includes the upper left area, the lower right area, the lower left area and the upper right area; in response to the movement operation of the user on the second display screen, the position of the second display screen is adjusted in the preset superimposed area, that is, when the movement operation of the user on the second display screen is in the preset superimposed area, the position of the second display area in the third display area is adjusted according to the movement operation of the user; when the movement operation of the user on the second display screen is out of the preset superimposed area, the second display area is moved to the boundary of the preset superimposed area in the third display screen according to the movement operation of the user.

[0166] The present application provides a content display method, system, vehicle and electronic device. The method comprises: displaying a first display screen of a first field of view; detecting whether the vehicle external driving environment information meets a preset condition; and in the case that the vehicle external driving environment information meets the preset condition, displaying a third display screen, the third display screen comprising the first display screen and a second display screen of a second field of view, the second field of view being different from the first field of view. The present application pre-acquires the first display screen and the second display screen of different fields of view, and combines the first display screen and the second display screen into the third display screen for display in the case that the vehicle meets the preset condition, so that the vehicle can automatically display the display screen of different fields of view under the preset condition, and the driver can conveniently and quickly and efficiently acquire the image information of different fields of view by directly observing the third display screen, thereby improving the driving experience.

[0167] In an embodiment, FIG. 17 shows a schematic diagram of a system architecture according to an embodiment of the present application. As shown in FIG. 17, the electronic rearview mirror at least comprises a display device (rearview mirror display screen) and an image acquisition device (such as an external camera) corresponding to the display device. The electronic rearview mirror host can use a real-time operating system on a virtual machine. In addition, the electronic rearview mirror system can not be based on a virtual machine, but be directly mounted on a vehicle SOC or an MCU. The MCU and the vehicle SOC are connected.

[0168] Different virtual machine systems are built to form a unified data bus, and a unified API interface is provided for an upper application, and the upper application can obtain vehicle sensing data such as data of a vehicle-mounted camera through the data bus and display the data on a corresponding screen.

[0169] Based on the same inventive concept, an embodiment of the present application provides a content display system. FIG. 18 shows a schematic diagram of a content display system according to an embodiment of the present application. As shown in FIG. 18, the content display system at least includes a display device 100, a first image acquisition device 101, a second image acquisition device 102, and a controller 200. Wherein,

[0170] The display device 100 is configured to display a display picture generated by the controller 200 based on images acquired by the image acquisition device. Optionally, FIG. 19 shows a schematic diagram of a vehicle-mounted display screen according to an embodiment of the present application. As shown in FIG. 19, the display device 100 is a rearview mirror display screen (including a left rearview screen or a right rearview screen shown in FIG. 19).

[0171] The first image acquisition device 101 is configured to acquire a first image of a first field of view.

[0172] The second image acquisition device 102 is configured to acquire a second image of a second field of view, and the second field of view is different from the first field of view.

[0173] The controller 200 is configured to generate a first display picture based on the first image, generate a second display picture based on the second image, control the display device 100 to display the first display picture, and detect whether a driving environment information outside the vehicle satisfies a preset condition. In a case where the driving environment information outside the vehicle satisfies the preset condition, the controller 200 controls the display device 100 to display a third display picture, and the third display picture includes the first display picture and the second display picture.

[0174] In the embodiment of the present application, the first image acquisition device 101 and the second image acquisition device 102 correspond to the display device 100. The display device 100 is configured to display a first display picture generated based on a first image acquired by the first image acquisition device 101, and / or display a second display picture generated based on a second image acquired by the second image acquisition device 102.

[0175] In some optional embodiments, the content display system further includes at least one of the following:

[0176] a distance sensor configured to detect a distance between the target object and the vehicle, the distance sensor configured to transmit the distance between the target object and the vehicle to the controller 200, so that the controller 200 determines the off-vehicle driving environment information based on the distance between the target object and the vehicle.

[0177] a position sensor configured to obtain a current position of the vehicle, the position sensor comprising at least a receiver configured to receive satellite signals. Optionally, the position sensor can be a global positioning system (GPS) mounted on the vehicle, which receives information through the receiver to determine the position, speed, direction, and the like of the vehicle.

[0178] In some optional embodiments, the content display system further comprises:

[0179] a third image acquisition device configured to acquire the second image, wherein the field of view of the third image acquisition device is smaller than that of the second image acquisition device, and the second image acquired by the third image acquisition device has a higher definition than the second image acquired by the second image acquisition device. Optionally, the third image acquisition device is a narrow-angle high-definition camera, and the second image acquisition device is a wide-angle camera.

[0180] The controller 200 is configured to control the third image acquisition device to acquire the image when the distance between the target object and the vehicle is greater than a preset distance threshold. When the target object is within a preset range of the vehicle, the relative position between the vehicle and the target object will be further reduced, i.e., the vehicle will gradually approach the target object. When the distance between the target object and the vehicle is greater than the preset distance threshold, it is determined that the process of gradually approaching needs to be represented by adjusting the display area of the second display picture. At this time, the second display picture needs to represent the high-definition image information of the target object, and other image information in the second display picture is relatively secondary compared to the image information of the target object. Therefore, in this scenario, the third image acquisition device acquires the second image with higher definition and smaller field of view, and the second display picture is obtained based on the second image acquired by the third image acquisition device.

[0181] In some optional embodiments, the content display system further comprises:

[0182] a touch device configured to receive a triggering operation of a user and generate a triggering instruction based on the triggering operation and send the triggering instruction to the controller 200, the triggering instruction being configured to instruct the controller 200 to directly display the third display picture on the display device 100. Optionally, the touch device is a master control screen.

[0183] The controller 200 is further configured to control the display device 100 to display the third display screen in response to the trigger instruction.

[0184] Based on the same inventive concept, the embodiments of the present application provide a vehicle, the vehicle comprising a controller 200, the controller 200 being configured to perform the steps of the content display method according to any of the embodiments described above.

[0185] Based on the same inventive concept, the embodiments of the present application provide an electronic device, and FIG. 20 shows a schematic diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 20, the electronic device 100 comprises a memory 110 and a processor 120. The memory 110 and the processor 120 are connected through a bus in communication. The memory 110 stores a computer program. The computer program can be loaded and run on the processor 120 to implement the steps of the content display method disclosed in the embodiments of the present application.

[0186] Each of the embodiments in the present specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The same and similar parts of each embodiment can be referred to each other.

[0187] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams according to the method, device, electronic device and computer program product of the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing terminal equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal equipment generate the device for implementing the functions specified in one or more flows of the flowcharts and / or one or more blocks of the block diagrams.

[0188] These computer program instructions can also be stored in a computer readable memory which can guide the computer or other programmable data processing terminal equipment to work in a specific way, so that the instructions stored in the computer readable memory generate a product comprising instruction devices, which implement the functions specified in one or more flows of the flowcharts and / or one or more blocks of the block diagrams.

[0189] These computer program instructions can also be loaded into a computer or other programmable data processing terminal device, so that a series of operational steps are performed on the computer or other programmable terminal device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more flows of the flow chart and / or one or more blocks of the block diagram.

[0190] Although the preferred embodiments of the application have been described, those skilled in the art will be able to make additional changes and modifications to these embodiments once they have the basic inventive concept. Therefore, the appended claims are intended to cover all changes and modifications falling within the scope of the embodiments of the application.

[0191] Finally, it should also be noted that, in this document, relational terms such as first and second and the like can only be used to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any such actual relationship or order between or among these entities or operations. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, so that a process, method, article, or terminal device including a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or terminal device. Without more limitations, an element defined by the statement "comprising a..." does not exclude the existence of additional identical elements in the process, method, article, or terminal device including the element.

[0192] The above provides a content display method, system, vehicle and electronic device, and the principles and implementation modes of the application are described by applying specific examples. The above description of the embodiments is only used to help understand the method of the application and its core idea; meanwhile, for those skilled in the art, according to the idea of the application, the specific implementation mode and application range can be changed, and the above description of the content of the specification should not be understood as a limitation of the application.

Claims

A content display method, wherein, The method includes: The first display screen shows the first field of view; Detect whether the external driving environment information meets the preset conditions; When the external driving environment information meets the preset conditions, a third display screen is displayed. The third display screen includes the first display screen and a second display screen with a second field of view, which is different from the first field of view. According to the content display method of claim 1, wherein, The system checks whether the external driving environment information meets preset conditions, including at least one of the following: Detect whether the external driving environment information indicates that the vehicle's current position is within the target area; The system detects whether the external driving environment information indicates the presence of a target object within a preset range of the vehicle. The system detects whether the external driving environment information indicates the presence of a target object within a preset range of the vehicle, and whether the target object is not displayed in the first screen. According to the content display method of claim 2, wherein, The second field of view is larger than the first field of view; Detecting whether external driving environment information indicates the presence of a target object within a preset range of the vehicle, including: Detect whether a target object exists within the second display screen of the second field of view. According to the content display method of claim 1, wherein, The method further includes: Obtain the display mode information of the second display screen, wherein the display mode information includes at least one of the following: light transmittance and superposition position; According to the display method information, the second display screen is superimposed on the first display screen to obtain the third display screen. According to the content display method of claim 1, wherein, The first displayed image is obtained based on a first image from a first perspective; Before displaying the third display screen, it also includes: Obtain a second image from a second-person perspective; Based on the first perspective, the second image is adjusted to obtain the second image after perspective adjustment; The second display screen is obtained based on the second image after the viewpoint adjustment. According to the content display method of claim 5, wherein, The method further includes: Obtain the display parameter values ​​of the second display screen, wherein the display parameter values ​​include at least one of the following: display size, display shape, and cropping position; Based on the second image after perspective adjustment, a second display screen is obtained, including: The second image, adjusted based on the viewing angle, is cropped according to the display parameter values ​​to obtain the second display screen. According to the content display method of claim 1, wherein, After displaying the third display screen, the method further includes: If the external driving environment information does not meet the preset conditions, the first display screen will be restored. According to the content display method of claim 4, wherein, The second display screen can be displayed in a superimposed position. Obtaining the superimposed position of the second display screen includes: When the vehicle's current position, as indicated by the external driving environment information, is within the target area, the superimposed position is determined as the first superimposed position. If other vehicles are present within a preset range of the vehicle's external driving environment information, the superimposed position is determined as a second superimposed position, which is different from the first superimposed position. According to the content display method of claim 1, wherein, The method further includes: In response to a user's trigger action, a third display screen is displayed, which includes the first display screen and a second display screen with a second field of view, the second field of view being different from the first field of view. According to the content display method of claim 1, wherein, If a target object exists within a preset range representing the vehicle's external driving environment information, and the target object is not displayed in the first display screen, after displaying the third display screen, the method further includes: Detect the distance between the target object and the vehicle; During the period when the distance is greater than a preset distance threshold, the display area of ​​the second display screen in the third display screen is adjusted according to the detected distance; If the distance is less than the preset distance and / or the ratio of the display area of ​​the target object in the first display screen to the area of ​​the first display screen is greater than a preset percentage, the first display screen is restored. According to the content display method of claim 1, wherein, After displaying the third display screen, the method further includes: Obtain the relative position reference of the first display screen and the second display screen along the target direction; In response to the user's display adjustment operation, the first display screen and the second display screen are respectively adjusted, and the display adjustment includes at least one of the following: viewing angle adjustment, display screen magnification, display screen shrinking, and display screen remaining unchanged; Based on the relative position reference, a corresponding third display screen is obtained based on the first display screen after display adjustment and the second display screen after display adjustment. According to the content display method of claim 1, wherein, After displaying the third display screen, the method further includes: Obtain the relative proportions of the first display screen and the second display screen, as well as their relative positions along the target direction; In response to the user's display adjustment operation, the first display screen and the second display screen are simultaneously adjusted, and the display adjustment includes at least one of the following: field of view adjustment, display screen magnification, and display screen reduction; Based on the relative position reference and the relative ratio, a corresponding third display screen is obtained based on the first display screen after display adjustment and the second display screen after display adjustment. The content display method according to claim 12, wherein, The display adjustment includes at least one of the following: enlarging the display screen and shrinking the display screen; the first display screen is obtained based on a first image in a first viewfinder, and the second display screen is obtained based on a second image in a second viewfinder. In response to a user's display adjustment operation, the first display screen and the second display screen are simultaneously adjusted, including: In response to the user's display adjustment operation, the first viewfinder and the second viewfinder are adjusted synchronously. The content display method according to claim 12, wherein, The display adjustment includes: field of view adjustment; the first display screen is obtained based on a first image captured by a first image acquisition device, and the second display screen is obtained based on a second image captured by a second image acquisition device; in response to the user's display adjustment operation, the first display screen and the second display screen are synchronously adjusted, including: In response to the user's display adjustment operation, the field of view of the first image acquisition device and the field of view of the second image acquisition device are adjusted synchronously. The content display method according to claim 14, wherein, The resolution of the second display image is higher than that of the first display image; and / or The second field of view is smaller than the first field of view. According to the content display method of claim 1, wherein, After displaying the third display screen, the method further includes: In response to the user's movement operation on the second display screen, the position of the second display screen in the third display screen is adjusted, and / or the second field of view is adjusted. A content display system, wherein, The content display system includes at least: a display device, a first image acquisition device, a second image acquisition device, and a controller; The first image acquisition device is used to acquire a first image within a first field of view; The second image acquisition device is used to acquire a second image within a second field of view, which is different from the first field of view. The controller is configured to generate a first display screen based on the first image, generate a second display screen based on the second image, control the display device to display the first display screen, and detect whether the external driving environment information meets preset conditions; if the external driving environment information meets the preset conditions, control the display device to display a third display screen, the third display screen including the first display screen and the second display screen. The content display system according to claim 17, wherein, The system also includes at least one of the following: A distance sensor is used to detect the distance between the target object and the vehicle; A position sensor is used to obtain the current position of the vehicle. The content display system according to claim 18, wherein, The system also includes: A third image acquisition device has a field of view smaller than that of the second image acquisition device, and the clarity of the second image acquired by the third image acquisition device is higher than that of the second image acquired by the second image acquisition device. The controller is used to control the third image acquisition device to acquire images when the distance is greater than a preset distance threshold. The content display system according to claim 17, wherein, The system also includes: A touch device is used to receive a user's trigger operation and generate a trigger command based on the trigger operation and send it to the controller; The controller is configured to respond to the trigger command and control the display device to display the third display screen. The content display system according to claim 20, wherein, The touch device is the main control screen. The content display system according to any one of claims 17-21, wherein, The display device is a rearview mirror display screen. A type of vehicle, in which, The vehicle includes a controller for performing the steps of the content display method as described in any one of claims 1-16. An electronic device, wherein, The electronic device includes a processor and a memory, the memory storing programs or instructions that can run on the processor, the programs or instructions being executed by the processor to implement the steps of the content display method as described in any one of claims 1-16.

Images