Image display method and device, image display system and vehicle-mounted equipment

Abstract

The invention provides an image display method and device, an image display system and vehicle-mounted equipment, the image display method is applied to mobile equipment, the mobile equipment is loaded with a plurality of first-class cameras and a plurality of display screens, and the plurality of first-class cameras and the plurality of display screens are in one-to-one correspondence; the image display method comprises the following steps: acquiring an actual eye position of a user; based on the positions of the plurality of display screens and the actual eye position, determining a function relationship between the virtual eye position and the actual eye position of the user; obtaining first images respectively collected by the plurality of first-class cameras; based on a function relationship between the virtual eye position and the actual eye position, calibrating first images acquired by the plurality of first-class cameras respectively to obtain first calibration images corresponding to the plurality of first-class cameras respectively; and displaying the first calibration images corresponding to the plurality of first-class cameras on the display screens corresponding to the plurality of first-class cameras. According to the technical scheme, the driving safety can be improved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image display method and device, an image display system, and a vehicle-mounted device. Background Art

[0002] At present, the A-pillar of the vehicle cockpit can ensure the stability of the cockpit safety structure and ensure the personal safety of the occupants in the event of a collision. However, the A-pillar also brings blind spots to the driver. In order to solve the problem of the blind spot of the A-pillar, a display screen is installed at the A-pillar position to display the image of the blind spot. The picture clarity and display effect of the displayed image directly affect the driver's judgment of the environment outside the vehicle. However, at present, there are some problems with the images displayed on the display screen. Summary of the invention

[0003] In order to solve the above problems, the embodiments of the present application provide an image display method and device, an image display system, and a vehicle-mounted device.

[0004] In a first aspect, an embodiment of the present application provides an image display method, which is applied to a mobile device, wherein the mobile device is equipped with multiple first-class cameras and multiple display screens, and the multiple first-class cameras and the multiple display screens correspond one to one; the method includes: obtaining the actual eye position of the user; determining the functional relationship between the virtual eye position and the actual eye position of the user based on the positions of the multiple display screens and the actual eye position; obtaining a first image captured by each of the multiple first-class cameras; based on the functional relationship between the virtual eye position and the actual eye position, calibrating the first image captured by each of the multiple first-class cameras to obtain a first calibration image corresponding to each of the multiple first-class cameras; and displaying the first calibration image corresponding to each of the multiple first-class cameras on the display screen corresponding to each of the multiple first-class cameras.

[0005] In combination with the first aspect, the multiple display screens include a first display screen and a second display screen, and based on the positions of the multiple display screens and the actual eye positions, a functional relationship between the virtual eye position and the actual eye position of the user is determined, including: based on the position of the first display screen and the position of the second display screen, a center position of a line connecting the first display screen and the second display screen is determined, and the virtual eye position is located on a target plane passing through the center position, and the target plane is perpendicular to the line connecting the first display screen and the second display screen; based on the actual eye position and the center position, a functional relationship between the virtual eye position and the actual eye position is established; preferably, the position of the first display screen is the geometric center of the first display screen, the position of the second display screen is the geometric center of the second display screen, and the actual eye position is the center of a line connecting the user's two eyes; preferably, the multiple first-class cameras include a first-class first camera and a first-class second camera, the first-class first camera corresponds to the first display screen, and the first-class second camera corresponds to the second display screen.

[0006] In combination with the first aspect, the movable device is also equipped with multiple second-type cameras, the multiple second-type cameras correspond to the multiple first-type cameras one-to-one, and the multiple second-type cameras are installed at the same position as the corresponding first-type cameras. The method also includes: determining whether there is an abnormality in front of the movable device; if there is an abnormality in front of the movable device, determining the first calibration image containing the abnormality as the first target image, and determining the first-type target camera corresponding to the first target image; controlling the second-type target camera corresponding to the first-type target camera to turn on, and obtaining a second image captured by the second-type target camera, the second image containing the abnormality; displaying the first target image in the first area of ​​the target display screen corresponding to the first-type target camera, and displaying the second image in the second area of ​​the target display screen of the first-type target camera; preferably, after obtaining the second image captured by the second-type target camera, the method also includes: calibrating the second image based on the functional relationship between the virtual eye position and the actual eye position; preferably, the depth of field of the first-type camera is longer than the depth of field of the second-type camera; preferably, the first-type camera includes a long depth of field camera, and the second-type camera includes a short depth of field camera.

[0007] In combination with the first aspect, determining whether there is an abnormality in front of the movable device includes: using multiple first-class cameras to detect whether there is an abnormality in front of the movable device; or using at least one laser radar loaded on the movable device to detect whether there is an abnormality in front of the movable device.

[0008] In combination with the first aspect, the method further includes: if there is an abnormality in front of the movable device, issuing a voice reminder to the user; and / or if there is an abnormality in front of the movable device, marking the location of the abnormality in the first target image.

[0009] In combination with the first aspect, the method further includes: if there is no abnormality in front of the movable device, continuing to display the first calibration images corresponding to the multiple first-type cameras on the display screens corresponding to the multiple first-type cameras.

[0010] In a second aspect, an embodiment of the present application provides an image display device, which is applied to a movable device, wherein the movable device is equipped with multiple first-class cameras and multiple display screens, and the multiple first-class cameras and the multiple display screens correspond one to one. The image display device includes: an acquisition module, a determination module, a calibration module and a display module, wherein the acquisition module is used to acquire the actual eye position of the user; the determination module is used to determine the functional relationship between the virtual eye position and the actual eye position of the user based on the positions of the multiple display screens and the actual eye position; the acquisition module is also used to acquire first images captured by each of the multiple first-class cameras; the calibration module is used to calibrate the first images captured by each of the multiple first-class cameras based on the functional relationship between the virtual eye position and the actual eye position, and obtain first calibration images corresponding to each of the multiple first-class cameras; the display module is used to display the first calibration images corresponding to each of the multiple first-class cameras on the display screens corresponding to each of the multiple first-class cameras.

[0011] In a third aspect, an embodiment of the present application provides an image display system, which is applied to a movable device, and the image display system includes: an eye detection unit, an image acquisition unit, a display unit and a control unit; the eye detection unit is used to acquire the actual eye position of the user; the image acquisition unit includes multiple first-class cameras, and the first-class cameras are used to acquire a first image; the display unit includes multiple display screens, and the multiple display screens correspond to the multiple first-class cameras one-to-one, and the display screens are used to display the first images acquired by the first-class cameras; the control unit is used to obtain the actual eye position; based on the positions of the multiple display screens and the actual eye position, determine the functional relationship between the virtual eye position and the actual eye position of the user; obtain the first images acquired by each of the multiple first-class cameras; based on the functional relationship between the virtual eye position and the actual eye position, calibrate the first images acquired by each of the multiple first-class cameras to obtain the first calibration images corresponding to each of the multiple first-class cameras; and display the first calibration images corresponding to each of the multiple first-class cameras on the display screens corresponding to each of the multiple first-class cameras.

[0012] In combination with the third aspect, the image display system also includes: an abnormality detection unit, used to identify abnormalities in front of the movable device; the image acquisition unit also includes multiple second-type cameras, the second-type cameras correspond to the first-type cameras one-to-one, and the second-type cameras are used to acquire a second image; the control unit is also used to determine whether there is an abnormality in front of the movable device; if there is an abnormality in front of the movable device, the first calibration image containing the abnormality is determined as the first target image; the first-type target camera corresponding to the first target image is determined; the second-type target camera corresponding to the first-type target camera is controlled to turn on, and a second image acquired by the second-type target camera is obtained, and the second image contains the abnormality; the first target image is displayed in the first area of ​​the display screen corresponding to the first-type target camera, and the second image is displayed in the second area of ​​the display screen of the first-type target camera; preferably, the abnormality detection unit includes multiple second-type cameras, or the abnormality reminder unit includes at least one laser radar.

[0013] In a fourth aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the above-mentioned image display method is implemented.

[0014] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a processor; a memory, the memory being connected to the processor, the memory being used to store a computer program, and the computer program implementing the above-mentioned image display method when executed by the processor.

[0015] In a sixth aspect, an embodiment of the present application provides a computer program product, including computer program instructions, which implement the above-mentioned image display method when executed by a processor.

[0016] In a seventh aspect, an embodiment of the present application provides a vehicle-mounted device, comprising the above-mentioned image display system and a vehicle-mounted A-pillar, for displaying the image acquired by the above-mentioned image display system on the vehicle-mounted A-pillar.

[0017] Through the above technical solution, a functional relationship between the user's virtual eye position and the actual eye position is established. When the actual eye position changes, the virtual eye position changes accordingly; according to the functional relationship between the virtual eye position and the actual eye position, the first image captured by the first type of camera is calibrated, so that the calibrated first image can restore the actual scene seen by the user, which is beneficial to the judgment of the vehicle's driving conditions and improves driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a flowchart of an image display method provided in one embodiment of the present application.

[0019] Figure 2It is a flowchart of a method for determining a functional relationship between a virtual eye position and an actual eye position provided in an embodiment of the present application.

[0020] Figure 3 A diagram showing the relationship between a display screen and eye position is shown.

[0021] Figure 4 It is a flowchart of an image display method provided by another embodiment of the present application.

[0022] Figure 5 A schematic diagram of a display screen is shown.

[0023] Figure 6 It is a structural block diagram of an image display device provided in one embodiment of the present application.

[0024] Figure 7 It is a structural schematic diagram of an image display system provided in one embodiment of the present application.

[0025] Figure 8 It is a structural schematic diagram of an image display system provided in yet another embodiment of the present application.

[0026] Fig. 9 It is a schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] Usually, in order to display the blind spot image on the A-pillar, cameras are installed on the outside of the left front A-pillar and the right front A-pillar of the vehicle to collect images within the blind spot of the A-pillar. The installation position of the camera is based on the vehicle, that is, the left front camera and the right front camera are symmetrical, so the images captured by the left front camera and the right front camera are also symmetrical. However, the driving seat is usually on the left or right side. When the driver sits in the driving seat and observes the image captured by the camera, there is a deviation from the actual blind spot, which may affect driving safety.

[0029] In the face of the above technical problems, on the first aspect, an embodiment of the present application provides an image display method, which is applied to a mobile device, wherein the mobile device is equipped with multiple first-class cameras and multiple display screens, and the multiple first-class cameras correspond to the multiple display screens one by one. The method includes: obtaining the actual eye position of the user; determining the functional relationship between the virtual eye position and the actual eye position of the user based on the positions of the multiple display screens and the actual eye position; obtaining the first images captured by each of the multiple first-class cameras; calibrating the first images captured by each of the multiple first-class cameras based on the functional relationship between the virtual eye position and the actual eye position, and obtaining the first calibration images corresponding to each of the multiple first-class cameras; and displaying the first calibration images corresponding to each of the multiple first-class cameras on the display screens corresponding to each of the multiple first-class cameras. In an embodiment of the present application, a functional relationship between the virtual eye position and the actual eye position of the user is established, and the first image captured by the first-class camera is calibrated according to the functional relationship, so that the calibrated first image can restore the actual scene seen by the user (for example, the driver), which is more conducive to judging the driving conditions of the vehicle and improving driving safety. In an embodiment of the present application, since the user's sitting posture may change, by establishing a functional relationship between the virtual eye position and the actual eye position, when the user's actual eye position changes, the virtual eye position will also change. In this way, the first image can be calibrated in real time according to the functional relationship, thereby improving driving safety.

[0030] Figure 1 It is a flowchart of an image display method provided in one embodiment of the present application.

[0031] The image display method of the embodiment of the present application is applied to a movable device. In the embodiment of the present application, the movable device may include a vehicle, an aircraft (e.g., an airplane), etc. The movable device is equipped with a plurality of first-class cameras and a plurality of display screens, and the plurality of first-class cameras and the plurality of display screens correspond one to one. Specifically, the display screen can display the image captured by the corresponding first-class camera. Optionally, the plurality of first-class cameras include a first-class first camera and a first-class second camera, and the plurality of display screens include a first display screen and a second display screen, and the first-class first camera corresponds to the first display screen, and the first-class second camera corresponds to the second display screen. Exemplarily, the first display screen is located on the inside of the left A-pillar, and the second display screen is located on the inside of the right A-pillar; the first-class first camera is located on the left front (e.g., the outside of the left A-pillar) of the movable device (e.g., the vehicle), and is used to collect images including at least the blind spot of the left A-pillar, and the first-class second camera is located on the right front (e.g., the outside of the right A-pillar) of the movable device (e.g., the vehicle), and is used to collect images including at least the blind spot of the right A-pillar.

[0032] like Figure 1 As shown, the image display method of the embodiment of the present application includes the following steps.

[0033] Step S110, obtaining the actual eye position of the user.

[0034] In an embodiment of the present application, the user includes at least one of a driver and a passenger. Preferably, the user is a driver. The actual eye position of the user is the center of the line connecting the two eyes of the user. Optionally, an eye detection unit is installed inside a movable device (e.g., a vehicle), and the eye detection unit can detect the position of the two eyes of the user in real time, and then determine the center of the line connecting the two eyes as the actual eye position. Optionally, the eye detection unit includes a camera, and the camera can capture an image containing the two eyes of the user in real time, extract the position of the two eyes of the user in the image, and determine the center of the line connecting the two eyes as the actual eye position. Usually, in order to avoid user fatigue driving, a camera for detecting the eye state of the user is installed on the vehicle. Therefore, in an embodiment of the present application, there is no need to add an additional eye detection unit, and the existing camera can be directly used to detect the actual eye position.

[0035] During driving, the user's position or posture may change, for example, leaning forward, leaning back, lowering the head, raising the head, etc. Therefore, in an embodiment of the present application, the user's actual eye position can be obtained in real time so as to reflect the user's actual eye position in real time.

[0036] Step S120, determining a functional relationship between the user's virtual eye position and the actual eye position based on the positions of the multiple display screens and the actual eye position.

[0037] In the embodiment of the present application, the user's virtual eye position is at an equal distance from the first display screen and the second display screen. In addition, the user's virtual eye position has a mapping relationship with the actual eye position, that is, when the actual eye position changes, the virtual eye position changes synchronously. Therefore, it is necessary to establish a functional relationship between the virtual eye position and the actual eye position. For a detailed description of determining the functional relationship between the virtual eye position and the actual eye position, please refer to Figure 2 , I will not go into details here.

[0038] Step S130, obtaining first images captured by each of the plurality of first-type cameras.

[0039] In an embodiment of the present application, the plurality of first-category cameras include a first-category first camera and a first-category second camera, the first-category camera is used to capture images including at least the left-side A-pillar blind spot, and the second-category camera is used to capture images including at least the right-side A-pillar blind spot. It should be noted that the first image may only include a picture of the A-pillar blind spot, or the first image may include a picture of the A-pillar blind spot and a part of the surrounding environment. Since the movable device is in motion, the environment outside the vehicle changes in real time. Therefore, in an embodiment of the present application, the first images captured by each of the plurality of first-category cameras can be acquired in real time so as to reflect the surrounding environment outside the vehicle in real time.

[0040] Step S140, based on the functional relationship between the virtual eye position and the actual eye position, calibrate the first images captured by the multiple first-type cameras to obtain the first calibration images corresponding to the multiple first-type cameras.

[0041] Optionally, based on the functional relationship between the virtual eye position and the actual eye position, the first image captured by the first camera of the first category is calibrated to obtain a first calibration image corresponding to the first camera of the first category; the first image captured by the second camera of the first category is calibrated to obtain a first calibration image corresponding to the second camera of the first category. In the embodiment of the present application, a conventional calibration algorithm can be used to calibrate the first image, which will not be described in detail in the present application.

[0042] Step S150: displaying first calibration images corresponding to the plurality of first-type cameras on display screens corresponding to the plurality of first-type cameras.

[0043] Optionally, a first calibration image corresponding to the first camera of the first category is displayed on the first display screen, and a first calibration image corresponding to the second camera of the first category is displayed on the second display screen.

[0044] In an embodiment of the present application, a functional relationship is established between the user's virtual eye position and the actual eye position. When the actual eye position changes, the virtual eye position changes accordingly. The first image captured by the first type of camera is calibrated according to the functional relationship between the virtual eye position and the actual eye position, so that the calibrated first image can restore the actual scene seen by the user, which is beneficial to judge the vehicle's driving conditions and improve driving safety.

[0045] Figure 2 FIG. 1 is a flow chart of a method for determining a functional relationship between a virtual eye position and an actual eye position provided by an embodiment of the present application. Figure 2 As shown, the method includes the following steps.

[0046] Step S210: determining the center position of a line connecting the first display screen and the second display screen based on the position of the first display screen and the position of the second display screen.

[0047] In the embodiment of the present application, the virtual eye position is located on a target plane passing through the center position, and the target plane is perpendicular to the line connecting the first display screen and the second display screen. Optionally, the position of the first display screen is the geometric center of the first display screen, and the position of the second display screen is the geometric center of the second display screen.

[0048] Step S220, establishing a functional relationship between the virtual eye position and the actual eye position based on the actual eye position and the center position.

[0049] In an embodiment of the present application, based on the center position, a target plane passing through the center position and perpendicular to the line connecting the first display screen and the second display screen is determined. In this way, the coordinate data of the first direction of the virtual eye position can be determined. Based on the actual eye position, the coordinate data of the second direction and the third direction of the virtual eye position are determined. Optionally, the coordinate data of the second direction and the third direction of the virtual eye position are the same as the coordinate data of the second direction and the third direction of the actual eye position. In an embodiment of the present application, the first direction refers to the direction in which the first display screen points to the second display screen, the second direction refers to the direction of travel of the vehicle, and the third direction refers to the vertical direction. Since the actual eye position changes dynamically, the virtual eye position also changes dynamically, that is, the coordinate data of the second direction and the third direction of the virtual eye position changes dynamically.

[0050] For example, Figure 3 A diagram showing the relationship between a display screen and eye position is shown. Figure 3 As shown, the position (i.e., geometric center) of the first display screen 310 is 311, the position (i.e., geometric center) of the second display screen 320 is 321, the line connecting the first display screen 310 and the second display screen 320 is 330, the actual eye position is M, and the virtual eye position is M'. Among them, the plane 340 is perpendicular to the line connecting the first display screen 310 and the second display screen 320, and the virtual eye position M' is located on the plane 340. The coordinate data of the virtual eye position M' in the first direction (x direction) is determined according to the center position of the line connecting the first display screen 310 and the second display screen 320 330; the coordinate data of the virtual eye position M' in the second direction (y direction) and the third direction (z direction) are determined according to the coordinate data of the actual eye position M. In the embodiment of the present application, the virtual eye position M' is located on the plane 340, which can ensure that the distances from the virtual eye position M' to the first display screen 310 and the second display screen 320 are the same, and when the first image is calibrated using the established functional relationship, the calibration accuracy can be improved.

[0051] In some cases, obstacles may appear when a movable device (e.g., a vehicle) is in motion. If the obstacle appears in the blind spot of the A-pillar, the user can only view it through the image on the display screen. However, due to the size limitation of the A-pillar, the size of the display screen is narrow, and the obstacle may not be clearly seen on the image, making it impossible to respond in time. To this end, after detecting an obstacle, the embodiment of the present application displays an image of the obstacle area (i.e., an enlarged image of the obstacle area) in a partial area of ​​the display screen, so that the user can view the obstacle in time and respond in time. For details, please refer to Figure 4 Description in .

[0052] Figure 4 FIG. 1 is a flow chart of an image display method provided by another embodiment of the present application. Figure 4 As shown, the method includes the following steps.

[0053] Step S410, determining whether there is an abnormality in front of the movable device.

[0054] In the embodiment of the present application, the abnormality includes an obstacle in front of the vehicle, or other abnormal conditions. Optionally, whether there is an abnormality is determined based on the distance between the obstacle and the vehicle and the speed of the vehicle. For example, if the vehicle is moving at a high speed, an obstacle at a long distance may be identified as an abnormality; if the vehicle is moving at a slow speed, an obstacle at a long distance is not an abnormality.

[0055] Optionally, multiple first-class cameras can be used to detect whether there is an abnormality in front of the movable device. Furthermore, after the abnormality is detected, the position of the abnormality is marked in the first image captured by the first-class camera. Alternatively, at least one laser radar loaded on the movable device is used to detect whether there is an abnormality in front of the movable device. Usually, a vehicle is equipped with multiple laser radars for detecting the surrounding environment. Therefore, the existing laser radar can be directly used for detection without reinstallation. For another example, the first-class camera and the laser radar can be combined to jointly determine whether there is an abnormality in front of the movable device, thereby improving the accuracy of abnormality detection.

[0056] In the embodiment of the present application, if it is determined that there is no abnormality in front of the movable device, step S450 is executed. In step S450, the first calibration images corresponding to the multiple first-type cameras are continuously displayed on the display screens corresponding to the multiple first-type cameras. That is, the image captured by the first camera is displayed normally. If it is determined that there is an abnormality in front of the movable device, step S420 is executed.

[0057] Step S420: determine the first calibration image containing the anomaly as the first target image, and determine the first type of target camera corresponding to the first target image.

[0058] In an embodiment of the present application, if an abnormality is detected in the first (calibrated) image taken by the first type of camera, the first (calibrated) image is determined as the first target image, and the first type of camera is directly determined as the first type of target camera. Optionally, the location of the abnormality is marked in the first target image to remind the user of the area where the abnormality occurs. Optionally, if there is an abnormality in front of the movable device, a voice reminder can be issued to the user. For example, a reminder that there is an obstacle in front (for example, the left front, the right front, the front, etc.), or a reminder of the specific type of obstacle, or a reminder to the driver to slow down or drive carefully, etc.

[0059] Step S430, controlling the second type target camera corresponding to the first type target camera to start, and acquiring a second image captured by the second type target camera.

[0060] In an embodiment of the present application, the mobile device is also equipped with a plurality of second-class cameras. The plurality of second-class cameras correspond one-to-one to the plurality of first-class cameras, and the plurality of second-class cameras are installed at the same position as the respective corresponding first-class cameras. It should be noted that "the same position" means that the second-class cameras and the respective corresponding first-class cameras are installed on the left A-pillar, the right A-pillar, etc. In this way, the first-class camera and the corresponding second-class camera can capture images within the same field of view. For example, the second-class camera can capture images of any area within the field of view of the first-class camera. In an embodiment of the present application, the depth of field of the first-class camera is longer than the depth of field of the second-class camera. Exemplarily, the first-class camera includes a long depth of field camera, and the second-class camera includes a short depth of field camera. In an embodiment of the present application, the second image contains the above-mentioned anomaly. Specifically, the position of the anomaly is marked in the first target image, and an enlarged view of the anomaly is displayed in the second image, so that the user can clearly view the type of anomaly, so as to avoid it in time or take emergency measures.

[0061] Optionally, after acquiring the second image, the method further includes: calibrating the second image based on the functional relationship between the virtual eye position and the actual eye position. That is, the second image is also a calibrated image, so that the abnormal situation can be accurately displayed, which is convenient for the user to judge the abnormality.

[0062] Step S440: displaying a first target image in a first area of ​​a target display screen corresponding to the first type of target camera, and displaying a second image in a second area of ​​the target display screen corresponding to the first type of target camera.

[0063] In the embodiment of the present application, when an abnormal situation occurs, the target display screen corresponding to the first type of target camera is displayed in a partitioned manner, with the first target image displayed in the first area and the second image displayed in the second area. Figure 5As shown, the first area 510 is located in the upper area of ​​the target display screen, and the second area 520 is located in the lower area of ​​the target display screen. It should be noted that the division of the first area and the second area is controlled by an algorithm, and the target display screen is not structurally divided into the first area and the second area. Therefore, the first area and the second area can be adjusted by adjusting the algorithm.

[0064] In an embodiment of the present application, when there is an abnormality, the first type of camera and the second type of camera are turned on at the same time, and a magnified picture of the abnormality is displayed in the second image taken by the second type of camera, which is beneficial for the user to judge the abnormality, take corresponding measures in time, and improve driving safety.

[0065] In a second aspect, an embodiment of the present application also provides an image display device.

[0066] Figure 6 1 is a structural block diagram of an image display device provided by an embodiment of the present application. The image display device is applied to a mobile device, and the mobile device is equipped with a plurality of first-class cameras and a plurality of display screens, and the plurality of first-class cameras and the plurality of display screens correspond to each other. Figure 6 As shown, the image display device 600 includes an acquisition module 610 , a determination module 620 , a calibration module 630 and a display module 640 .

[0067] The acquisition module 610 is used to acquire the actual eye position of the user.

[0068] The determination module 620 is used to determine the functional relationship between the user's virtual eye position and the actual eye position based on the positions of multiple display screens and the actual eye position.

[0069] Optionally, the multiple display screens include a first display screen and a second display screen. The determination module 620 is further configured to determine the center position of a line connecting the first display screen and the second display screen based on the position of the first display screen and the position of the second display screen, the virtual eye position is located on a target plane passing through the center position, and the target plane is perpendicular to the line connecting the first display screen and the second display screen; and based on the actual eye position and the center position, establish a functional relationship between the virtual eye position and the actual eye position.

[0070] The acquisition module 610 is further configured to acquire first images captured by each of the plurality of first-type cameras.

[0071] The calibration module 630 is used to calibrate the first images captured by each of the multiple first-type cameras based on the functional relationship between the virtual eye position and the actual eye position, so as to obtain the first calibration images corresponding to each of the multiple first-type cameras.

[0072] The display module 640 is used to display the first calibration images corresponding to the multiple first-type cameras on the display screens corresponding to the multiple first-type cameras.

[0073] Optionally, the movable device is also equipped with a plurality of second-class cameras, the plurality of second-class cameras correspond to the plurality of first-class cameras one-to-one, and the plurality of second-class cameras are installed at the same position as the first-class cameras corresponding to each other. The determination module 620 is also used to determine whether there is an abnormality in front of the movable device; if there is an abnormality in front of the movable device, the first calibration image containing the abnormality is determined as the first target image, and the first-class target camera corresponding to the first target image is determined; the second-class target camera corresponding to the first-class target camera is controlled to be turned on, and the second image captured by the second-class target camera is obtained, and the second image contains the abnormality. The display module 640 displays the first target image in the first area of ​​the target display screen corresponding to the first-class target camera, and displays the second image in the second area of ​​the target display screen of the first-class target camera. Optionally, the calibration module 630 is also used to calibrate the second image based on the functional relationship between the virtual eye position and the actual eye position.

[0074] Optionally, the determination module 620 is further used to detect whether there is any abnormality in front of the movable device using multiple first-category cameras; or, to detect whether there is any abnormality in front of the movable device using at least one laser radar loaded on the movable device.

[0075] The specific working principle and benefits of the image display device provided in the embodiment of the present application are similar to the specific working principle and benefits of the image display method provided in the embodiment of the present application, and will not be repeated here.

[0076] In a third aspect, an embodiment of the present application provides an image display system.

[0077] Figure 7 Schematic diagram of the structure of an image display system provided by an embodiment of the present application. Figure 7 As shown, the image display system 700 includes an eye detection unit 710 , an image acquisition unit 720 , a display unit 730 and a control unit 740 .

[0078] The eye detection unit 710 is used to collect the actual eye position of the user. Optionally, the eye detection unit 710 includes a camera.

[0079] The image acquisition unit 720 includes a plurality of first-type cameras, and the first-type cameras are used to acquire a first image.

[0080] The display unit 730 includes multiple display screens, and the multiple display screens correspond to the multiple first-type cameras one by one. The display screens are used to display the first images captured by the first-type cameras.

[0081] The control unit 740 is used to obtain the actual eye position; determine the functional relationship between the user's virtual eye position and the actual eye position based on the positions of multiple display screens and the actual eye position; obtain the first images captured by each of the multiple first-class cameras; based on the functional relationship between the virtual eye position and the actual eye position, calibrate the first images captured by each of the multiple first-class cameras to obtain the first calibration images corresponding to each of the multiple first-class cameras; and display the first calibration images corresponding to each of the multiple first-class cameras on the display screens corresponding to each of the multiple first-class cameras.

[0082] Figure 8 It is a structural schematic diagram of an image display system provided in yet another embodiment of the present application. Figure 8 The image display system 800 shown is Figure 7 The difference of the image display system 700 shown is that the image display system 800 also includes an abnormality detection unit 750. The abnormality detection unit 750 is used to identify abnormalities in front of the movable device. In the embodiment of the present application, the abnormality detection unit 750 includes a plurality of second-class cameras, or includes at least one laser radar. The image acquisition unit 720 also includes a plurality of second-class cameras, the second-class cameras correspond to the first-class cameras one by one, and the second-class cameras are used to acquire the second image.

[0083] The control unit 740 is also used to determine whether there is an abnormality in front of the movable device; if there is an abnormality in front of the movable device, determine the first calibration image containing the abnormality as the first target image; determine the first type of target camera corresponding to the first target image; control the second type of target camera corresponding to the first type of target camera to turn on, and obtain a second image captured by the second type of target camera, the second image containing the abnormality; display the first target image in the first area of ​​the display screen corresponding to the first type of target camera, and display the second image in the second area of ​​the display screen of the first type of target camera.

[0084] The specific working principle and benefits of the image display system provided in the embodiment of the present application are similar to the specific working principle and benefits of the image display method provided in the embodiment of the present application, and will not be repeated here.

[0085] Below, reference Fig. 9 To describe an electronic device according to an embodiment of the present application. Fig. 9 It is a schematic diagram of the structure of an electronic device provided in one embodiment of the present application.

[0086] like Fig. 9 As shown, the electronic device 900 includes one or more processors 901 and a memory 902 .

[0087] The processor 901 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 900 to perform desired functions.

[0088] The memory 902 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 901 may run the program instructions to implement the image display method of each embodiment of the present application described above and / or other desired functions. Various contents such as a first (calibration) image, a second image, etc. may also be stored in the computer-readable storage medium.

[0089] In one example, the electronic device 900 may further include: an input device 903 and an output device 904 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0090] The input device 903 may include, for example, a keyboard, a mouse, etc.

[0091] The output device 904 can output various information to the outside, including the first calibration image, the second image, etc. The output device 904 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0092] Of course, to simplify, Fig. 9 Only some of the components related to the present application in the electronic device 900 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 900 may also include any other appropriate components.

[0093] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the image display method according to various embodiments of the present application described above in this specification.

[0094] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0095] In addition, an embodiment of the present application may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the image display method according to various embodiments of the present application described above in this specification.

[0096] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0097] The embodiment of the present application may also be a vehicle-mounted device, including the above-mentioned image display system and a vehicle-mounted A-pillar, which is used to display the image acquired by the image display system on the vehicle-mounted A-pillar.

[0098] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0099] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0100] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0101] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0102] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. An image display method, characterized in that: Applied to a mobile device, the mobile device is equipped with a plurality of first-class cameras and a plurality of display screens, and the plurality of first-class cameras and the plurality of display screens correspond one to one; the method comprises: Get the user's actual eye position; Determining a functional relationship between a virtual eye position of the user and the actual eye position based on the positions of the plurality of display screens and the actual eye position; Acquire a first image captured by each of the plurality of first-category cameras; Based on the functional relationship between the virtual eye position and the actual eye position, calibrate the first images captured by the plurality of first-category cameras to obtain first calibration images corresponding to the plurality of first-category cameras; The first calibration images corresponding to each of the plurality of first-type cameras are displayed on display screens corresponding to each of the plurality of first-type cameras.

2. The method according to claim 1, characterized in that The plurality of display screens include a first display screen and a second display screen, and determining a functional relationship between a virtual eye position of the user and the actual eye position based on positions of the plurality of display screens and the actual eye position includes: Based on the position of the first display screen and the position of the second display screen, determine the center position of the line connecting the first display screen and the second display screen, the virtual eye position is located on a target plane passing through the center position, and the target plane is perpendicular to the line connecting the first display screen and the second display screen; Based on the actual eye position and the center position, establishing a functional relationship between the virtual eye position and the actual eye position; Preferably, the position of the first display screen is the geometric center of the first display screen, the position of the second display screen is the geometric center of the second display screen, and the actual eye position is the center of the line connecting the two eyes of the user; Preferably, the multiple first-category cameras include a first-category first camera and a first-category second camera, the first-category first camera corresponds to the first display screen, and the first-category second camera corresponds to the second display screen.

3. The method according to claim 1, characterized in that The mobile device is also equipped with a plurality of second-type cameras, the plurality of second-type cameras correspond to the plurality of first-type cameras one by one, and the plurality of second-type cameras and the first-type cameras corresponding to each other are installed at the same position, and the method further includes: Determining whether there is an abnormality in front of the movable device; If there is an abnormality in front of the movable device, determining the first calibration image containing the abnormality as a first target image, and determining a first type of target camera corresponding to the first target image; Controlling the second type of target camera corresponding to the first type of target camera to start, and obtaining a second image captured by the second type of target camera, wherein the second image contains the anomaly; Display the first target image in a first area of ​​a target display screen corresponding to the first type of target camera, and display the second image in a second area of ​​the target display screen of the first type of target camera; Preferably, after acquiring the second image captured by the second-category target camera, the method further comprises: calibrating the second image based on a functional relationship between the virtual eye position and the actual eye position; Preferably, the depth of field of the first type of camera is longer than the depth of field of the second type of camera; Preferably, the first type of camera includes a long depth of field camera, and the second type of camera includes a short depth of field camera.

4. The method according to claim 3, characterized in that The determining whether there is an abnormality in front of the movable device comprises: The plurality of first-category cameras are used to detect whether there is any abnormality in front of the movable device; or, at least one laser radar loaded on the movable device is used to detect whether there is any abnormality in front of the movable device.

5. The method according to claim 3, characterized in that: Also includes: If there is an abnormality in front of the movable device, a voice reminder is issued to the user; and / or, If there is an abnormality in front of the movable device, the position of the abnormality is marked in the first target image.

6. The method according to claim 3, characterized in that Also includes: If there is no abnormality in front of the movable device, the first calibration images corresponding to the multiple first-type cameras continue to be displayed on the display screens corresponding to the multiple first-type cameras.

7. An image display device, characterized in that: Applied to a mobile device, the mobile device is equipped with a plurality of first-class cameras and a plurality of display screens, the plurality of first-class cameras and the plurality of display screens correspond one to one, and the image display device comprises: An acquisition module, used to acquire the actual eye position of the user; a determination module, configured to determine a functional relationship between a virtual eye position of the user and the actual eye position based on the positions of the plurality of display screens and the actual eye position; The acquisition module is further used to acquire the first images captured by each of the plurality of first-type cameras; A calibration module, configured to calibrate the first images captured by the plurality of first-category cameras respectively based on a functional relationship between the virtual eye position and the actual eye position, so as to obtain first calibration images corresponding to the plurality of first-category cameras respectively; The display module is used to display the first calibration images corresponding to each of the multiple first-type cameras on the display screens corresponding to each of the multiple first-type cameras.

8. An image display system, characterized in that: Applied to a mobile device, the image display system comprises: An eye detection unit, used to collect the actual eye position of the user; An image acquisition unit, comprising a plurality of first-type cameras, wherein the first-type cameras are used to acquire a first image; A display unit, comprising a plurality of display screens, wherein the plurality of display screens correspond to the plurality of first-type cameras in a one-to-one manner, and the display screens are used to display first images captured by the first-type cameras; A control unit, the control unit is used to obtain the actual eye position; determine the functional relationship between the virtual eye position of the user and the actual eye position based on the positions of the multiple display screens and the actual eye position; obtain the first image captured by each of the multiple first-category cameras; based on the functional relationship between the virtual eye position and the actual eye position, calibrate the first image captured by each of the multiple first-category cameras to obtain a first calibration image corresponding to each of the multiple first-category cameras; and display the first calibration image corresponding to each of the multiple first-category cameras on the display screens corresponding to each of the multiple first-category cameras.

9. The image display system according to claim 8, characterized in that: Also includes: an anomaly detection unit, configured to identify an anomaly in front of the movable device; The image acquisition unit further includes a plurality of second-type cameras, the second-type cameras correspond to the first-type cameras one by one, and the second-type cameras are used to acquire second images; The control unit is also used to determine whether there is an abnormality in front of the movable device; If there is an abnormality in front of the movable device, determining the first calibration image including the abnormality as a first target image; Determine a first type of target camera corresponding to the first type of target image; control a second type of target camera corresponding to the first type of target camera to start, and obtain a second image captured by the second type of target camera, wherein the second image contains the anomaly; display the first target image in a first area of ​​a display screen corresponding to the first type of target camera, and display the second image in a second area of ​​the display screen of the first type of target camera; Preferably, the abnormality detection unit includes the multiple second-type cameras, or the abnormality reminder unit includes at least one laser radar.

10. A vehicle-mounted device, characterized in that: It comprises the image display system as claimed in claim 8 or 9 and a vehicle-mounted A-pillar, and is used to display the image acquired by the image display system on the vehicle-mounted A-pillar.

Images