Method, device, apparatus and computer-readable storage medium for displaying images

Abstract

The present application discloses a method, apparatus, device, and computer-readable storage medium for displaying images, belonging to the field of display technology. The method comprises: acquiring a first image corresponding to a vehicle, the first image corresponding to a first display range, the first display range being a range around the outside of the vehicle; acquiring at least one second image corresponding to the vehicle, the at least one second image corresponding to at least one second display range, each second display range in the at least one second display range being a range in a reference direction outside the vehicle; splicing the first image and the second image to obtain a third image, the third image corresponding to a third display range, the third display range being larger than the first display range, and the third display range being larger than each second display range; acquiring a fourth image based on the third image, and displaying the fourth image.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of display technology, and in particular to a method, apparatus, device, and computer-readable storage medium for displaying an image. Background Art

[0002] With the continuous development of display technology, more and more scenarios are being applied to it, and assisted driving is one of them. In assisted driving scenarios, after obtaining an image of the vehicle's exterior, the image is displayed, allowing people inside the vehicle to understand the external situation by observing the image, thus playing a role in assisting driving.

[0003] In related technologies, a 360-degree surround view system captures and displays images of the vehicle's exterior. This image corresponds to a specific display range: the 360-degree range outside the vehicle, with the edge of the display range 2 to 3 meters from the vehicle's exterior. In other words, by viewing this image, a person inside the vehicle can understand the situation within a 2 to 3-meter radius surrounding the vehicle.

[0004] However, the display range corresponding to this type of image is small, and the information that people inside the vehicle can understand about the situation outside the vehicle by viewing this type of image is limited, which is very restrictive. Summary of the Invention

[0005] The embodiments of the present application provide a method, apparatus, device, and storage medium for displaying images, which can be used to solve the problems existing in the related art. The technical solution is as follows:

[0006] In one aspect, an embodiment of the present application provides a method for displaying an image, the method comprising:

[0007] Acquire a first image corresponding to the vehicle, where the first image corresponds to a first display range, and the first display range is a range around the outside of the vehicle;

[0008] Acquire at least one second image corresponding to the vehicle, wherein the at least one second image corresponds to at least one second display range, and each second display range of the at least one second display range is a range in a reference direction outside the vehicle;

[0009] splicing the first image and the second image to obtain a third image, where the third image corresponds to a third display range, the third display range is larger than the first display range, and the third display range is larger than each second display range;

[0010] A fourth image is acquired based on the third image, and the fourth image is displayed.

[0011] In another aspect, a device for displaying an image is provided, the device comprising:

[0012] A first acquisition module is configured to acquire a first image corresponding to the vehicle, wherein the first image corresponds to a first display range, and the first display range is a range around the outside of the vehicle;

[0013] a second acquisition module, configured to acquire at least one second image corresponding to the vehicle, wherein the at least one second image corresponds to at least one second display range, and each second display range of the at least one second display range is a range in a reference direction outside the vehicle;

[0014] a splicing module, configured to splice the first image and the second image to obtain a third image, wherein the third image corresponds to a third display range, the third display range being larger than the first display range, and the third display range being larger than each second display range;

[0015] The display module is configured to acquire a fourth image based on the third image and display the fourth image.

[0016] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor so that the computer device implements any of the above-mentioned methods for displaying an image.

[0017] On the other hand, a computer-readable storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to enable a computer to implement any of the above-mentioned methods for displaying an image.

[0018] In another aspect, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the aforementioned methods for displaying an image.

[0019] The technical solutions provided by the embodiments of the present application bring at least the following beneficial effects:

[0020] The first and second vehicle images are first stitched together to create a third image with a larger display area. The third image is then processed to create and display a fourth image, also with a larger display area. This allows passengers inside the vehicle to fully understand the situation outside the vehicle by viewing the displayed fourth image, reducing blind spots and facilitating correct driving, improving driving safety and enhancing the practicality of the driver assistance system. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] Figure 1 This is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0023] Figure 2 This is a module diagram of a method for displaying an image provided by an embodiment of the present application;

[0024] Figure 3 is a flowchart of a method for displaying an image provided by an embodiment of the present application;

[0025] Figure 4 is a schematic diagram of a first display range provided in an embodiment of the present application;

[0026] Figure 5 is a schematic diagram of a second display range provided in an embodiment of the present application;

[0027] Figure 6 is a schematic diagram of a first display range and a second display range provided in an embodiment of the present application;

[0028] Figure 7 is a schematic diagram of a third display range provided in an embodiment of the present application;

[0029] Figure 8 is a schematic diagram of a driver's field of view provided in an embodiment of the present application;

[0030] Figure 9 Schematic diagram of a device for displaying images provided in an embodiment of the present application;

[0031] Figure 10 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0033] Please refer to Figure 1 , Figure 1 A schematic diagram of an implementation environment provided by an embodiment of the present application is shown. The implementation environment may include: a vehicle 11 and a computer device 12 installed in vehicle 11. Computer device 12 may apply the image display method provided by an embodiment of the present application. For example, after acquiring a first image and a second image, computer device 12 may stitch the first and second images together to obtain a third image, and then acquire and display a fourth image based on the third image.

[0034] Optionally, the computer device 12 may be a smart device such as a mobile phone, a tablet computer, a personal computer, a smart car machine, etc. In the embodiment of the present application, the installation location of the computer device 12 for displaying images on the vehicle 11 is not limited. For example, the installation location includes but is not limited to a location easily visible to the driver, such as the right side of the steering wheel.

[0035] Those skilled in the art should understand that the above-mentioned computer device 12 is only an example, and other existing or future computer devices that are applicable to this application should also be included in the scope of protection of this application and are included here by reference.

[0036] For example, Figure 2 A module diagram of a method for displaying an image is shown, and the connection relationship between each module (including a camera, a unit or a display screen) is described as follows.

[0037] The left electronic exterior mirror camera is connected to the left electronic exterior mirror image processing unit, which is connected to both the left exterior mirror display and the image cropping unit. The right electronic exterior mirror camera is connected to the right electronic exterior mirror image processing unit, which is connected to both the right exterior mirror display and the image cropping unit. Furthermore, the left 360° surround view camera, front 360° surround view camera, rear 360° surround view camera, and right 360° surround view camera are each connected to the image cropping unit. The image cropping unit is also connected to the image stitching unit, which is in turn connected to the image display unit.

[0038] For example, each module can be connected to a bus, thereby being connected via the bus. Figure 2Not shown. Alternatively, wireless connection can be established between the modules. In addition, the above-mentioned left electronic exterior rearview mirror camera refers to the camera installed at the electronic exterior rearview mirror on the left side of the vehicle. The camera can also be installed at other locations according to actual needs, which is not limited here. Of course, in addition to being installed at the electronic exterior rearview mirror on the right side of the vehicle, the above-mentioned right electronic exterior rearview mirror camera can also be installed at other locations according to actual needs, which is not limited here. In addition, the above Figure 2 The functions of each module shown are detailed below. Figure 3 The corresponding method embodiments will not be described in detail here.

[0039] The embodiment of the present application provides a method for displaying an image. Figure 3 As shown, this method is applied to Figure 1 Taking the computer device shown in FIG. 1 as an example, the method includes the following steps 301 to 304 .

[0040] Step 301: Acquire a first image corresponding to a vehicle.

[0041] The first image corresponds to the first display range, which is the range of one circle around the vehicle, or the range of one circle around the vehicle, and one circle or one circle is 360°. Figure 4 As shown, the shaded portion shows an exemplary first display range.

[0042] For example, the vehicle is equipped with a 360° surround view camera, and the embodiment of the present application can obtain the first image through the 360° surround view camera. The 360° surround view camera includes Figure 2 The left 360° surround view camera, right 360° surround view camera, front 360° surround view camera, and rear 360° surround view camera are shown. The left 360° surround view camera captures images of the left side of the vehicle, the right 360° surround view camera captures images of the right side of the vehicle, the front 360° surround view camera captures images in front of the vehicle, and the rear 360° surround view camera captures images behind the vehicle. Figure 2 The image stitching unit shown can stitch the image on the left side of the vehicle, the image on the right side of the vehicle, the image in front of the vehicle, and the image behind the vehicle to obtain a first image with a first display range.

[0043] In some embodiments, step 301 is performed continuously, for example, after detecting that a driver or passenger has entered the vehicle. In other embodiments, step 301 is performed only when certain conditions are met. Compared to continuously performing step 301, performing step 301 only when certain conditions are met can reduce resource waste and conserve resources. Exemplarily, performing step 301 only when certain conditions are met includes, but is not limited to, the following methods.

[0044] Method 1: receiving an image display request, and executing step 301 based on the image display request.

[0045] The image display request is used to instruct the display of an image used for assisted driving. The driver of the vehicle understands the environment outside the vehicle by observing the image used for assisted driving and determines the next operation he needs to perform. For example, when the driver observes the image used for assisted driving while reversing and sees another vehicle approaching from behind the vehicle he is driving, the driver stops the vehicle in time and waits for the other vehicle to pass before continuing to reverse. Receiving the image display request indicates that the driver or passenger has the intention to observe the image, so step 301 can be executed to trigger the execution of the method provided in the embodiment of the present application and satisfy the intention.

[0046] Exemplarily, receiving an image display request includes the following receiving method 1 and receiving method 2.

[0047] Receiving mode 1 involves real-time detection and recognition of sound information from a reference subject. When the reference subject's sound information is detected and recognized as "display image" or a similarly meaningful content, it indicates that an image display request has been received, and step 301 is executed. The reference subject includes the vehicle driver and the subjects riding in the vehicle (i.e., passengers).

[0048] Receiving method 2: Real-time detection of a reference subject's gesture. When the reference subject's gesture is detected as a reference gesture, it indicates that an image display request has been received, and step 301 is executed. The reference gesture may be, for example, a click on a display screen for a duration exceeding a first duration. The first duration may be customized by the reference subject, and neither the first duration nor the reference gesture is limited in this embodiment of the application.

[0049] In a second method, reference information of vehicle components used by the driver is obtained. If the reference information of vehicle components used by the driver meets a first condition, step 301 is executed.

[0050] The vehicle components used by the driver include, but are not limited to, at least one of the vehicle's steering wheel, turn signal switch, and tires, and are not limited in this embodiment of the present application. Accordingly, the reference information of the vehicle components used by the driver can be information related to the driver's operation of the vehicle components or changes in the parameters of the vehicle components themselves. Those skilled in the art can set this reference information based on experience. The reference information of the vehicle components meeting the first condition includes: the reference information of the vehicle components meeting the threshold corresponding to the vehicle components.

[0051] In the second approach described above, whether the vehicle component reference information represents information about the driver's operation of the vehicle component or changes in the parameters of the vehicle component itself, it can reflect the driver's operation of the vehicle component, as changes in the parameters of the vehicle component itself are also caused by the driver's operation of the vehicle component. Therefore, if the vehicle component reference information meets the first condition, executing step 301 is equivalent to triggering the execution of step 301 based on the driver's operation. This not only makes the vehicle's driving assistance function more complete and user-friendly, but also enables the driver to better operate the vehicle, as the driver often needs to observe the surrounding images when operating the vehicle.

[0052] For example, if a vehicle component used by the driver includes the vehicle's steering wheel, the steering wheel reference information includes the angle at which the driver turns the steering wheel, which can be obtained in real time by a steering parameter tester. The steering wheel reference information satisfies a first condition: the angle at which the driver turns the steering wheel exceeds a threshold while the vehicle is in motion. For example, the steering wheel angle threshold is set to 20 degrees. When the steering parameter tester detects that the driver has turned the steering wheel by more than 20 degrees while the vehicle is in motion, step 301 is executed.

[0053] For example, if a vehicle component used by the driver includes a turn signal switch, the reference information of the turn signal switch includes whether the turn signal switch is under pressure, which can be obtained in real time by a pressure sensor. In this case, the reference information of the turn signal switch meeting the first condition includes: the turn signal switch is under pressure. For example, if the pressure sensor detects that the turn signal switch is under pressure, it indicates that the driver has pressed the turn signal switch, and step 301 is executed.

[0054] Taking the example of a vehicle component used by a driver, including tires, tire reference information includes the tire's angle changes during driving, which can be measured in real time by a tire steering angle measurement device. The tire reference information satisfies a first condition, including: the tire's steering angle being greater than a tire steering threshold. For example, if the tire steering threshold is 45 degrees, step 301 is executed when the tire's steering angle is detected to be greater than 45 degrees.

[0055] Method three: obtaining the location information of the vehicle, and executing step 301 when the location information of the vehicle meets the second condition.

[0056] Among them, the location information of the vehicle includes at least one of the current location of the vehicle and the time when the vehicle is at the current location. Correspondingly, the second condition is satisfied including at least one of the current location of the vehicle being a special road section and the time when the vehicle is at the current location being in a time period with frequent accidents. Special road sections include but are not limited to traffic light intersections, busy areas, etc., and the embodiments of the present application do not limit this. Among them, the location information of the vehicle satisfies the second condition, that is, the driver is in a special road section or in a time period with frequent accidents during driving, indicating that the environment around the vehicle is complex. The driver needs to pay more attention to the environment around the vehicle when performing driving operations to avoid accidents. Therefore, step 301 needs to be executed to trigger the execution of the method provided in the embodiments of the present application to assist the driver in driving in a complex environment.

[0057] Step 302: Acquire at least one second image corresponding to the vehicle.

[0058] The at least one second image corresponds to the at least one second display range, and each of the at least one second display range is a range in a reference direction outside the vehicle. The reference direction outside the vehicle can be any direction around the vehicle. Figure 5 , the shaded portion shows an exemplary second display range, and the reference directions corresponding to the second display range include: the left rear and right rear of the vehicle. This reference direction is only an example, and the reference directions provided in the embodiments of the present application are not limited thereto.

[0059] For example, the distance from the edge of the second display range to the outside of the vehicle in a reference direction is a first distance, and the distance from the edge of the first display range to the outside of the vehicle in the reference direction is a second distance, and the first distance is greater than the second distance. For example, the second distance may be 2-3 meters, and the first distance may be 5-6 meters or even greater. Figure 6 As shown, the Figure 6 A first display range and a second display range are shown. In the reference direction of the left rear of the vehicle, the first distance from the edge of the second display range to the outside of the vehicle is greater than the second distance from the edge of the first display range to the outside of the vehicle. In the reference direction of the right rear of the vehicle, the first distance from the edge of the second display range to the outside of the vehicle is also greater than the second distance from the edge of the first display range to the outside of the vehicle.

[0060] In some embodiments, step 302 may be performed continuously, and in other embodiments, step 302 may be performed again when certain conditions are met. The certain conditions that need to be met can be found in the description of methods 1, 2, and 3 in step 301 above, and will not be repeated here.

[0061] In some embodiments, the second image is captured by other cameras besides the 360° surround view camera, including but not limited to Figure 2 In some other embodiments, obtaining at least one second image corresponding to the vehicle includes: obtaining at least one corresponding second image based on at least one fifth image. The fifth image is obtained by the other camera mentioned above, and the process of obtaining the second image based on the fifth image can be performed by Figure 2 The left electronic exterior rearview mirror image processing unit and the right electronic exterior rearview mirror image processing unit shown are executed. At least one fifth image corresponds to at least one reference range, and each reference range in the at least one reference range is a range in a reference direction outside the vehicle. The reference range in a reference direction can be larger than the second display range in the reference direction, that is, a part of the fifth image in a reference direction can be used as the second image in the reference direction, for example, the fifth image in a reference direction is processed to obtain the second image in the reference direction. Alternatively, the reference range in a reference direction can also be equal to the second display range in the reference direction, that is, the fifth image in a reference range is directly used as the second image in the reference direction. Alternatively, the reference range in a reference direction can also be equal to the second display range in the reference direction, for example, image prediction and supplementation are performed on the basis of the fifth image in a reference direction to obtain the second image in the reference direction.

[0062] Exemplarily, in an embodiment of the present application, it is determined whether the fifth image produces image distortion, noise or insufficient clarity, and based on the obtained judgment result (used to indicate whether the fifth image produces distortion, noise or insufficient clarity), it is determined based on at least one fifth image to obtain at least one corresponding second image.

[0063] In some embodiments, based on the at least one fifth image, obtaining the corresponding at least one second image includes: if the judgment result indicates that the fifth image has no distortion, noise or insufficient clarity, using the fifth image as the second image.

[0064] The fifth image does not produce distortion, noise, or lack of clarity, indicating that the fifth image will not affect the driver's understanding of the environment around the vehicle, and thus the fifth image can be directly used as the second image.

[0065] Alternatively, in other embodiments, based on at least one fifth image, obtaining at least one corresponding second image includes: if the judgment result indicates that the fifth image has distortion, noise or insufficient clarity, processing the fifth image to obtain the second image.

[0066] If the fifth image exhibits distortion, noise, or lacks clarity, and is displayed directly without processing, it will affect the driver's understanding of the vehicle's surroundings. Therefore, the fifth image needs to be processed to produce a distortion-free, noise-free, and sufficiently clear second image to avoid affecting the driver's understanding of the vehicle's surroundings. The processing of the fifth image may or may not affect the reference range corresponding to the fifth image, and this is not limited here.

[0067] Exemplarily, processing the fifth image to obtain the second image includes performing at least one of distortion correction, noise reduction, and clarity enhancement on the fifth image to obtain a second image corresponding to the fifth image, i.e., a second image corresponding to the same reference direction as the fifth image. The embodiments of this application do not impose excessive limitations on the implementation of these processing processes, and those skilled in the art may configure them based on actual needs or experience.

[0068] The above describes the method of obtaining the first image and the second image. In a possible implementation, the method provided by the embodiment of the present application further includes: displaying at least one of the first image and the second image. For example, by Figure 2 The image display unit shown displays a first image by Figure 2 The left exterior rearview mirror display screen shown shows a second image (such as the second image corresponding to the left rear), through Figure 2 The right exterior rearview mirror display screen shown shows another second image (for example, a second image corresponding to the right rear).

[0069] Step 303: splice the first image and the second image to obtain a third image.

[0070] The first image and the second image are stitched together to obtain a third image. The third image corresponds to a third display range, which is larger than the first display range and larger than each second display range. Figure 7 , Figure 7 The shaded portion of the image shows an exemplary third display range. It can be seen that compared to the first display range corresponding to the first image alone, or the second display range corresponding to the second image alone, the third display range corresponding to the third image is larger and can display the environment outside the vehicle in more detail.

[0071] In some embodiments, the third display range is larger than the first display range, including: the area of ​​the third display range is larger than the area of ​​the first display range. Correspondingly, the third display range is larger than each second display range, including: the area of ​​the third display range is larger than the area of ​​each second display range.

[0072] In other embodiments, the third display range is larger than the first display range, including: the third driver's field of view angle of the third display range is larger than the first driver's field of view angle of the first display range. Accordingly, the third display range is larger than each second display range, including: the third driver's field of view angle of the third display range is larger than the second driver's field of view angle of each second display range.

[0073] For example, Figure 8 As shown ( Figure 8 (The shaded areas of each display range are removed to intuitively illustrate the driver's field of view angles.) For the side and rear, the first driver's field of view angle is acute angle 1 formed by thick lines 82 and 85, a second driver's field of view angle is acute angle 2 formed by thick lines 81 and 83, another second driver's field of view angle is acute angle 3 formed by thick lines 84 and 86, and the third driver's field of view angle is obtuse angle 4 formed by thick lines 81 and 86. Obtuse angle 4 is greater than acute angle 1, acute angle 2, and acute angle 3.

[0074] Next, a method of stitching the first image and the second image will be described.

[0075] Among them, at least one second image may include a reference image, and the second display range corresponding to the reference image is the reference display range, and the reference display range overlaps with the first display range corresponding to the first image. At least one second image may also include a non-reference image, and the second display range corresponding to the non-reference image is the non-reference display range, and the non-reference display range does not overlap with the first display range corresponding to the first image. In embodiments of the present application, for non-reference images and reference images, embodiments of the present application can use different methods to splice them with the first image to obtain a third image. The following describes them separately.

[0076] Case 1: for the non-reference image in the second image, the first image and the second image are spliced ​​to obtain a third image, including: splicing the first image and the non-reference image to obtain the third image.

[0077] Among them, the embodiment of the present application can directly splice the first image and the non-reference image, that is, directly perform a mosaic connection on the first image and the non-reference image. This process can be done by Figure 2 The image stitching unit shown is executed.

[0078] Case 2: For the reference image in the second image, the first image and the second image are spliced ​​to obtain a third image, which includes the following steps (1) to (3).

[0079] Step (1): determine a first sub-image and a second sub-image in the first image, and determine a third sub-image and a fourth sub-image in the reference image.

[0080] The display range of the first sub-image in the first display range overlaps with the second display range, while the display range of the second sub-image in the first display range does not overlap with the second display range. The display range of the third sub-image in the reference display range overlaps with the first display range, while the display range of the fourth sub-image in the reference display range does not overlap with the second display range.

[0081] Therefore, the first and third sub-images are the overlapping portions of the first image and the reference image in the display range. In this embodiment of the present application, it is necessary to perform a first processing on the first and third sub-images to obtain a fifth sub-image, so that the third image subsequently spliced ​​based on the fifth sub-image has a clear and complete display range, which is convenient for the driver to observe.

[0082] Step (2): Perform a first processing on the first sub-image and the third sub-image to obtain a fifth sub-image.

[0083] Exemplarily, step (2) includes but is not limited to the following three processing methods.

[0084] Processing method 1: The first processing is a screening process. First feature information corresponding to the first sub-image is obtained, and second feature information corresponding to the third sub-image is obtained. The scene in which the vehicle is located is obtained. Feature information that has a high degree of compatibility with the scene is determined from the first and second feature information. Based on this highly compatible feature information, the first and third sub-images are screened to obtain a sub-image corresponding to the feature information that has a high degree of compatibility with the scene. This sub-image is used as the fifth sub-image.

[0085] The first characteristic information and the second characteristic information include, but are not limited to, at least one of brightness values ​​and color values, and are not limited here. For example, the first characteristic information and the second characteristic information include the same type of information. For example, if the first characteristic information includes a brightness value, then the second characteristic information also includes a corresponding brightness value. The embodiments of the present application do not limit the type of information included in the first characteristic information and the second characteristic information, and those skilled in the art may set it based on their experience.

[0086] The scene in which the vehicle is located can be used to indicate the surrounding environment of the vehicle during driving. For example, the scene in which the vehicle is located can be a foggy day or a dark night. Figure 2 The images captured by the various cameras shown can also be obtained through a dedicated monitoring device, which is not limited in this embodiment of the present application.

[0087] For different scenes in which the vehicle is located, the feature information that is more compatible with the scene of the vehicle is also different. The feature information that is more compatible with the scene of the vehicle is feature information that can make the corresponding sub-image display better in the scene in which the vehicle is located (for example, it is more conducive to the driver observing the details in the sub-image).

[0088] For example, if the vehicle is in a foggy, hazy scene, yellow or orange color values ​​appear better in this foggy scene (because yellow or orange light has stronger penetrating power in foggy conditions). Therefore, yellow or orange color values ​​are considered the feature information most compatible with this foggy scene. In other words, the feature information with a color value closer to yellow or orange between the first and second feature information is the feature information most compatible with this foggy scene.

[0089] For example, if the vehicle is in a dark night scene, a higher brightness value produces a better display effect in this scene. Therefore, the higher brightness value is considered the feature information that is more suitable for the scene. In other words, the feature information with the higher brightness value between the first feature information and the second feature information is the feature information that is more suitable for the night scene.

[0090] After obtaining feature information that is highly compatible with the scene in which the vehicle is located, the first and third sub-images are screened to obtain a sub-image corresponding to the feature information that is highly compatible with the scene in which the vehicle is located. The present embodiment of the application does not limit the method of screening and processing, and it can be flexibly adjusted according to the different feature information. The obtained sub-image can then be used as the fifth sub-image. For example, if the sub-image corresponding to the feature information that is highly compatible with the scene is the third sub-image, then the third sub-image can be used as the fifth sub-image.

[0091] Processing method 2: The first processing is a fusion processing. The first sub-image includes multiple first pixels, and the third sub-image includes multiple second pixels. A pixel correspondence relationship between the multiple first pixels and the multiple second pixels is obtained, where the pixel correspondence relationship indicates corresponding first and second pixels. Based on the pixel correspondence relationship, the first pixels and the second pixels are fused to obtain multiple third pixels. A fifth sub-image is obtained based on the multiple third pixels.

[0092] In some embodiments, the number of first pixels is the same as the number of second pixels, and the layout of the plurality of first pixels is the same as the layout of the plurality of second pixels, then the plurality of first pixels and the plurality of second pixels are in a one-to-one correspondence. The layout may refer to the number of pixel rows and the number of pixel columns, and if the number of rows and columns are the same, the layout is considered to be the same. For example, if the number of first pixels and the number of second pixels are both 16, and the layout of the first pixels and the layout of the second pixels are both 4×4 (i.e., there are 4 rows of pixels and 4 columns of pixels), then the plurality of first pixels and the plurality of second pixels are in a one-to-one correspondence.

[0093] In this embodiment, obtaining a pixel correspondence relationship between a plurality of first pixels and a plurality of second pixels includes: determining the first pixels and the second pixels having the same position information as corresponding pixels to obtain the pixel correspondence relationship. The position information indicates the position of the pixel in the image. For example, the first pixel in the first row and first column of the first sub-image and the second pixel in the first row and first column of the third sub-image are corresponding pixels.

[0094] In other embodiments, the number of first pixels is different from the number of second pixels, and / or the layout of the multiple first pixels is different from the layout of the multiple second pixels (i.e., at least one of the number of pixel rows and the number of pixel columns is different), then the multiple first pixels and the multiple second pixels are not one-to-one corresponding.

[0095] In this embodiment, obtaining a pixel correspondence relationship between the plurality of first pixels and the plurality of second pixels includes: dividing the first sub-image and the third sub-image according to the same reference method to obtain a plurality of first regions in the first sub-image and a plurality of second regions in the third sub-image. In the corresponding first and second regions, a first pixel included in the first region and a second pixel included in the second region are used as corresponding pixels to obtain the pixel correspondence relationship.

[0096] Taking the cross-division method as an example, after dividing the first sub-image, a first upper-left region, a first upper-right region, a first lower-left region, and a first lower-right region are obtained. After dividing the third sub-image, a second upper-left region, a second upper-right region, a second lower-left region, and a second lower-right region are obtained. The first pixel included in the first upper-left region corresponds to the second pixel included in the second upper-left region. The pixel correspondences in other regions are not further described here.

[0097] Alternatively, in this embodiment, obtaining a pixel correspondence relationship between a plurality of first pixels and a plurality of second pixels includes: using feature matching technology to find similar areas in the first sub-image and the third sub-image, and based on the similar areas in the first sub-image and the third sub-image, matching the plurality of first pixels in the similar area in the first image with the plurality of second pixels in the similar area in the third image, thereby obtaining a pixel correspondence relationship between the plurality of first pixels and the plurality of second pixels. Exemplarily, the similar area is an area in the first sub-image and the third sub-image that records the same image content. The embodiment of the present application does not limit the feature matching technology used, and those skilled in the art can set it based on experience.

[0098] After obtaining the pixel correspondence according to any of the above embodiments, the corresponding first pixel and second pixel indicated by the pixel correspondence are fused to obtain a plurality of third pixels. After obtaining the plurality of third pixels, the plurality of third pixels are combined into a fifth sub-image.

[0099] Exemplarily, the fusion processing method includes: for corresponding first and second pixels, performing a weighted average of the pixel value of the first pixel and the pixel value of the second pixel, and using the obtained pixel value as the pixel value of the third pixel, thereby obtaining the third pixel. Each group of corresponding first and second pixels is fused in this manner to obtain multiple third pixels. Of course, the embodiments of the present application do not limit the fusion processing method, and those skilled in the art can set it based on experience.

[0100] Processing method three: The first process is merging and deduplication. Image recognition is performed on the first sub-image to obtain the first background and the first object. Image recognition is performed on the third sub-image to obtain the second background and the second object. The first and second backgrounds are merged and deduplicated to obtain the third background. The first and second objects are merged and deduplicated to obtain the third object. A fifth sub-image is generated based on the third background and the third object.

[0101] The image contents recorded by the first sub-image and the third sub-image may be the same or different (eg, partially the same or completely different). Therefore, the first sub-image and the third sub-image may need to be merged and deduplicated.

[0102] Exemplary methods for image recognition include, but are not limited to, performing image recognition through image segmentation to separately identify the background and object in the image. For the first sub-image, the first background and the first object are identified, while for the third sub-image, the second background and the second object are identified. Those skilled in the art may determine the specific image recognition method based on their experience, and this is not limited herein.

[0103] In some embodiments, the first background and the second background are merged and deduplicated to obtain a third background, including: when the first background and the second background are different, superimposing the first background and the second background images, for example, superimposing the first background and the second background images according to a reference rule or weight to obtain the third background.

[0104] In other embodiments, merging and deduplicating the first and second backgrounds to obtain a third background includes: if the first and second backgrounds are identical, using the first background or the second background as the third background. For example, if the first and second backgrounds both include the same road and trees, then the first background or the second background can be used as the third background.

[0105] For example, a first object and a second object are merged and deduplicated to obtain a third object. For any overlapping objects in the first and second objects, only one of the overlapping objects is retained, and any non-overlapping objects in the first and second objects are retained as normal. All retained objects constitute the third object. The first and second objects may be people or obstacles, for example, and are the areas that the driver needs to focus on.

[0106] For example, if the first object includes obstacle A and obstacle B, and the second object includes obstacle B and person C, and the overlapping object is obstacle B, then only one obstacle B can be retained. The non-overlapping objects are obstacle A and person C, and they can be retained normally. Based on this, the resulting third object includes obstacle A, obstacle B, and person C.

[0107] Exemplarily, before selecting only one of the overlapping objects from the first and second objects for retention, the method further includes: optimizing the second sub-object in the overlapping object using the first sub-object to obtain an optimized second sub-object. Accordingly, selecting only one of the overlapping objects for retention includes retaining only the optimized second sub-object and removing the first sub-object.

[0108] For example, if the overlapping object is obstacle B, the first sub-object of the first object is the upper half of obstacle B, and the second sub-object of the second object is the lower half of obstacle B. After optimizing the second sub-object using the first sub-object, the optimized second sub-object is the complete obstacle B. Accordingly, the optimized second sub-object (i.e., the complete obstacle B) is retained, and the first sub-object (the upper half of obstacle B) is removed.

[0109] Illustratively, generating the fifth sub-image according to the third background and the third object includes: acquiring position information of the third object, and placing the third object in the third background based on the position information of the third object to obtain the fifth sub-image.

[0110] For example, obtaining the position information of the third object includes: obtaining the first position information of the first object in the first background, obtaining the second position information of the second object in the second background, performing weighted summation on the first position information and the second position information to obtain the third position information of the third object in the third background, that is, the position information of the third object mentioned above.

[0111] The above describes three processing methods for processing the first and third sub-images to obtain the fifth sub-image. It should be understood that the above three processing methods are examples and are not intended to limit the method for obtaining the fifth sub-image in the embodiments of the present application.

[0112] Step (3): splicing the second sub-image, the fourth sub-image and the fifth sub-image to obtain a third image.

[0113] Among them, the embodiment of the present application can directly splice the second sub-image, the fourth sub-image and the fifth sub-image, that is, directly connect the second sub-image, the fourth sub-image and the fifth sub-image in a mosaic manner to obtain the third image.

[0114] For example, for steps (1) to (3) described above, steps (1) and (2) can be replaced by Figure 2 The image shearing unit shown in FIG is executed, and step (3) can be performed by Figure 2 The image stitching unit shown is executed.

[0115] In addition, in the above case 1 and step (3) of case 2, the description is made using direct splicing as an example. For example, the embodiment of the present application can also obtain the vehicle's requirements for the image display range, cut the images to be spliced ​​according to the requirements of the image display range, so that the cut images meet the requirements of the image display range, and then splice the cut images. It should be understood that for case 1, the images to be spliced ​​refer to the first image and the non-reference image, and for step (3) of case 2, the images to be spliced ​​refer to the second sub-image, the fourth sub-image, and the fifth sub-image.

[0116] For example, different vehicle models may have different requirements for image display ranges. For example, a small van may only require an image display range of 5-6 meters from the vehicle, while a large truck may require an image display range of 7-8 meters from the front and sides of the vehicle, and 9-10 meters from the rear. The image display range requirements for a vehicle can be set at the factory or by those skilled in the art based on experience.

[0117] Step 304: Acquire a fourth image based on the third image, and display the fourth image.

[0118] According to the above description, the third image is the image after image stitching. The fourth image obtained based on the third image is the image to be displayed. It should be understood that the fourth image corresponds to the fourth display range, the fourth display range is larger than the first display range, and the fourth display range is larger than each second display range. For this, please refer to the description of the third display range in step 303, which will not be repeated here. For example, the display of the fourth image can be performed by Figure 2 The image display unit shown is executed.

[0119] Exemplarily, the method of acquiring the fourth image based on the third image includes the following two methods.

[0120] In a first manner, the third image is used as the fourth image and displayed.

[0121] In the second manner, the third image is subjected to a second processing to obtain a fourth image.

[0122] Among them, because the driver has corresponding personal tendencies when driving the vehicle, and personal tendencies may affect the driver's field of view when observing the environment around the vehicle, correspondingly, it will affect the driver's blind spot. Therefore, it is necessary to provide the driver with a different display range (i.e., the fourth display range corresponding to the fourth image). Therefore, in order to make the displayed fourth image more consistent with the driver's personal tendencies, the third image can be subjected to a second processing to obtain the fourth image. Exemplarily, the second processing includes at least one of a cropping process and a correction process.

[0123] Exemplarily, performing a second processing on the third image to obtain a fourth image includes: obtaining third characteristic information corresponding to the driver, and determining processing information based on the third characteristic information. For example, the processing information includes at least one of a processing method and a processing amount. The processing information is determined based on the third characteristic information. Based on the processing information, a second processing is performed on the third image to obtain a fourth image. The third characteristic information is used to indicate at least one of the driver's driving visual characteristics, driving posture characteristics, and driving habit characteristics, each of which can reflect the driver's personal tendencies during driving.

[0124] Hereinafter, different types of third characteristic information will be described respectively.

[0125] In case 1, the third characteristic information corresponding to the driver includes the driver's driving vision characteristics. The driver's driving vision characteristics include whether the driver is nearsighted, etc. The driver's driving vision characteristics can be set and updated by the driver himself.

[0126] In scenario 1, the processing information determined based on the third feature information includes image scaling (i.e., the aforementioned processing method) and scaling ratio (i.e., the aforementioned processing amount). Accordingly, performing the second processing on the third image based on the processing information to obtain the fourth image includes: enlarging the third image according to the scaling ratio to obtain the fourth image.

[0127] For example, if the driver is nearsighted, the image scaling should be image magnification, that is, the third image needs to be magnified, and the obtained fourth image is the magnified image. In this way, the driver can clearly see the displayed fourth image.

[0128] In case 2, the third characteristic information corresponding to the driver includes the driver's driving posture characteristics. The driver's driving posture characteristics include the driver's posture when driving the vehicle, and can be set and updated by the driver himself.

[0129] In the second scenario, the processing information determined based on the third feature information includes an image shift direction and an image shift amount. Performing a second process on the third image based on the processing information to obtain a fourth image includes shifting the third image in the image shift direction by the image shift amount to obtain the fourth image.

[0130] For example, the direction and distance of the driver's field of view offset are obtained based on the driver's driving posture characteristics, and the image offset direction and image offset amount are obtained based on the driver's field of view offset direction and distance. For example, the field of view offset direction is used as the image offset direction, and the field of view offset distance is used as the image offset amount.

[0131] When determining the direction and distance of the driver's field of view offset, the driver can be based on the driver's position, looking directly ahead at the vehicle. For example, if the driver is sitting in the driver's position, looking straight ahead, and their body shifts 20 centimeters (field of view offset distance) to the right (field of view offset direction), then the image offset direction is determined to be right, and the image offset is 20 centimeters. In other words, the fourth image is obtained by shifting the third image 20 centimeters to the right.

[0132] In case 3, the third characteristic information corresponding to the driver includes the driver's driving habit characteristics. The driver's driving habit characteristics include the driver's habits during driving, and the driver's driving habit characteristics can be set and updated by the driver himself.

[0133] In scenario three, the processing information determined based on the third feature information includes an image shift direction and an image shift amount. Performing a second process on the third image based on the processing information to obtain a fourth image includes shifting the third image in the image shift direction by the image shift amount to obtain the fourth image.

[0134] For example, based on the driving habit characteristics of the driver, the key image portion that needs to be highlighted in the third image is determined. Compared with the normal display of the third image, the key image portion needs to be offset to display it in the center of the screen of the computer device, and the image offset direction and image offset amount are determined based on the offset.

[0135] For example, if a driver tends to look at the left and rear of the vehicle while driving, they tend to overlook the right side. Therefore, the image portion corresponding to the right side of the vehicle in the third image is the key image portion that needs to be highlighted. When the third image is normally displayed, this key image portion is often located on the right side of the computer screen, rather than in the center. Therefore, this key image portion can be shifted from the right side of the screen to the center. The information that enables this shift is the image shift direction and amount. Thus, after shifting the third image, a fourth image can be obtained.

[0136] The above describes three separate scenarios. If different scenarios are combined, one scenario can be used first, followed by another. For example, if the third characteristic information corresponding to the driver includes driving visual characteristics and driving habit characteristics, scenario one can be used to scale the image to a certain ratio, and then scenario three can be used to offset the scaled image. Examples of other scenarios are not provided here.

[0137] In summary, the image display method provided in the embodiments of the present application first splices the first and second images of the vehicle to obtain a third image with a larger display range. The third image is then processed to obtain and display a fourth image, which also has a larger display range. As a result, by viewing the displayed fourth image, occupants inside the vehicle can fully understand the situation outside the vehicle, reducing blind spots, facilitating correct driving operations, improving driving safety, and enhancing the practicality of the driver assistance system.

[0138] See also Figure 9 , an embodiment of the present application provides a device for displaying an image, the device comprising:

[0139] A first acquisition module 901 is configured to acquire a first image corresponding to the vehicle, the first image corresponding to a first display range, and the first display range is an area around the outside of the vehicle;

[0140] A second acquisition module 902 is configured to acquire at least one second image corresponding to the vehicle, wherein the at least one second image corresponds to at least one second display range, and each second display range of the at least one second display range is a range in a reference direction outside the vehicle;

[0141] a stitching module 903 configured to stitch the first image and the second image to obtain a third image, where the third image corresponds to a third display range, the third display range being larger than the first display range, and the third display range being larger than each second display range;

[0142] The display module 904 is configured to acquire a fourth image based on the third image and display the fourth image.

[0143] In an exemplary embodiment, at least one second image includes a reference image, and the second display range corresponding to the reference image is the reference display range, and the reference display range overlaps with the first display range. The stitching module 903 is used to determine a first sub-image and a second sub-image in the first image, and the display range corresponding to the first sub-image in the first display range overlaps with the second display range, and the display range corresponding to the second sub-image in the first display range does not overlap with the second display range; determine a third sub-image and a fourth sub-image in the reference image, and the display range corresponding to the third sub-image in the reference display range overlaps with the first display range, and the display range corresponding to the fourth sub-image in the reference display range does not overlap with the second display range; perform a first processing on the first sub-image and the third sub-image to obtain a fifth sub-image; and stitch the second sub-image, the fourth sub-image, and the fifth sub-image to obtain a third image.

[0144] In an exemplary embodiment, the first processing includes a screening processing, and the first processing is performed on the first sub-image and the third sub-image to obtain a fifth sub-image. The stitching module 903 is used to obtain first feature information corresponding to the first sub-image; obtain second feature information corresponding to the second sub-image; obtain the scene in which the vehicle is located, and determine feature information with a higher degree of adaptability to the scene from the first feature information and the second feature information; perform screening processing on the first sub-image and the third sub-image to obtain a sub-image corresponding to the feature information with a higher degree of adaptability to the scene; and use the obtained sub-image as the fifth sub-image.

[0145] In an exemplary embodiment, the first sub-image includes multiple first pixels, the third sub-image includes multiple second pixels, the first processing includes a fusion processing, and the stitching module 903 is used to obtain a pixel correspondence between the multiple first pixels and the multiple second pixels, and the pixel correspondence is used to indicate the corresponding first pixels and second pixels; based on the pixel correspondence, the corresponding first pixels and second pixels are fused to obtain multiple third pixels; and the fifth sub-image is obtained based on the multiple third pixels.

[0146] In an exemplary embodiment, the first processing includes merging and deduplication processing, and the stitching module 903 is used to perform image recognition on the first sub-image to obtain a first background and a first object; perform image recognition on the third sub-image to obtain a second background and a second object; perform merging and deduplication processing on the first background and the second background to obtain a third background; perform merging and deduplication processing on the first object and the second object to obtain a third object; and generate a fifth sub-image based on the third background and the third object.

[0147] In an exemplary embodiment, the display module 904 is configured to use the third image as the fourth image; or perform a second processing on the third image to obtain the fourth image, where the second processing includes at least one of a shearing process and a correction process.

[0148] In an exemplary embodiment, the display module 904 is used to obtain third characteristic information corresponding to the driver, where the third characteristic information is used to indicate at least one of the driver's driving visual characteristics, driving posture characteristics, and driving habit characteristics; determine processing information based on the third characteristic information; and perform a second processing on the third image based on the processing information to obtain a fourth image.

[0149] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process and technical effects are detailed in the method embodiments and will not be repeated here.

[0150] Figure 10 This is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. The device may be a terminal, such as a smartphone, tablet computer, player, laptop computer, or desktop computer. A terminal may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other similar terminology.

[0151] Typically, the terminal includes: a processor 1001 and a memory 1002 .

[0152] The processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1001 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1001 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1001 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0153] Memory 1002 may include one or more computer-readable storage media, which may be non-transitory. Memory 1002 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in memory 1002 is used to store at least one instruction, which is executed by processor 1001 to enable the terminal to implement the method for displaying an image provided in the method embodiment of the present application.

[0154] In some embodiments, the terminal may optionally include a peripheral device interface 1003 and at least one peripheral device. The processor 1001, memory 1002, and peripheral device interface 1003 may be connected via a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 1003 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 1004, a display screen 1005, a camera assembly 1006, an audio circuit 1007, and a power supply 1008.

[0155] The peripheral device interface 1003 can be used to connect at least one I / O (Input / Output)-related peripheral device to the processor 1001 and the memory 1002. In some embodiments, the processor 1001, the memory 1002, and the peripheral device interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1001, the memory 1002, and the peripheral device interface 1003 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0156] The RF circuit 1004 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1004 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the RF circuit 1004 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The RF circuit 1004 can communicate with other terminals via at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1004 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0157] Display screen 1005 is used to display a user interface (UI). This UI may include graphics, text, icons, videos, or any combination thereof. When display screen 1005 is a touchscreen display, it is also capable of collecting touch signals on or above the surface of display screen 1005. These touch signals can be input as control signals to processor 1001 for processing. Display screen 1005 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there can be a single display screen 1005, located on the front panel of the terminal. In other embodiments, there can be at least two display screens 1005, located on different surfaces of the terminal or in a foldable design. In still other embodiments, display screen 1005 can be a flexible display, located on a curved or foldable surface of the terminal. Display screen 1005 can also be configured as a non-rectangular, irregular shape, also known as a special-shaped screen. Display screen 1005 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0158] The camera assembly 1006 is used to capture images or videos. Optionally, the camera assembly 1006 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1006 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0159] The audio circuit 1007 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals that are input into the processor 1001 for processing, or input into the radio frequency circuit 1004 to achieve voice communication. For the purpose of stereo sound collection or noise reduction, there may be multiple microphones, each disposed at different locations of the terminal. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert electrical signals from the processor 1001 or the radio frequency circuit 1004 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1007 may also include a headphone jack.

[0160] Power supply 1008 is used to power various components in the terminal. Power supply 1008 can be AC ​​power, DC power, disposable batteries, or rechargeable batteries. When power supply 1008 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0161] In some embodiments, the terminal further includes one or more sensors 1009 , including but not limited to: an acceleration sensor 1010 , a gyroscope sensor 1011 , a pressure sensor 1012 , an optical sensor 1013 , and a proximity sensor 1014 .

[0162] The accelerometer 1010 can detect the magnitude of acceleration along the three coordinate axes of the coordinate system established by the terminal. For example, the accelerometer 1010 can be used to detect the components of gravity acceleration along the three coordinate axes. The processor 1001 can control the display screen 1005 to display the user interface in a landscape or portrait view based on the gravity acceleration signal collected by the accelerometer 1010. The accelerometer 1010 can also be used to collect game or user motion data.

[0163] The gyroscope sensor 1011 can detect the terminal's body orientation and rotation angle. It can also work with the accelerometer 1010 to collect the user's 3D movements on the terminal. Based on the data collected by the gyroscope sensor 1011, the processor 1001 can implement the following functions: motion sensing (such as changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0164] The pressure sensor 1012 can be set in the side frame of the terminal and / or the lower layer of the display screen 1005. When the pressure sensor 1012 is set in the side frame of the terminal, it can detect the user's grip signal of the terminal, and the processor 1001 performs left and right hand recognition or shortcut operations based on the grip signal collected by the pressure sensor 1012. When the pressure sensor 1012 is set in the lower layer of the display screen 1005, the processor 1001 controls the operable controls on the UI interface based on the user's pressure operation on the display screen 1005. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0165] Optical sensor 1013 is used to detect ambient light intensity. In one embodiment, processor 1001 can control the display brightness of display screen 1005 based on the ambient light intensity detected by optical sensor 1013. Specifically, when the ambient light intensity is high, the display brightness of display screen 1005 is increased; when the ambient light intensity is low, the display brightness of display screen 1005 is decreased. In another embodiment, processor 1001 can also dynamically adjust the shooting parameters of camera assembly 1006 based on the ambient light intensity detected by optical sensor 1013.

[0166] Proximity sensor 1014, also known as a distance sensor, is typically located on the front panel of the terminal. Proximity sensor 1014 is used to detect the distance between the user and the front of the terminal. In one embodiment, when proximity sensor 1014 detects that the distance between the user and the front of the terminal is gradually decreasing, processor 1001 controls display screen 1005 to switch from the screen-on state to the screen-off state. When proximity sensor 1014 detects that the distance between the user and the front of the terminal is gradually increasing, processor 1001 controls display screen 1005 to switch from the screen-off state to the screen-on state.

[0167] Those skilled in the art will understand that Figure 10 The structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0168] In an exemplary embodiment, a computer device is further provided, comprising a processor and a memory, wherein the memory stores at least one computer program. The at least one computer program is loaded and executed by one or more processors to enable the computer device to implement any of the above-mentioned methods for displaying an image.

[0169] In an exemplary embodiment, a computer-readable storage medium is further provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor of a computer device to enable the computer to implement any of the above-mentioned methods for displaying an image.

[0170] In one possible implementation, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0171] In an exemplary embodiment, a computer program product or computer program is also provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the above-described methods for displaying an image.

[0172] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images involved in this application were obtained with full authorization.

[0173] It should be understood that the term "plurality" used herein refers to two or more. "And / or" describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates an "or" relationship between the associated objects.

[0174] The above description is merely an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for displaying an image, characterized in that: The method comprises: Acquire a first image corresponding to the vehicle, where the first image corresponds to a first display range, and the first display range is a range around the outside of the vehicle; Based on at least one fifth image, at least one second image corresponding to the vehicle is acquired, the at least one second image having a one-to-one correspondence with at least one second display range, each second display range in the at least one second display range being a range in a reference direction outside the vehicle, and in the same reference direction, a first distance is between an edge of the second display range and the outside of the vehicle, a second distance is between an edge of the first display range and the outside of the vehicle, and the first distance is greater than the second distance; wherein, based on the at least one fifth image, acquiring the at least one second image corresponding to the vehicle includes: if a judgment result indicates that the fifth image has no distortion, noise, or insufficient clarity, using the fifth image as the second image; if the judgment result indicates that the fifth image has distortion, noise, or insufficient clarity, performing at least one of distortion correction processing, denoising processing, and clarity enhancement processing on the fifth image to obtain the second image corresponding to the fifth image; splicing the first image and the second image to obtain a third image, where the third image corresponds to a third display range, the third display range is larger than the first display range, and the third display range is larger than each second display range; A fourth image is acquired based on the third image, and the fourth image is displayed, wherein acquiring the fourth image based on the third image includes: performing a second processing on the third image to obtain the fourth image, and the second processing includes at least one of a shearing process and a correction process.

2. The method according to claim 1, characterized in that The at least one second image includes a reference image, a second display range corresponding to the reference image is a reference display range, and the reference display range overlaps with the first display range; The step of stitching the first image and the second image to obtain a third image includes: Determining a first sub-image and a second sub-image in the first image, wherein a display range corresponding to the first sub-image in the first display range overlaps with the second display range, and a display range corresponding to the second sub-image in the first display range does not overlap with the second display range; determining a third sub-image and a fourth sub-image in the reference image, wherein a display range corresponding to the third sub-image in the reference display range overlaps with the first display range, and a display range corresponding to the fourth sub-image in the reference display range does not overlap with the second display range; performing a first processing on the first sub-image and the third sub-image to obtain a fifth sub-image; The second sub-image, the fourth sub-image, and the fifth sub-image are spliced ​​together to obtain the third image.

3. The method according to claim 2, characterized in that The first processing includes a screening process, and performing the first processing on the first sub-image and the third sub-image to obtain a fifth sub-image includes: Obtaining first feature information corresponding to the first sub-image; Obtaining second feature information corresponding to the second sub-image; Acquiring a scene in which the vehicle is located, and determining feature information having a higher degree of adaptability to the scene from the first feature information and the second feature information; performing the screening process on the first sub-image and the third sub-image to obtain a sub-image corresponding to the feature information having a high degree of adaptability to the scene; The obtained sub-image is used as the fifth sub-image.

4. The method according to claim 2, characterized in that The first sub-image includes a plurality of first pixels, the third sub-image includes a plurality of second pixels, and the first processing includes a fusion processing; The performing a first processing on the first sub-image and the third sub-image to obtain a fifth sub-image includes: Acquire a pixel correspondence relationship between the plurality of first pixels and the plurality of second pixels, the pixel correspondence relationship being used to indicate corresponding first pixels and second pixels; Based on the pixel correspondence, performing the fusion process on the corresponding first and second pixels to obtain a plurality of third pixels; The fifth sub-image is acquired according to the plurality of third pixels.

5. The method according to claim 2, characterized in that The first processing includes merging and deduplication processing, and performing the first processing on the first sub-image and the third sub-image to obtain the fifth sub-image includes: performing image recognition on the first sub-image to obtain a first background and a first object; performing image recognition on the third sub-image to obtain a second background and a second object; performing the merging and duplication removal process on the first background and the second background to obtain a third background; performing the merging and deduplication processing on the first object and the second object to obtain a third object; The fifth sub-image is generated according to the third background and the third object.

6. The method according to claim 1, characterized in that The performing a second processing on the third image to obtain the fourth image includes: Acquiring third characteristic information corresponding to the driver, the third characteristic information being used to indicate at least one of a driving visual characteristic, a driving posture characteristic, and a driving habit characteristic of the driver; determining processing information according to the third characteristic information; The second processing is performed on the third image based on the processing information to obtain the fourth image.

7. A device for displaying an image, characterized in that: The device comprises: A first acquisition module is configured to acquire a first image corresponding to the vehicle, wherein the first image corresponds to a first display range, and the first display range is a range around the outside of the vehicle; a second acquisition module, configured to acquire, based on at least one fifth image, at least one second image corresponding to the vehicle, the at least one second image corresponding one-to-one to at least one second display range, each second display range of the at least one second display range being a range in a reference direction outside the vehicle, and in the same reference direction, a first distance from an edge of the second display range to the outside of the vehicle, a second distance from an edge of the first display range to the outside of the vehicle, and the first distance being greater than the second distance; wherein acquiring, based on the at least one fifth image, at least one second image corresponding to the vehicle comprises: if a judgment result indicates that the fifth image has no distortion, noise, or insufficient clarity, using the fifth image as the second image; and if a judgment result indicates that the fifth image has distortion, noise, or insufficient clarity, performing at least one of distortion correction processing, denoising processing, and clarity enhancement processing on the fifth image to obtain the second image corresponding to the fifth image; a splicing module, configured to splice the first image and the second image to obtain a third image, wherein the third image corresponds to a third display range, the third display range being larger than the first display range, and the third display range being larger than each second display range; A display module is used to obtain a fourth image based on the third image and display the fourth image, wherein the display module is also used to perform a second processing on the third image to obtain the fourth image, and the second processing includes at least one of a shearing process and a correction process.

8. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor, so that the computer device implements the method for displaying an image according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by a processor to enable a computer to implement the method for displaying an image according to any one of claims 1 to 6.

Images