Image processing method, apparatus, device, storage medium and program product

Abstract

The present disclosure provides an image processing method and device, electronic equipment, computer readable storage medium and computer program product, relating to the technical field of vehicles. The method comprises: constructing a to-be-displayed image having a target size for cross-screen display between a plurality of vehicle-mounted display screens; wherein the target size is determined based on display sizes respectively corresponding to the plurality of vehicle-mounted display screens; dividing the to-be-displayed image into a plurality of sub-images respectively corresponding to the plurality of vehicle-mounted display screens based on a relative positional relationship between the plurality of vehicle-mounted display screens, the target size and the display sizes respectively corresponding to the plurality of vehicle-mounted display screens; and displaying image content contained in each sub-image of the plurality of sub-images on the vehicle-mounted display screen corresponding to the sub-image. The method can efficiently achieve cross-screen display between a plurality of vehicle-mounted display screens for the same image, while ensuring the effect of cross-screen linkage display of the image, and can also reduce the cost of cross-screen linkage display of the image.

Description

Technical Field

[0001] This disclosure relates to the field of vehicle technology, and in particular to an image processing method, apparatus, device, storage medium, and program product. Background Technology

[0002] As the level of automotive intelligence continues to improve, the multi-screen interaction function of smart cockpits is attracting increasing attention from consumers. Smart cockpits are generally equipped with multiple display screens, such as the driver's screen, the central control display screen, and the passenger's screen. Each screen usually displays independently, making it difficult to meet users' needs for in-depth interaction through multi-screen collaborative display. Summary of the Invention

[0003] This disclosure provides an image processing method, image processing apparatus, electronic device, computer-readable storage medium, and computer program product that can efficiently achieve cross-screen display of the same image across multiple vehicle-mounted displays, ensuring the effect of cross-screen linkage display while reducing the cost of cross-screen linkage display.

[0004] In a first aspect, embodiments of this disclosure propose an image processing method, comprising: constructing an image to be displayed having a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display sizes corresponding to the multiple vehicle-mounted displays respectively; dividing the image to be displayed into multiple sub-images corresponding to the multiple vehicle-mounted displays based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display sizes corresponding to the multiple vehicle-mounted displays respectively; and displaying the image content contained in each of the multiple sub-images on the vehicle-mounted display corresponding to each sub-image.

[0005] Secondly, embodiments of this disclosure propose an image processing apparatus, including a construction module, a division module, and a processing module. The construction module is configured to construct an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays. The target size is determined based on the display sizes corresponding to the multiple vehicle-mounted displays. The division module is configured to divide the image to be displayed into multiple sub-images corresponding to the multiple vehicle-mounted displays based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display sizes corresponding to the multiple vehicle-mounted displays. The processing module is configured to display the image content contained in each of the multiple sub-images on the vehicle-mounted display corresponding to each sub-image.

[0006] Thirdly, embodiments of this disclosure provide an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the image processing method described in any implementation of the first aspect.

[0007] Fourthly, embodiments of this disclosure provide a non-transitory computer-readable storage medium storing computer instructions that enable a computer to implement the image processing method as described in any implementation of the first aspect.

[0008] Fifthly, embodiments of this disclosure provide a computer program product including a computer program that, when executed by a processor, can implement the image processing method described in any of the implementations in the first aspect.

[0009] The image processing solution provided in this disclosure, in response to the need for multi-screen collaborative or linked display of the same image, requires the construction of a displayable image capable of cross-screen display among multiple vehicle-mounted displays corresponding to this need. Specifically, the target size of the displayable image is determined by the display sizes of the multiple vehicle-mounted displays. Furthermore, to display the displayable image across the multiple vehicle-mounted displays, the image can be accurately divided according to the relative positions of the multiple vehicle-mounted displays, the display sizes of each display, and the target size of the image. The image content of each sub-image is then displayed on its corresponding vehicle-mounted display. In this way, cross-screen display of the same image across multiple vehicle-mounted displays can be efficiently achieved, ensuring the effectiveness of the cross-screen linked display while reducing the cost of cross-screen linked display.

[0010] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0011] Other features, objects, and advantages of this disclosure will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0012] Figure 1 This is an exemplary system architecture to which this disclosure can be applied;

[0013] Figure 2 A flowchart of an image processing method provided in an embodiment of this disclosure;

[0014] Figure 3 A flowchart of another image processing method provided in this disclosure embodiment;

[0015] Figure 4 This is a schematic diagram illustrating cross-screen image display in an application scenario provided by an embodiment of this disclosure;

[0016] Figure 5 This is a structural block diagram of an image processing apparatus provided in an embodiment of the present disclosure;

[0017] Figure 6 This is a schematic diagram of the structure of an electronic device suitable for performing an image processing method, provided as an embodiment of the present disclosure.

[0018] Specific implementation method

[0019] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding; these should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description. It should be noted that, unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0020] It should be noted that the collection, acquisition, storage, processing, transmission, provision, disclosure, and application of user personal information (such as identity verification information) involved in the technical solution disclosed herein are all carried out with the user's knowledge and explicit authorization, comply with the provisions of relevant laws and regulations, and do not violate public order and good morals.

[0021] As the level of automotive intelligence continues to improve, the multi-screen interaction function of smart cockpits is attracting increasing attention from consumers, especially the growing demand for cross-screen display of 3D (3D) images. Smart cockpits are generally equipped with multiple display screens, such as the driver's screen, the central control display screen, and the passenger's screen. Each screen usually displays independently, making it difficult to meet users' deep interactive needs for multi-screen collaborative display.

[0022] Currently, most mainstream 3D engines either do not support cross-screen rendering between multiple screens (such as Unreal Engine), or while they can achieve this function, the cost is high and the versatility is poor (such as Unity Engine). Therefore, there is a need for a low-cost cross-screen image display solution that can meet users' needs for multi-screen collaborative display.

[0023] Figure 1An exemplary architecture of a vehicle 100 to which embodiments of the image processing methods, image processing apparatus, electronic devices, computer-readable storage media, and computer program products of the present disclosure can be applied is illustrated. The vehicle 100 may include a first controller 110, a second controller 120, a screen 130, and peripherals 140. The first controller 110 and the second controller 120 are communicatively connected to enable data interaction.

[0024] In some optional implementations of the embodiments of this disclosure, the first controller 110 can be implemented as a microcontroller (MCU), mainly responsible for controlling and managing various devices and sensors of the vehicle. The first controller 110 can realize the acquisition and processing of sensor data, the control and scheduling of actuators, etc. It should be noted that, without departing from the teachings of this disclosure, the first controller 110 can also be implemented as other devices with data processing capabilities, and no specific limitations are made here.

[0025] In some optional implementations of the embodiments of this disclosure, the second controller 120 can be implemented as a system-on-a-chip (SoC), which integrates a processor, memory, peripherals, and other functions. Due to its powerful computing and processing capabilities, the second controller 120 can be integrated into an in-vehicle infotainment system (hereinafter referred to as an in-vehicle infotainment system) and used to process and analyze sensor data in real time, and make decisions. It should be noted that, without departing from the teachings of this disclosure, the second controller 120 can also be implemented as other devices with computing and processing capabilities, and no specific limitations are made herein.

[0026] In some optional implementations of the embodiments of this disclosure, the first controller 110 and the second controller 120 may be specifically set in the domain controller (such as the cockpit domain controller) of the vehicle 100.

[0027] It should be noted that in some optional implementations of the embodiments of this disclosure, other controllers may also be provided in the vehicle 100 to better realize the functions of the vehicle system, etc., which are not specifically limited here.

[0028] In some optional implementations of the embodiments of this disclosure, the screen 130 may include, but is not limited to, at least one of an instrument panel display, a central control display, a passenger-side display, and a rear-seat display. In some optional implementations, after the vehicle system mounted on the second controller 120 is started, it can output the instrument panel interface, etc., to the instrument panel display for display, and output the central control interface, etc., to the central control display for display.

[0029] In some optional implementations of the embodiments of this disclosure, the peripheral device 140 of the vehicle 100 may refer to the device of the vehicle system mounted on the second controller 120, which may include, but is not limited to, devices such as microphones and vehicle cameras, etc., which will not be listed here.

[0030] Figure 2 A flowchart of an image processing method provided in an embodiment of this disclosure is shown, wherein process 200 includes the following steps:

[0031] S201. Construct an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display size corresponding to each of the multiple vehicle-mounted displays.

[0032] This step is intended for the execution subject of the image processing method (e.g., Figure 1 The second controller 120 shown can accurately construct the image to be displayed for cross-screen display based on the target size determined by the display sizes of the multiple vehicle-mounted displays corresponding to the cross-screen display requirements. In this embodiment, the multiple vehicle-mounted displays used to display the image can be factory-specified displays or dynamically selected displays based on real-time display needs. The display size of the vehicle-mounted displays can be either physical size or display resolution. Physical size can be measured in inches, millimeters, or centimeters, while display resolution is measured in pixels. A pixel is the smallest independent imaging unit on a vehicle-mounted display, and each pixel can independently control color and brightness. Taking display size as display resolution as an example, display size can be expressed as horizontal pixels × vertical pixels. For example, if the display size of the vehicle-mounted display is 1920 × 720, it means that the vehicle-mounted display has 1920 pixels horizontally and 720 pixels vertically. The higher the resolution of the vehicle-mounted display, the clearer and more detailed the displayed image.

[0033] In some optional implementations of the embodiments of this disclosure, the target size of the image to be displayed may include a target width and a target height. The target width may be less than or equal to the sum of the display widths of the multiple vehicle-mounted displays used to display the image. When at least two vehicle-mounted displays have different display heights, in order to ensure that the image to be displayed can be clearly displayed on the multiple vehicle-mounted displays, the target height of the image to be displayed may be greater than or equal to the largest display height among the multiple vehicle-mounted displays. In this way, the image to be displayed can be shown across the corresponding displays of the multiple vehicle-mounted displays at its original size or a compressed size, ensuring that each vehicle-mounted display can display the corresponding image in full screen, so that the image fills all the vehicle-mounted displays.

[0034] For example, there are a total of three in-vehicle display screens for displaying the image to be presented. For ease of distinction, the three in-vehicle display screens may be sequentially referred to as a central control display screen, an instrument display screen, and a front passenger display screen, where the instrument display screen is located on the left side of the central control display screen in the horizontal direction, and the front passenger display screen is located on the right side of the central control display screen in the horizontal direction. If the display dimensions of the central control display screen, the instrument display screen, and the front passenger display screen are all 1920×720, the target width of the image to be presented may be configured as 1920*3=5760, and the target height may be configured as 720, that is, the target dimension of the image to be presented may be configured as 5760×720. If there are four in-vehicle display screens for displaying the image to be presented, three of the four in-vehicle display screens have a display dimension of 1920×720, and the remaining one has a display dimension of 1920×750, the target dimension of the image to be presented may be configured as 7680×750.

[0035] S202. Dividing the image to be presented into a plurality of sub-images respectively corresponding to the plurality of in-vehicle display screens based on the relative positional relationship among the plurality of in-vehicle display screens, the target dimension, and the display dimension respectively corresponding to each of the plurality of in-vehicle display screens.

[0036] On the basis of step S201, this step aims to enable the aforementioned execution subject to accurately and efficiently divide the image to be presented into sub-images respectively corresponding to each in-vehicle display screen based on the target dimension of the image to be presented, the display dimension respectively corresponding to each of the plurality of in-vehicle display screens, and the relative positional relationship among the respective in-vehicle display screens, so as to ensure the adaptability between each sub-image and its corresponding in-vehicle display screen, and at the same time ensure the effect of cross-screen linked display of the same image on the plurality of in-vehicle display screens. The dimension of a sub-image may be less than or equal to the display dimension of its corresponding in-vehicle display screen.

[0037] S203. Presenting the image content respectively contained in each of the plurality of sub-images on the in-vehicle display screen corresponding to each sub-image.

[0038] On the basis of the aforementioned step S202, this step aims to enable the aforementioned execution subject to correspondingly present the image content contained in each sub-image on its corresponding in-vehicle display screen, so as to realize cross-screen display.

[0039] The image processing method provided in this disclosure, in response to the need for multi-screen collaborative or linked display of the same image, requires the construction of a displayable image capable of cross-screen display among multiple vehicle-mounted displays corresponding to this need. Specifically, the target size of the displayable image is determined by the display size of each of the multiple vehicle-mounted displays. Furthermore, to display the displayable image across the multiple vehicle-mounted displays, the image can be accurately divided according to the relative positional relationship between the multiple vehicle-mounted displays, the display size of each display, and the target size of the image. The image content of each sub-image is then displayed on its corresponding vehicle-mounted display. In this way, cross-screen display of the same image across multiple vehicle-mounted displays can be efficiently achieved, ensuring the effect of cross-screen linked display while eliminating limitations on image engine type (such as the aforementioned 3D engines), thereby reducing the cost of cross-screen linked display.

[0040] It should be noted that, since the sub-images in this embodiment are obtained by dividing the images based on the relative positional relationship between the vehicle displays, the target size of the image to be displayed (based on the display size corresponding to each vehicle display), and the display size of each vehicle display, this image processing method can be applied to cross-screen display of any number and / or any display size of vehicle displays.

[0041] Please refer to Figure 3 , Figure 3 A flowchart of another image processing method provided in this disclosure embodiment, wherein process 300 may include the following steps:

[0042] S301. In response to receiving an image cross-screen display instruction, determine the multiple vehicle-mounted displays corresponding to the image cross-screen display instruction.

[0043] In this step, upon receiving an image cross-screen display instruction, it can be determined which in-vehicle displays will perform the image cross-screen display. The image cross-screen display instruction is used to indicate the relative positional relationship between multiple in-vehicle displays. For example, in some optional implementations of this disclosure, the image cross-screen display instruction can be an interactive instruction triggered by a user clicking on one of the in-vehicle displays. For instance, a user can first click a button such as "Cross-screen display" displayed on one of the in-vehicle displays, then select other linked in-vehicle displays by means such as checking a box, and finally determine the relative positional relationship between the multiple in-vehicle displays by dragging. In other optional implementations of this disclosure, the image cross-screen display instruction can also be a voice instruction, an instruction triggered by a steering wheel button, or a gesture operation instruction. For example, a user can issue a voice instruction such as "Perform cross-screen display on the central control display, instrument display, and passenger-side display," and the executing entity can determine the multiple in-vehicle displays to be used for cross-screen display and the relative positional relationship between the multiple in-vehicle displays based on the voice instruction.

[0044] In this embodiment of the disclosure, cross-screen display can be performed on multiple in-vehicle displays specified by the user according to the user's real-time needs, i.e., cross-screen display commands, thereby improving the interactive experience of cross-screen linkage display of images between multiple in-vehicle displays.

[0045] S302. Construct an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display size corresponding to each of the multiple vehicle-mounted displays.

[0046] S303. Based on the relative positional relationship between multiple vehicle-mounted displays, the target size, and the display size corresponding to each of the multiple vehicle-mounted displays, the image to be displayed is divided into multiple sub-images corresponding to each of the multiple vehicle-mounted displays.

[0047] S304. Display the image content contained in each of the multiple sub-images on the vehicle display screen corresponding to each sub-image.

[0048] The above steps S302 to S304 are the same as those in the example. Figure 2 Steps S201 to S203 are essentially the same. For identical or similar parts, please refer to the corresponding parts of the previous embodiment; they will not be repeated here. In some optional implementations of any of the above embodiments of this disclosure, the image to be displayed may include, but is not limited to, a two-dimensional (2-Diment, 2D) image or a three-dimensional image corresponding to a three-dimensional scene. The three-dimensional scene may include a scene pre-stored and already constructed in the system, or a scene constructed in real time based on objects (such as roads, pedestrians, buildings, etc.) in the surrounding environment captured by cameras installed on the vehicle.

[0049] In some optional implementations of any of the foregoing embodiments of the present disclosure, the plurality of vehicle-mounted display screens for performing cross-screen display of the to-be-displayed image may be located in the same area of the vehicle, or may be located in different areas of the vehicle. For example, the plurality of vehicle-mounted display screens for displaying the to-be-displayed image are all located in the front row area of the vehicle and arranged side by side in the horizontal direction. In the case that the display size of the vehicle-mounted display screen is defined by display resolution, the display size of the vehicle-mounted display screen may be mainstream sizes such as 800×480, 1920×720 or 1280×720, and may also be other non-mainstream sizes such as 1280×700 or 1280×750. In addition, the display sizes of the plurality of vehicle-mounted display screens may be the same or different.

[0050] Further, in response to the plurality of vehicle-mounted display screens being located in the same area of the vehicle, the plurality of vehicle-mounted display screens may be row-arranged screens disposed in the first area of the vehicle, and the plurality of vehicle-mounted display screens may respectively correspond to different vehicle-mounted functions. For example, the first area may be located in the front row area of the vehicle corresponding to the main driving position and the front passenger position, for example, one of the plurality of vehicle-mounted display screens is a central control display screen, another vehicle-mounted display screen is an instrument display screen, and a further vehicle-mounted display screen is a front passenger display screen. The central control display screen is mainly used for operation and display of the infotainment system, such as navigation, multimedia playback, vehicle setting, etc.; the instrument display screen is mainly used for displaying basic driving information of the vehicle, such as vehicle speed, rotational speed, fuel consumption, water temperature, tire pressure, etc., and in addition, may also display various vehicle status indicator lights and alarm information; the front passenger display screen mainly provides entertainment functions for the front passenger, such as watching videos, browsing pictures, setting navigation, etc. In this way, while ensuring that the vehicle-mounted display screens corresponding to different vehicle-mounted functions realize their respective function displays, the cross-screen linked display of the same image can be realized, thereby improving user experience.

[0051] In response to the plurality of vehicle-mounted display screens being located in different areas of the vehicle, for example, they may be respectively located in the aforementioned front row area of the vehicle and the rear row area corresponding to the position of the rear row occupants of the vehicle, for example, the plurality of vehicle-mounted display screens may include one or more of the aforementioned central control display screen, instrument display screen and front passenger display screen, and further include one or more of rear row display screens (for example, display screens respectively disposed on the back of the main driver's seat and the back of the front passenger's seat).

[0052] Furthermore, in some optional implementations of the embodiments of this disclosure, the image processing method may further include: in response to receiving a display request associated with a target in-vehicle display screen located in a second area of ​​the vehicle, displaying the image content contained in the target sub-image corresponding to the display request in the image to be displayed on the target in-vehicle display screen. In this embodiment, while realizing cross-screen display of the image to be displayed based on multiple screens in the first area, it is also possible to extract the image content contained in the target sub-image corresponding to the display request from the image to be displayed and project it onto the target in-vehicle display screen based on the projection needs of users in other areas of the vehicle, i.e., the second area, in response to a display request associated with the target in-vehicle display screen in the second area (such as the aforementioned rear seat area). This can improve the diversity and flexibility of image display, thereby further enhancing the user experience. The image content contained in the target sub-image may be part or all of the image content in the image to be displayed, which can be determined according to the specific projection display needs, and is not specifically limited here.

[0053] Furthermore, in some optional implementations of the embodiments of this disclosure, the above-mentioned projection of the image content contained in the target sub-image corresponding to the display request in the image to be displayed onto the target vehicle display screen can be specifically implemented as follows: in response to the existence of multiple target vehicle display screens, the image content contained in the target sub-image is displayed across multiple target vehicle display screens in the second area. Specifically, the image content contained in the target sub-image can be displayed across multiple target vehicle display screens based on the relative positional relationship between the multiple target vehicle display screens, the size of the target sub-image, and the display size corresponding to each target vehicle display screen. The specific implementation process can be referred to Figure 2 The implementation process of displaying the image to be displayed across multiple vehicle displays as described in the corresponding embodiments will not be repeated here.

[0054] In some alternative implementations of the embodiments of this disclosure, the image processing method may further include: in response to receiving a new display request associated with a target vehicle display screen disposed in a second area of ​​the vehicle, displaying the image content contained in the image to be displayed on the target vehicle display screen, so as to realize the projection display of the complete image to be displayed.

[0055] In some optional implementations of the embodiments of this disclosure, in Figure 2 or Figure 3 Based on the corresponding image processing method embodiments, the multiple sub-images in S202 or S303 above can be divided by the following method:

[0056] Based on the relative positional relationship between multiple vehicle-mounted displays, the target size, and the display size corresponding to each of the multiple vehicle-mounted displays, the display boundary information corresponding to each of the multiple vehicle-mounted displays is determined; based on the display boundary information corresponding to each of the multiple vehicle-mounted displays, the image to be displayed is divided into multiple sub-images.

[0057] In this embodiment, the multiple vehicle-mounted displays can be placed on the same plane. Based on their respective sizes and relative positions, combined with the target size of the image to be displayed, the display boundary information of each vehicle-mounted display on the plane can be accurately determined. Then, the display boundary information corresponding to each vehicle-mounted display can be used to divide the image to be displayed into corresponding sub-images. Alternatively, it can be understood that based on the display boundary information corresponding to each vehicle-mounted display, a corresponding portion of the image to be displayed is extracted or cropped as its respective sub-image. The number of sub-images is the same as the number of vehicle-mounted displays used for cross-screen display. The display boundary information can specifically be the geometric information corresponding to the sub-image. Based on this display boundary information, the cropping boundary of the sub-image in the image to be displayed can be determined.

[0058] In some optional implementations of the embodiments of this disclosure, the display boundary information corresponding to each vehicle-mounted display screen may include a horizontal start boundary, a horizontal end boundary, a vertical start boundary, and a vertical end boundary. Specifically, the start boundary can be selected based on the relative positional relationship between multiple vehicle-mounted display screens. Furthermore, the horizontal start boundary and horizontal end boundary of each vehicle-mounted display screen can be determined by combining the relative positional relationship between the multiple vehicle-mounted display screens, the width in the target size, and the width in the display size of each vehicle-mounted display screen. The vertical start boundary and vertical end boundary of each vehicle-mounted display screen can be determined by combining the height in the target size and the height in the display size of each vehicle-mounted display screen.

[0059] Taking a cross-screen display requiring three in-vehicle displays as an example, these three displays are the central control display, the instrument panel display, and the passenger-side display. The instrument panel display is located to the left of the central control display, and the passenger-side display is located to the right of the central control display. In one example, if the central control display, instrument panel display, and passenger-side display are all 1920×720 pixels, then the target size of the image to be displayed can be 5760×720 pixels. Based on the display sizes of the central control display, instrument panel display, and passenger-side display, their relative positions, and the target size of the image to be displayed, the display boundary information for the central control display can be determined as (left:1920, right:3840, top:0, bottom:720), the display boundary information for the instrument panel display is (left:0, right:1920, top:0, bottom:720), and the display boundary information for the passenger-side display is (left:3840, right:5760, top:0, bottom:720). Figure 4 As shown in the diagram. Here, `left` represents the horizontal starting boundary, `right` represents the horizontal ending boundary, `top` represents the vertical starting boundary, and `bottom` represents the vertical ending boundary. The image within the boundary range (left:1920, right:3840, top:0, bottom:720) is divided into three sub-images: the first sub-image, the second sub-image, and the third sub-image. This allows each sub-image to be displayed proportionally on its respective screen. The first, second, and third sub-images are all the sub-images mentioned above.

[0060] In another example, if the size of the central control display and the passenger-side display is 1920×720, and the size of the instrument display is 1920×480, then the target size of the image to be displayed can be 5760×720. Based on the display sizes of the central control display, the instrument display, and the passenger-side display, their relative positions, and the target size of the image to be displayed, the display boundary information corresponding to the central control display can be determined as (left:1920, right:3840, top:0, bottom:720), the display boundary information corresponding to the instrument display is (left:0, right:1920, top:0, bottom:480), and the display boundary information corresponding to the passenger-side display is (left:3840, right:5760, top:0, bottom:720). In this example, the image within the boundary range (left:1920, right:3840, top:0, bottom:720) of the image to be displayed is designated as the first sub-image; the image within the boundary range (left:0, right:1920, top:0, bottom:480) is designated as the second sub-image; and the image within the boundary range (left:3840, right:5760, top:0, bottom:720) is designated as the third sub-image. In another example, the display boundary information for the instrument panel display can also be (left:0, right:1920, top:0, bottom:720). In this case, the image within the boundary range (left:0, right:1920, top:0, bottom:720) of the image to be displayed can be scaled down to a 720:480 ratio to obtain the second sub-image. In other words, when multiple vehicle displays correspond to multiple sizes, the corresponding display boundary information can be set according to the specific display area requirements.

[0061] In some optional implementations of the embodiments of this disclosure, in Figure 2 or Figure 3 Based on the corresponding image processing method embodiments, each sub-image in S203 or S304 above is demonstrated through the following process:

[0062] Using a target application corresponding to the first in-vehicle display screen, and based on the display boundary information of the first in-vehicle display screen, the image content contained in the sub-image corresponding to the first in-vehicle display screen is displayed on the first in-vehicle display screen. The target application can be an application used to display or construct an image including the image to be displayed, such as a 3D scene image. For example, the target application could be a wallpaper app or a preset view component (such as SurfaceView in Android). Furthermore, the first in-vehicle display screen can be the in-vehicle display screen that triggers the cross-screen display command. For example, the first in-vehicle display screen could be the central control display screen mentioned above.

[0063] The mirror image generation interface in the target application is invoked to generate a mirror image of the image to be displayed for the second vehicle display screen among multiple vehicle display screens. The second vehicle display screen can be any display screen other than the first vehicle display screen. For example, the second vehicle display screen can be an instrument panel display screen or a passenger-side display screen. The mirror image generation interface (e.g., an Application Programming Interface, API) can correspond to an algorithm or code integrated or deployed in the target application for generating the mirror image of the image to be displayed. Thus, by invoking the mirror image generation interface, the algorithm or code can be invoked and run, efficiently generating the mirror image of the image to be displayed. In some optional implementations of this disclosure, the size of the mirror image can be the same as the size of the image to be displayed (i.e., both being the aforementioned target size), or it can be another size with a preset proportional relationship to the target size. The specific setting depends on actual needs and is not specifically limited here.

[0064] Based on the mirrored image and the display boundary information corresponding to the second vehicle display screen, the image content contained in the sub-image corresponding to the second vehicle display screen is displayed on the second vehicle display screen.

[0065] In this embodiment, the image content contained in a sub-image of one of the multiple vehicle-mounted displays can be directly displayed by the target application corresponding to that vehicle-mounted display according to the corresponding display boundary information. When displaying the remaining sub-images on the corresponding vehicle-mounted displays, the mirror image generation interface in the target application can be called to generate mirror images of the image to be displayed corresponding to each of the remaining vehicle-mounted displays (i.e., the second vehicle-mounted display). Then, the target application can extract or crop the image content contained in the corresponding sub-image from their respective mirror images according to the display boundary information (i.e., target display boundary information) of each of the remaining vehicle-mounted displays to complete the display, thereby ensuring the cross-screen linkage display effect of the image to be displayed on the multiple vehicle-mounted displays.

[0066] Furthermore, in some optional implementations of the embodiments of this disclosure, the above-mentioned displaying of the image content contained in the sub-image corresponding to the second vehicle display screen on the second vehicle display screen based on the mirrored image and the target display boundary information corresponding to the second vehicle display screen can be specifically executed as follows:

[0067] A SurfaceView is created on the second in-vehicle display screen. By reparenting a mirrored image onto the SurfaceView, the image content corresponding to the display boundary information of the mirrored image is displayed on the second in-vehicle display screen. Specifically, the image content corresponding to the display boundary information can be cropped from the mirrored image and then displayed on the second in-vehicle display screen. This ensures the reliability of cross-screen interactive display of the image to be displayed.

[0068] To enhance understanding, this disclosure also provides a specific implementation scheme based on the Android system's Surface mechanism, using a concrete application scenario as an example. Here, Surface can represent an independent drawing buffer, and the specific process may include the following:

[0069] (1) In response to receiving an image cross-screen display command, determine the multiple in-vehicle displays corresponding to the image cross-screen display command. Specifically, when a user has a cross-screen display requirement, the user can trigger the image cross-screen display command by clicking the central control display screen. Specifically, the user first clicks the "Cross-screen Display" button displayed on the central control display screen, then selects the instrument display screen and the passenger-side display screen to be linked with it, and finally determines the relative positional relationship between the three displays by dragging, such as... Figure 4 As shown, the three displays are a row of screens located in the same area of ​​the vehicle. When the executing entity receives the instruction to display the image across screens, it can determine that the user wants to display the image across the central control display, the instrument display, and the passenger-side display.

[0070] (2) Construct the image to be displayed. For example, construct the image to be displayed using the Wallpaper App on the central control display screen (corresponding to the target application in the above embodiments). The target size of the image to be displayed can be determined based on the display sizes of the central control display screen, the instrument display screen, and the passenger-side display screen. For example, if the sizes of the central control display screen, the instrument display screen, and the passenger-side display screen are all 1920×720, then the target size of the image to be displayed can be configured as 5760×720.

[0071] (3) Divide the image to be displayed into a first sub-image, a second sub-image, and a third sub-image, respectively corresponding to... Figure 4The diagram shows the central control display, instrument panel display, and passenger-side display. Specifically, the display boundary information for each display can be determined based on its size, relative position, and the target size of the image to be displayed. For example, the display boundary information (Geometry) for the central control display is (left:1920, right:3840, top:0, bottom:720), the instrument panel display is (left:0, right:1920, top:0, bottom:720), and the passenger-side display is (left:3840, right:5760, top:0, bottom:720). Then, the image within the display area (left:1920, right:3840, top:0, bottom:720) of the image to be displayed can be divided into the first sub-image, the image within the display area (left:0, right:1920, top:0, bottom:720) of the image to be displayed can be divided into the second sub-image, and the image within the display area (left:3840, right:5760, top:0, bottom:720) of the image to be displayed can be divided into the third sub-image.

[0072] (4) Display the image content contained in the first sub-image on the central control display screen. For example, using WallpaperApp based on the display boundary information (left:1920, right:3840, top:0, bottom:720) corresponding to the central control display screen, display the image content contained in the first sub-image on the central control display screen. Thus, the content of the first sub-image, which is located in the middle third of the image to be displayed, can be displayed on the central control display screen.

[0073] (5) Display the image content contained in the second sub-image on the instrument display screen. For example, in the Wallpaper App, call Surface Control.Mirror Surface() (corresponding to the mirror image generation interface in the above embodiment) to generate a mirror image of the image to be displayed. The size of the mirror image can be the same as the target size of the image to be displayed. In other words, the size of the mirror image is 5760×720. According to the display boundary information (left:0, right:1920, top:0, bottom:720) corresponding to the instrument display screen, the display range of the mirror image corresponding to the instrument display screen can be determined to be (left:0, right:1920, top:0, bottom:720). In other words, the instrument display screen needs to display the left third of the image in the mirror image. Create a Surface View on the instrument display screen. The Surface View is the canvas view. Bind the mirror image to the view hierarchy of the instrument display screen through Surface.reparent(). Thus, the content of the left third of the image to be displayed, i.e., the second sub-image, can be displayed on the instrument display screen.

[0074] (6) Display the image content contained in the third sub-image on the passenger-side display screen. In the Wallpaper App, call SurfaceControl.MirrorSurface() again to generate a mirror image of the image to be displayed. Based on the display boundary information (left:3840, right:5760, top:0, bottom:720) of the passenger-side display screen, the display range of the mirror image on the passenger-side display screen is determined to be (left:3840, right:5760, top:0, bottom:720). In other words, the passenger-side display screen needs to display the right third of the image in the mirror image. Create a Surface View on the passenger-side display screen; the Surface View is the canvas view. Bind the mirror image to the view hierarchy of the passenger-side display screen using Surface.reparent(), so that the content of the right third of the image to be displayed, i.e., the second sub-image, can be displayed on the passenger-side display screen.

[0075] The implementation scheme of this disclosure allows for the display of images of the same 3D scene through multiple in-vehicle displays. The number of these multiple in-vehicle displays can be arbitrary, as can the aspect ratio of the displays. Furthermore, it can support different engine types (such as 3D engine types Unity and UE engine), exhibiting good compatibility and low cost.

[0076] Further reference Figure 5 As an implementation of the methods shown in the above figures, this disclosure provides an embodiment of an image processing apparatus, which is similar to... Figure 2 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices (such as vehicle infotainment systems).

[0077] like Figure 5 As shown, the image processing apparatus 500 of this embodiment may include: a construction module 510, a division module 520, and a processing module 530.

[0078] The construction module 510 is configured to construct an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display sizes of the multiple vehicle-mounted displays respectively; the division module 520 is configured to divide the image to be displayed into multiple sub-images corresponding to the multiple vehicle-mounted displays based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display sizes of the multiple vehicle-mounted displays respectively; and the processing module 530 is configured to display the image content contained in each of the multiple sub-images on the vehicle-mounted display corresponding to each sub-image.

[0079] In the image processing apparatus 500 of this embodiment, the specific processing of the construction module 510, the division module 520, and the processing module 530, and the resulting technical effects, can be found in references to [the relevant documentation]. Figure 2 The relevant descriptions of S201 to S203 in the corresponding embodiments will not be repeated here.

[0080] In some optional implementations of the embodiments of this disclosure, the image processing apparatus 500 may further include: a determining module (not shown in the figure), configured to determine a plurality of vehicle-mounted displays corresponding to the image cross-screen display instruction in response to receiving the image cross-screen display instruction; wherein the image cross-screen display instruction is used to indicate the relative positional relationship between the plurality of vehicle-mounted displays.

[0081] In some optional implementations of the embodiments of this disclosure, the above-mentioned division module 520 is further configured to: determine display boundary information corresponding to the multiple vehicle display screens based on the relative positional relationship between the multiple vehicle display screens, the target size, and the display size corresponding to the multiple vehicle display screens respectively; and divide the image to be displayed into multiple sub-images based on the display boundary information corresponding to the multiple vehicle display screens respectively.

[0082] In some optional implementations of the embodiments of this disclosure, the processing module 530 is further configured to: display the image content contained in the sub-image corresponding to the first vehicle display screen on the first vehicle display screen based on the display boundary information corresponding to the first vehicle display screen by a target application corresponding to the first vehicle display screen; call the mirror image generation interface in the target application to generate a mirror image of the image to be displayed for the second vehicle display screen among the multiple vehicle display screens; wherein the second vehicle display screen is any display screen other than the first vehicle display screen among the multiple vehicle display screens; and display the image content contained in the sub-image corresponding to the second vehicle display screen on the second vehicle display screen based on the mirror image and the target display boundary information corresponding to the second vehicle display screen.

[0083] In some optional implementations of the embodiments of this disclosure, the processing module 530 is further configured to: create a canvas view on the second vehicle display screen, and display the image content of the mirror image corresponding to the target display boundary information on the second vehicle display screen by mounting the mirror image on the canvas view.

[0084] In some optional implementations of the embodiments of this disclosure, the image to be displayed includes a two-dimensional image or a three-dimensional image corresponding to a three-dimensional scene.

[0085] In some optional implementations of the embodiments of this disclosure, the plurality of vehicle-mounted displays are arranged in a row of screens in a first area of ​​the vehicle; wherein the plurality of vehicle-mounted displays correspond to different vehicle-mounted functions.

[0086] In some optional implementations of the embodiments of this disclosure, the processing module 530 is further configured to: in response to receiving a display request associated with a target vehicle display screen located in the second area of ​​the vehicle, display the image content contained in the target sub-image corresponding to the display request in the image to be displayed on the target vehicle display screen.

[0087] This embodiment exists as a device embodiment corresponding to the method embodiment described above. The image processing device 500 provided in this embodiment, in response to the need for multi-screen collaborative or linked display of the same image, needs to construct an image to be displayed based on multiple vehicle-mounted displays corresponding to this need, which can be displayed across these multiple vehicle-mounted displays. Specifically, the target size of the image to be displayed is determined by the display size of each of the multiple vehicle-mounted displays. Furthermore, in order to display the image to be displayed across the multiple vehicle-mounted displays, the image to be displayed can be accurately divided according to the relative positional relationship between the multiple vehicle-mounted displays, the display size of each vehicle-mounted display, and the target size of the image to be displayed. Then, the image content contained in each of the divided sub-images is displayed on its corresponding vehicle-mounted display. In this way, cross-screen display of the same image across multiple vehicle-mounted displays can be efficiently achieved, and the effect of cross-screen linked display of the image can be ensured while eliminating the limitation on the image engine type, thereby reducing the cost of cross-screen linked display of the image.

[0088] According to embodiments of the present disclosure, the present disclosure also provides an electronic device, the electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the image processing method described in any of the above embodiments.

[0089] According to embodiments of this disclosure, this disclosure also provides a non-transitory computer-readable storage medium storing computer instructions that enable a computer to implement the image processing method described in any of the above embodiments when executed.

[0090] For example, the computer instructions corresponding to an image processing method in this embodiment can be stored on a storage medium such as an optical disc, hard disk, or USB flash drive. When the computer instructions corresponding to an image processing method in the storage medium are read or executed by a computer, the image processing method described in any of the above embodiments can be implemented.

[0091] According to embodiments of this disclosure, this disclosure also provides a computer program product including a computer program that, when executed by a processor, can implement the image processing method described in any of the above embodiments.

[0092] Figure 6A schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure is shown. The electronic device 600 (which may include a vehicle infotainment system) proposed in the embodiments of the present disclosure includes a processor 601 and a memory 602 storing an executable computer program. When the processor 601 executes the executable computer program stored in the memory 602, it implements the image processing method provided in the embodiments of the present disclosure.

[0093] In some optional implementations of the embodiments of this disclosure, the electronic device 600 may further include a communication interface 603 and a bus 604 for connecting the processor 601, the memory 602 and the communication interface 603.

[0094] In some optional implementations of the embodiments of this disclosure, bus 604 is used to connect communication interface 603, processor 601 and memory 602 to realize mutual communication between these devices.

[0095] In some optional implementations of the embodiments of this disclosure, the processor 601 may be at least one of the following: Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (CPU), Controller, Microcontroller, and Microprocessor. It is understood that, for different devices, the electronic device used to implement the function of the processor 601 may also be other types, and the embodiments of this disclosure do not specifically limit this.

[0096] The aforementioned memory 602 is used to store executable computer programs and data. The executable computer program includes computer operation instructions. Memory 602 may include high-speed RAM and may also include non-volatile memory, such as at least two disk drives. In practical applications, the aforementioned memory 602 may be volatile memory, such as random-access memory (RAM); or non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); or a combination of the above types of memory, and provides executable computer programs and data to the processor.

[0097] Furthermore, the functional modules in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional module.

[0098] If the integrated units described above are implemented as software functional modules and not sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure embodiment, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the method of this disclosure embodiment. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0099] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0100] It should also be understood that expressions such as "comprising," "including," "having," "containing," and / or "comprising" are open-ended rather than closed-ended expressions in this disclosure, indicating the presence of the stated features, elements, and / or components, but not excluding the presence of one or more other features, elements, components, and / or combinations thereof. Furthermore, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features, not just individual elements in the list. Additionally, when describing embodiments of this disclosure, the word "may" is used to mean "one or more embodiments of this disclosure." And the term "exemplary" is intended to refer to an example or illustration.

[0101] Unless otherwise specified, all terms used herein (including engineering and technical terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should also be understood that, unless expressly stated in this disclosure, terms as defined in common dictionaries shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or overly formalized meaning.

[0102] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. An image processing method, comprising: Construct an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display size corresponding to each of the multiple vehicle-mounted displays; Based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display size corresponding to each of the multiple vehicle-mounted displays, the image to be displayed is divided into multiple sub-images corresponding to each of the multiple vehicle-mounted displays; The image content contained in each of the multiple sub-images is displayed on the in-vehicle display screen corresponding to each sub-image.

2. The method according to claim 1, further comprising: In response to receiving an image cross-screen display instruction, the plurality of vehicle-mounted displays corresponding to the image cross-screen display instruction are determined; wherein, the image cross-screen display instruction is used to indicate the relative positional relationship between the plurality of vehicle-mounted displays.

3. The method according to claim 1, wherein, Based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display sizes corresponding to the multiple vehicle-mounted displays, the image to be displayed is divided into multiple sub-images corresponding to the multiple vehicle-mounted displays, including: Based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display size corresponding to each of the multiple vehicle-mounted displays, the display boundary information corresponding to each of the multiple vehicle-mounted displays is determined; Based on the display boundary information corresponding to the multiple vehicle-mounted displays, the image to be displayed is divided into the multiple sub-images.

4. The method according to claim 3, wherein, The step of displaying the image content contained in each of the plurality of sub-images on the vehicle-mounted display screen corresponding to each sub-image includes: By using the target application corresponding to the first vehicle display screen among the plurality of vehicle display screens, based on the display boundary information corresponding to the first vehicle display screen, the image content contained in the sub-image corresponding to the first vehicle display screen is displayed on the first vehicle display screen; The mirror image generation interface in the target application is invoked to generate a mirror image of the image to be displayed for the second vehicle display screen among the plurality of vehicle display screens; wherein, the second vehicle display screen is any display screen among the plurality of vehicle display screens other than the first vehicle display screen; Based on the mirrored image and the target display boundary information corresponding to the second vehicle display screen, the image content contained in the sub-image corresponding to the second vehicle display screen is displayed on the second vehicle display screen.

5. The method according to claim 4, wherein, The step of displaying the image content contained in the sub-image corresponding to the second vehicle display screen on the second vehicle display screen based on the mirrored image and the target display boundary information corresponding to the second vehicle display screen includes: Create a canvas view on the second in-vehicle display screen; By mounting the mirrored image onto the canvas view, the image content of the mirrored image corresponding to the target display boundary information is displayed on the second vehicle display screen.

6. The method according to claim 1, wherein, The images to be displayed include two-dimensional or three-dimensional images corresponding to a three-dimensional scene.

7. The method according to claim 1, wherein, The multiple in-vehicle displays are arranged in a row of screens in the first area of ​​the vehicle; wherein, the multiple in-vehicle displays correspond to different in-vehicle functions.

8. The method according to claim 7, further comprising: In response to receiving a display request associated with a target in-vehicle display screen located in a second area of ​​the vehicle, the image content contained in the target sub-image corresponding to the display request in the image to be displayed is displayed on the target in-vehicle display screen.

9. An image processing apparatus, comprising: The building module is configured to build an image to be displayed with a target size for cross-screen display among multiple vehicle-mounted displays; wherein the target size is determined based on the display size corresponding to each of the multiple vehicle-mounted displays. The segmentation module is configured to divide the image to be displayed into multiple sub-images corresponding to the multiple vehicle-mounted displays based on the relative positional relationship between the multiple vehicle-mounted displays, the target size, and the display size corresponding to each of the multiple vehicle-mounted displays. The processing module is configured to display the image content contained in each of the plurality of sub-images on the in-vehicle display screen corresponding to each sub-image.

10. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the image processing method according to any one of claims 1-8.

11. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the image processing method according to any one of claims 1-8.

12. A computer program product comprising a computer program that, when executed by a processor, implements the steps of the image processing method according to any one of claims 1-8.

Images