Image data display method and system, vehicle-mounted terminal equipment and vehicle

Abstract

The invention provides an image data display method and system, vehicle-mounted terminal equipment and a vehicle, and the method comprises the steps: splicing multiple paths of image data sources in a first image processing region, and obtaining a spliced image; transmitting the spliced image from the first image processing area to a second image processing area, and splitting the spliced image in the second image processing area to obtain a plurality of image data streams; and associating the plurality of image data streams with a plurality of display channels in a preset display area, transmitting the plurality of image data streams to the preset display area based on an association result, and displaying a plurality of image data sources. According to the method and the device, multiple paths of image data sources input to the front end are spliced, then the spliced image is transmitted to the rear end by utilizing one path of channel, meanwhile, the spliced image is split at the rear end, and multi-path display is performed on the display equipment at the rear end according to the image splitting result; therefore, the original single-channel display can be expanded into multi-channel display.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to an image data display method and system, a vehicle-mounted terminal device, and a vehicle. Background Art

[0002] In relevant display systems (such as automotive display systems), most display chips usually have only one or two display channels. These display channels are responsible for transmitting image data to the display device so as to display corresponding information to relevant personnel (such as drivers, passengers, etc.). However, with the increase in display requirements, such as the introduction of navigation, entertainment, driving assistance and other functions in automobiles, more display channels are needed to support these complex display requirements.

[0003] At present, the relevant technical solutions are usually implemented through hardware upgrades, such as adding or replacing display chips with more display channels. Although this method can increase the number of display channels, for related companies, increasing the number of display channels in the display system by adding or replacing display chips will not only increase the manufacturing cost, but also increase the complexity of the display system. Summary of the invention

[0004] In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide an image data display method and system, a vehicle-mounted terminal device and a vehicle, which are used to solve the problem of a small number of display channels in the relevant display system.

[0005] To achieve the above-mentioned purpose and other related purposes, the present application provides an image data display method, comprising the following steps:

[0006] In the first image processing area, multiple image data sources are spliced ​​based on display parameter information of a preset display area to obtain a spliced ​​image;

[0007] The stitched image is transmitted from the first image processing area to the second image processing area by using a single channel established in advance or in real time between the first image processing area and the second image processing area, and the stitched image is split in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams;

[0008] The multiple image data streams are respectively associated with the multiple display channels in the preset display area, and based on the association results, the multiple image data streams are transmitted to the preset display area, and the multiple image data sources are displayed in the preset display area.

[0009] In one embodiment of the present application, the process of splicing multiple image data sources based on display parameter information of a preset display area in a first image processing area includes:

[0010] In the first image processing area, the left and right images of the multiple image data sources are spliced ​​based on the number of display channels in the display parameter information to obtain a spliced ​​image; or, in the first image processing area, the upper and lower images of the multiple image data sources are spliced ​​based on the number of display channels in the display parameter information to obtain a spliced ​​image;

[0011] Alternatively, in the first image processing area, based on the resolution of each display channel in the display parameter information, left and right images of the multiple image data sources are spliced ​​to obtain a spliced ​​image; or, in the first image processing area, based on the resolution of each display channel in the display parameter information, upper and lower images of the multiple image data sources are spliced ​​to obtain a spliced ​​image;

[0012] Alternatively, in the first image processing area, the multiple image data sources are spliced ​​together in left and right images based on the position mark information of each display channel in the display parameter information to obtain a spliced ​​image; or, in the first image processing area, the multiple image data sources are spliced ​​together in upper and lower images based on the position mark information of each display channel in the display parameter information to obtain a spliced ​​image.

[0013] In one embodiment of the present application, the process of splitting the stitched image based on the display parameter information of the preset display area in the second image processing area includes:

[0014] If the stitched image is obtained by stitching based on the number of display channels in the display parameter information, then in the second image processing area, splitting the multiple image data sources into left and right images based on the number of display channels in the display parameter information to obtain multiple image data streams; or, in the second image processing area, splitting the multiple image data sources into upper and lower images based on the number of display channels in the display parameter information to obtain multiple image data streams;

[0015] Alternatively, if the stitched image is obtained by stitching based on the resolution of each display channel in the display parameter information, then in the second image processing area, the multiple image data sources are split into left and right images based on the resolution of each display channel in the display parameter information to obtain multiple image data streams; or, in the second image processing area, the multiple image data sources are split into upper and lower images based on the resolution of each display channel in the display parameter information to obtain multiple image data streams;

[0016] Alternatively, if the spliced ​​image is obtained by splicing based on the position mark information of each display channel in the display parameter information, then in the second image processing area, the multiple image data sources are split into left and right screens based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams; or, in the second image processing area, the multiple image data sources are split into upper and lower screens based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams.

[0017] In one embodiment of the present application, after obtaining the spliced ​​image, the method further includes:

[0018] If the resolution of the stitched image is inconsistent with the resolution of the preset display area, interpolation calculation is performed on each pixel in the stitched image based on each pixel in the preset display area, and a scaled stitched image is obtained according to the interpolation calculation result; and

[0019] The scaled spliced ​​image is split in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams.

[0020] In one embodiment of the present application, the process of establishing a single channel in the first image processing area and the second image processing area includes:

[0021] Establishing a single channel between the first image processing area and the second image processing area based on a serial asynchronous communication protocol;

[0022] Alternatively, a single channel is established between the first image processing area and the second image processing area based on a full-duplex synchronous communication protocol;

[0023] Alternatively, a single channel is established between the first image processing area and the second image processing area based on a serial distributed communication protocol;

[0024] Alternatively, a video interface between the first image processing area and the second image processing area is used as a corresponding single channel.

[0025] In one embodiment of the present application, the method further includes: adjusting the multiple display channels in the preset display area through a preconfigured interface, wherein the adjustment includes: adjusting the resolution of each display channel and adjusting the position mark information of each display channel;

[0026] And / or, performing interface signal conversion before displaying the multiple image data sources in the preset display area.

[0027] In one embodiment of the present application, the process of acquiring multiple image data sources includes:

[0028] Acquire the headlight display pattern transmitted by each headlight module in the target vehicle; wherein the target vehicle includes: a new energy vehicle determined in advance or in real time, and a fuel vehicle determined in advance or in real time;

[0029] A single vehicle light display pattern is used as one channel of image data source to obtain the multiple channels of image data sources.

[0030] The present application also provides an image data display system, the system comprising:

[0031] A splicing module, configured to splice multiple image data sources in the first image processing area based on display parameter information of a preset display area to obtain a spliced ​​image;

[0032] a splitting module, configured to transmit the stitched image from the first image processing area to the second image processing area by using a single channel established in advance or in real time between the first image processing area and the second image processing area, and to split the stitched image in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams;

[0033] The display module is used to associate the multiple image data streams with the multiple display channels in the preset display area respectively, and transmit the multiple image data streams to the preset display area based on the association results, and display the multiple image data sources in the preset display area.

[0034] The present application also provides a vehicle-mounted terminal device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any one of the above-mentioned image data display methods.

[0035] The present application also provides a vehicle, which includes the image data display system as described above, or includes the vehicle-mounted terminal device as described above.

[0036] As described above, the present application provides an image data display method and system, a vehicle-mounted terminal device and a vehicle, which have the following beneficial effects: a spliced ​​image is obtained by splicing multiple image data sources based on the display parameter information of a preset display area in a first image processing area; then, a single channel established in advance or in real time between the first image processing area and the second image processing area is used to transmit the spliced ​​image from the first image processing area to the second image processing area, and the spliced ​​image is split based on the display parameter information of the preset display area in the second image processing area to obtain multiple image data streams; finally, the multiple image data streams are respectively associated with the multiple display channels in the preset display area, and the multiple image data streams are transmitted to the preset display area based on the association result, and the multiple image data sources are displayed in the preset display area. It can be seen from this that the present application splices the multiple image data sources input to the front end, and then transmits the spliced ​​image to the back end using a channel, and at the same time, the spliced ​​image is first split at the back end, and then multi-channel display is performed on the display device of the back end according to the image splitting result, so that the original single channel display can be expanded to multi-channel display, solving the problem of insufficient display channels in the relevant display system. Moreover, without adding or replacing other display chips with more display channels, the relevant display system can be used to meet the current growing display demand, saving the manufacturing cost of the relevant display system. In addition, the present application can be applied in a variety of display scenarios, such as automotive display systems, virtual reality devices, smart home devices, and other display scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram of a flow chart of an image data display method provided in an embodiment of the present application;

[0038] Figure 2 A schematic diagram of a flow chart of an image data display method provided in another embodiment of the present application;

[0039] Figure 3 A schematic diagram of the hardware structure of an image data display system provided in an embodiment of the present application;

[0040] Figure 4 A schematic diagram of the hardware structure of a vehicle-mounted terminal device suitable for implementing one or more embodiments of the present application. DETAILED DESCRIPTION

[0041] The following is an explanation of the embodiments of the present application by specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied by other different specific embodiments, and the details in this specification can also be based on different viewpoints and applications, without departing from the spirit of the present application. Various modifications or changes are made. It is understood that, in the absence of conflict, the following embodiments and the features in the embodiments can be combined with each other. In addition, it is understood that the illustrations provided in the following embodiments only illustrate the basic concept of the present application in a schematic manner, and only the components related to the present application are shown in the drawings rather than the number, shape and size of the components during the actual implementation. The type, quantity and ratio of each component during its actual implementation can be a random change, and its component layout type may also be more complicated.

[0042] Figure 1 A schematic flow chart of a method for displaying image data is shown. Specifically, in an exemplary embodiment, Figure 1 As shown, this embodiment provides an image data display method, the method comprising the following steps:

[0043] S110, in the first image processing area, multiple image data sources are spliced ​​based on display parameter information of a preset display area to obtain a spliced ​​image. The multiple image data sources can be stored in advance or in real time in an Electrically Erasable Programmable Read-Only Memory (EEPROM).

[0044] S120, using a single channel established in advance or in real time between the first image processing area and the second image processing area, the stitched image is transmitted from the first image processing area to the second image processing area, and the stitched image is split in the second image processing area based on the display parameter information of the preset display area to obtain multiple image data streams. In some examples, the first image processing area and the second image processing area can be obtained based on the same chip, or based on different chips. As an example, for example, the first image processing area and the second image processing area can be obtained by functional division based on the same SOC (System on Chip, SOC for short) chip.

[0045] S130, associating the multiple image data streams with the multiple display channels in the preset display area respectively, and transmitting the multiple image data streams to the preset display area based on the association results, and displaying the multiple image data sources in the preset display area. In some examples, the preset display area includes but is not limited to the display area corresponding to the display device. As an example, the preset display area may be the display area corresponding to the display in the automobile display system. As another example, the preset display area may be the display area corresponding to the display in the virtual reality device. As yet another example, the preset display area may be the display area corresponding to the display in the smart home device.

[0046] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the number of display channels, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, splicing the multiple image data sources into left and right images based on the number of display channels in the display parameter information to obtain a spliced ​​image. Alternatively, in the first image processing area, splicing the multiple image data sources into upper and lower images based on the number of display channels in the display parameter information to obtain a spliced ​​image. It can be seen that in some examples, the multiple image data sources can be spliced ​​into left and right images or upper and lower images according to the number of display channels corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0047] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the resolution of each display channel, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, based on the resolution of each display channel in the display parameter information, the multiple image data sources are spliced ​​into left and right pictures to obtain a spliced ​​image. Alternatively, in the first image processing area, based on the resolution of each display channel in the display parameter information, the multiple image data sources are spliced ​​into upper and lower pictures to obtain a spliced ​​image. It can be seen that in the first image processing area, the multiple image data sources can be spliced ​​into left and right pictures or upper and lower pictures according to the number of display channels corresponding to the preset display area, so as to obtain a spliced ​​image. It can be seen that in some examples, the multiple image data sources can be spliced ​​into left and right pictures or upper and lower pictures according to the resolution of each display channel corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0048] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the position mark information of each display channel, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, based on the position mark information of each display channel in the display parameter information, the multiple image data sources are spliced ​​together in left and right images to obtain a spliced ​​image. Alternatively, in the first image processing area, based on the position mark information of each display channel in the display parameter information, the multiple image data sources are spliced ​​together in upper and lower images to obtain a spliced ​​image. It can be seen that, in some examples, the multiple image data sources can be spliced ​​together in left and right images or upper and lower images according to the position mark information of each display channel corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0049] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing the display channel number in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: in the second image processing area, splitting the multiple image data sources into left and right images based on the display channel number in the display parameter information to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the multiple image data sources into upper and lower images based on the display channel number in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the display channel number in the display parameter information, the multiple image data sources can be split into upper and lower images based on the display channel number in the display parameter information in the second image processing area to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the display channel number in the display parameter information, the multiple image data sources can be split into left and right images based on the display channel number in the display parameter information in the second image processing area to obtain multiple image data streams.

[0050] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing based on the resolution of each display channel in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: splitting the left and right images of multiple image data sources based on the resolution of each display channel in the display parameter information in the second image processing area to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the upper and lower images of multiple image data sources based on the resolution of each display channel in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the resolution of each display channel in the display parameter information, the upper and lower images of multiple image data sources can be split in the second image processing area based on the resolution of each display channel in the display parameter information to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the resolution of each display channel in the display parameter information, the left and right images of multiple image data sources can be split in the second image processing area based on the resolution of each display channel in the display parameter information to obtain multiple image data streams.

[0051] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing based on the position mark information of each display channel in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: splitting the left and right images of multiple image data sources based on the position mark information of each display channel in the display parameter information in the second image processing area to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the upper and lower images of multiple image data sources based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the position mark information of each display channel in the display parameter information, the upper and lower images of multiple image data sources can be split in the second image processing area based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the position mark information of each display channel in the display parameter information, the left and right images of multiple image data sources can be split in the second image processing area based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams.

[0052] In an exemplary embodiment of the present application, after obtaining the stitched image, it can also include: comparing the resolution of the stitched image with the resolution of the preset display area; if the resolution of the stitched image is inconsistent with the resolution of the preset display area, then interpolating each pixel in the stitched image based on each pixel in the preset display area, and obtaining the scaled stitched image according to the interpolation calculation result; and splitting the scaled stitched image based on the display parameter information of the preset display area in the second image processing area to obtain multiple image data streams. Among them, the resolution of the stitched image can be compared with the resolution of the preset display area by pixel comparison, and the specific comparison process is not repeated here. In some examples, bilinear interpolation can be used to interpolate each pixel in the stitched image. In some examples, the scaled stitched image is split to obtain multiple image data streams, which can ensure that the resolution of the image data source is completely matched with the video resolution of the display device.

[0053] In an exemplary embodiment of the present application, the process of establishing a single channel in the first image processing area and the second image processing area includes: establishing a single channel in the first image processing area and the second image processing area based on a serial asynchronous communication protocol. Or, establishing a single channel in the first image processing area and the second image processing area based on a full-duplex synchronous communication protocol; or, establishing a single channel in the first image processing area and the second image processing area based on a serial distributed communication protocol. As an example, for example, a single channel can be established in the first image processing area and the second image processing area through a UART (Universal Asynchronous Receiver / Transmitter, abbreviated as UART) bus. As an example, for example, a single channel can be established in the first image processing area and the second image processing area through an SPI (Serial Peripheral Interface, abbreviated as SPI) bus. As another example, for example, a single channel can be established in the first image processing area and the second image processing area through a CAN (Controller Area Network, abbreviated as CAN) bus. As another example, for example, a video interface between the first image processing area and the second image processing area can be used as the corresponding single channel.

[0054] In an exemplary embodiment of the present application, it may also include: adjusting multiple display channels in a preset display area through a pre-configured interface, including: adjusting the resolution of each display channel and adjusting the position mark information of each display channel. It can be seen that in some examples, the corresponding relationship of online channels in a preset display area can be modified by reserving an external configuration interface, so that there is no need to recompile the software, reducing the number of software development times.

[0055] In an exemplary embodiment of the present application, it may also include: before displaying multiple image data sources in the preset display area, performing interface signal conversion. For example, if the interface signal output by the second image processing area is FPD-Link, and the interface signal corresponding to the preset display area is LVDS (Low Voltage Differential Signaling, LVDS for short), before displaying multiple image data sources in the preset display area, the interface signal FPD-Link is converted into LVDS through a pre-set or real-time interface converter.

[0056] In some exemplary embodiments of the present application, multiple image data sources may be image data sources under the same application scenario, or image data sources under different application scenarios. As one example, multiple image data sources are derived from a car display system. As another example, multiple image data sources are derived from a virtual reality device. As another example, multiple image data sources are derived from a smart home device. In some examples, if multiple image data sources are derived from a car display system, the process of acquiring multiple image data sources may include: acquiring a headlight display pattern transmitted by each headlight module in the target vehicle; wherein the target vehicles include: a new energy vehicle determined in advance or in real time, a fuel vehicle determined in advance or in real time; using a single headlight display pattern as one image data source to obtain multiple image data sources.

[0057] Since the headlight SOC chip in some smart vehicles has only one video output interface, and the headlights are two headlight modules, and the contents of the two headlight modules are different, the SOC chip cannot directly transmit the display contents of the two headlight modules. Therefore, according to the above records, in an exemplary embodiment of the present application, Figure 2 As shown, this embodiment provides an image data display method, comprising the following steps:

[0058] Step 1: The second image processing area communicates with the video interface conversion module through a serial bus such as I2C (Inter-Integrated Circuit, integrated circuit bus, referred to as I2C) to obtain the resolution of the display device and the position mark information L1 and L2 where the display device is located. Among them, the display device can store the position mark information in a memory such as an electrically erasable programmable read-only memory EEPROM through the video interface conversion module. The video interface conversion module is used to meet the needs of video interface conversion. For example, the video interface output by the second image processing area is FDP-Link, and the video interface of the display demand device is LVDS. The first image processing area communicates with the second image processing area through a configuration channel. The configuration channel can be established and generated through a UART bus or an SPI bus or a CAN bus. The first image processing area obtains the number of display channels required by the second image processing area, the resolution information corresponding to each display channel, and the display position mark information corresponding to each display channel according to the set protocol frame.

[0059] Step 2: The first image processing area obtains the display device channel position information L1 and L2 obtained by the second image processing area through the configuration channel, as well as the video resolution information corresponding to each display channel. At the same time, the first image processing area reads the required video content through the input channels V1, V2 or the memory, and the video content includes multiple image sources. After reading the video, according to the resolution information corresponding to each display channel required by the display device obtained in step 1 and the display position mark information corresponding to each display channel, the left and right images are spliced ​​according to the display position mark information L1 and L2 to obtain the spliced ​​image L1-VideoB-L2-VideoA; or the upper and lower images are spliced ​​according to the display position mark information L1 and L2 to obtain the spliced ​​image L1-VideoA-L2-VideoB. After obtaining the spliced ​​image, when the input video picture resolution does not match the display device resolution, the image can be scaled by using the bilinear interpolation method to adjust the input video source resolution and the video resolution required by the display device, so that the adjusted input video picture resolution matches the display device resolution. After the first image processing area generates the spliced ​​image, the spliced ​​image is transmitted to the video input interface of the second image processing area through a video interface channel.

[0060] Step 3: The second image processing area receives the stitched image input by the first image processing area, and splits the input stitched image into image data stream VideoB and image data stream VideoA according to the display position mark information L1 and L2, wherein the display position mark information L1 corresponds to the image data stream VideoB, and the display position mark information L2 corresponds to the image data stream VideoA. The video output channel of the second image processing area corresponds one-to-one to the input channel of the video interface conversion module. By reading the video interface conversion module with position information, the second image processing area can learn that the image data stream VideoB should be sent to the display channel corresponding to the display position mark information L1, and the image data stream VideoA should be sent to the display channel corresponding to the position channel display position mark information L2, thereby realizing multi-channel simultaneous display in the display device when the original SOC chip has only one video interface.

[0061] Step 4: After the original video interface in the SOC chip is expanded into multiple video outputs for display on the display device, an external configuration interface can be reserved to modify the correspondence between the multiple display channels in the SOC chip, thereby eliminating the need to recompile the software and reducing the number of software development times.

[0062] From this, it can be seen that by first splicing the two display images corresponding to the two car light modules into one video signal, and then splitting the one video signal to obtain two image data streams, and then outputting them to the video interfaces of the two light modules, the multi-channel images can be split and then converted through the video interface circuit to realize the display of different channel images.

[0063] In summary, the present application provides an image data display method, which obtains a spliced ​​image by splicing multiple image data sources in a first image processing area based on display parameter information of a preset display area; then, using a single channel pre-established or in real time between the first image processing area and the second image processing area, the spliced ​​image is transmitted from the first image processing area to the second image processing area, and the spliced ​​image is split based on the display parameter information of the preset display area in the second image processing area to obtain multiple image data streams; finally, the multiple image data streams are respectively associated with the multiple display channels in the preset display area, and based on the association results, the multiple image data streams are transmitted to the preset display area, and the multiple image data sources are displayed in the preset display area. It can be seen that the method splices the multiple image data sources input to the front end, and then transmits the spliced ​​image to the back end using a channel, and at the same time, the spliced ​​image is first split at the back end, and then multi-channel display is performed on the display device of the back end according to the image splitting result, so that the original single channel display can be expanded to multi-channel display, solving the problem of insufficient display channels in the relevant display system. Moreover, without adding or replacing other display chips with more display channels, the relevant display system can be used to meet the current growing display demand, saving the manufacturing cost of the relevant display system. In addition, the method can be applied to a variety of display scenarios, such as automotive display systems, virtual reality devices, smart home devices and other display scenarios. Among them, in the automotive display system, the method can meet the growing display demand, such as navigation, entertainment, driving assistance and other functions, by expanding the original single-channel display to a multi-channel display; this can not only improve the driving experience, but also improve the intelligence level of the car. In virtual reality devices, the method can realize multi-channel display by dividing one display content into multiple screens, providing a richer and more immersive visual experience; this is of great significance for the development and promotion of virtual reality devices. In home smart devices, the method can realize multi-channel display by dividing one display content into multiple screens, providing a more intuitive and convenient operation interface, and improving the user experience.

[0064] In another exemplary embodiment of the present application, Figure 3 As shown, this embodiment also provides an image data display system, including:

[0065] The splicing module 310 is used to splice multiple image data sources in the first image processing area based on the display parameter information of the preset display area to obtain a spliced ​​image. The multiple image data sources can be stored in advance or in real time in an electrically erasable programmable read-only memory EEPROM.

[0066] The splitting module 320 is used to transfer the stitched image from the first image processing area to the second image processing area by using a single channel established in advance or in real time between the first image processing area and the second image processing area, and to split the stitched image in the second image processing area based on the display parameter information of the preset display area to obtain multiple image data streams. In some examples, the first image processing area and the second image processing area can be obtained based on the same chip, or based on different chips. As an example, for example, the first image processing area and the second image processing area can be obtained by functional division based on the same SOC chip.

[0067] The display module 330 is used to associate multiple image data streams with multiple display channels in a preset display area, and transmit the multiple image data streams to the preset display area based on the association result, and display the multiple image data sources in the preset display area. . In some examples, the preset display area includes but is not limited to the display area corresponding to the display device. As an example, the preset display area can be the display area corresponding to the display in the automobile display system. As another example, the preset display area can be the display area corresponding to the display in the virtual reality device. As another example, the preset display area can be the display area corresponding to the display in the smart home device.

[0068] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the number of display channels, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, splicing the multiple image data sources into left and right images based on the number of display channels in the display parameter information to obtain a spliced ​​image. Alternatively, in the first image processing area, splicing the multiple image data sources into upper and lower images based on the number of display channels in the display parameter information to obtain a spliced ​​image. It can be seen that in some examples, the multiple image data sources can be spliced ​​into left and right images or upper and lower images according to the number of display channels corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0069] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the resolution of each display channel, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, based on the resolution of each display channel in the display parameter information, the multiple image data sources are spliced ​​into left and right pictures to obtain a spliced ​​image. Alternatively, in the first image processing area, based on the resolution of each display channel in the display parameter information, the multiple image data sources are spliced ​​into upper and lower pictures to obtain a spliced ​​image. It can be seen that in the first image processing area, the multiple image data sources can be spliced ​​into left and right pictures or upper and lower pictures according to the number of display channels corresponding to the preset display area, so as to obtain a spliced ​​image. It can be seen that in some examples, the multiple image data sources can be spliced ​​into left and right pictures or upper and lower pictures according to the resolution of each display channel corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0070] In an exemplary embodiment of the present application, if the display parameter information of the preset display area includes the position mark information of each display channel, then the process of splicing multiple image data sources based on the display parameter information of the preset display area in the first image processing area includes: in the first image processing area, based on the position mark information of each display channel in the display parameter information, the multiple image data sources are spliced ​​together in left and right images to obtain a spliced ​​image. Alternatively, in the first image processing area, based on the position mark information of each display channel in the display parameter information, the multiple image data sources are spliced ​​together in upper and lower images to obtain a spliced ​​image. It can be seen that, in some examples, the multiple image data sources can be spliced ​​together in left and right images or upper and lower images according to the position mark information of each display channel corresponding to the preset display area in the first image processing area to obtain a corresponding spliced ​​image.

[0071] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing the display channel number in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: in the second image processing area, splitting the multiple image data sources into left and right images based on the display channel number in the display parameter information to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the multiple image data sources into upper and lower images based on the display channel number in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the display channel number in the display parameter information, the multiple image data sources can be split into upper and lower images based on the display channel number in the display parameter information in the second image processing area to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the display channel number in the display parameter information, the multiple image data sources can be split into left and right images based on the display channel number in the display parameter information in the second image processing area to obtain multiple image data streams.

[0072] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing based on the resolution of each display channel in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: splitting the left and right images of multiple image data sources based on the resolution of each display channel in the display parameter information in the second image processing area to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the upper and lower images of multiple image data sources based on the resolution of each display channel in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the resolution of each display channel in the display parameter information, the upper and lower images of multiple image data sources can be split in the second image processing area based on the resolution of each display channel in the display parameter information to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the resolution of each display channel in the display parameter information, the left and right images of multiple image data sources can be split in the second image processing area based on the resolution of each display channel in the display parameter information to obtain multiple image data streams.

[0073] In an exemplary embodiment of the present application, if the spliced ​​image is obtained by splicing based on the position mark information of each display channel in the display parameter information, the process of splitting the spliced ​​image based on the display parameter information of the preset display area in the second image processing area includes: splitting the left and right images of multiple image data sources based on the position mark information of each display channel in the display parameter information in the second image processing area to obtain multiple image data streams. Alternatively, in the second image processing area, splitting the upper and lower images of multiple image data sources based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams. It can be seen that in some examples, when the spliced ​​image is obtained by splicing the upper and lower images based on the position mark information of each display channel in the display parameter information, the upper and lower images of multiple image data sources can be split in the second image processing area based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams. When the spliced ​​image is obtained by splicing the left and right images based on the position mark information of each display channel in the display parameter information, the left and right images of multiple image data sources can be split in the second image processing area based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams.

[0074] In an exemplary embodiment of the present application, after obtaining the stitched image, it can also include: comparing the resolution of the stitched image with the resolution of the preset display area; if the resolution of the stitched image is inconsistent with the resolution of the preset display area, then interpolating each pixel in the stitched image based on each pixel in the preset display area, and obtaining the scaled stitched image according to the interpolation calculation result; and splitting the scaled stitched image based on the display parameter information of the preset display area in the second image processing area to obtain multiple image data streams. Among them, the resolution of the stitched image can be compared with the resolution of the preset display area by pixel comparison, and the specific comparison process is not repeated here. In some examples, bilinear interpolation can be used to interpolate each pixel in the stitched image. In some examples, the scaled stitched image is split to obtain multiple image data streams, which can ensure that the resolution of the image data source is completely matched with the video resolution of the display device.

[0075] In an exemplary embodiment of the present application, the process of establishing a single channel in the first image processing area and the second image processing area includes: establishing a single channel in the first image processing area and the second image processing area based on a serial asynchronous communication protocol. Alternatively, a single channel is established in the first image processing area and the second image processing area based on a full-duplex synchronous communication protocol; or, a single channel is established in the first image processing area and the second image processing area based on a serial distributed communication protocol. As an example, a single channel can be established in the first image processing area and the second image processing area through a UART bus, for example. As an example, a single channel can be established in the first image processing area and the second image processing area through an SPI bus, for example. As another example, a single channel can be established in the first image processing area and the second image processing area through a CAN bus, for example. As another example, for example, a video interface between the first image processing area and the second image processing area can be used as the corresponding single channel.

[0076] In an exemplary embodiment of the present application, it may also include: adjusting multiple display channels in a preset display area through a pre-configured interface, including: adjusting the resolution of each display channel and adjusting the position mark information of each display channel. It can be seen that in some examples, the corresponding relationship of online channels in a preset display area can be modified by reserving an external configuration interface, so that there is no need to recompile the software, reducing the number of software development times.

[0077] In an exemplary embodiment of the present application, the following may be further included: before displaying multiple image data sources in the preset display area, performing interface signal conversion. For example, if the interface signal output by the second image processing area is FPD-Link, and the interface signal corresponding to the preset display area is LVDS, before displaying multiple image data sources in the preset display area, the interface signal FPD-Link is converted into LVDS through a pre-set or real-time interface converter.

[0078] In some exemplary embodiments of the present application, multiple image data sources may be image data sources under the same application scenario, or image data sources under different application scenarios. As one example, multiple image data sources are derived from a car display system. As another example, multiple image data sources are derived from a virtual reality device. As another example, multiple image data sources are derived from a smart home device. In some examples, if multiple image data sources are derived from a car display system, the process of acquiring multiple image data sources may include: acquiring a headlight display pattern transmitted by each headlight module in the target vehicle; wherein the target vehicles include: a new energy vehicle determined in advance or in real time, a fuel vehicle determined in advance or in real time; using a single headlight display pattern as one image data source to obtain multiple image data sources.

[0079] In summary, the present application provides an image data display system, which splices multiple image data sources in a first image processing area based on display parameter information of a preset display area through a splicing module to obtain a spliced ​​image; then, the splitting module uses a single channel pre-established or in real time between the first image processing area and the second image processing area to transmit the spliced ​​image from the first image processing area to the second image processing area, and splits the spliced ​​image in the second image processing area based on the display parameter information of the preset display area to obtain multiple image data streams; finally, the display module associates the multiple image data streams with the multiple display channels in the preset display area, and transmits the multiple image data streams to the preset display area based on the association result, and displays the multiple image data sources in the preset display area. It can be seen that the system splices the multiple image data sources input to the front end, and then transmits the spliced ​​image to the back end using a channel, and at the same time, the spliced ​​image is first split at the back end, and then multi-channel display is performed on the display device of the back end according to the image splitting result, so that the original single channel display can be expanded to multi-channel display, solving the problem of insufficient display channels in the relevant display system. Moreover, without adding or replacing other display chips with more display channels, the relevant display system can be used to meet the current growing display demand and save the manufacturing cost of the relevant display system. In addition, the system can be applied in a variety of display scenarios, such as automotive display systems, virtual reality devices, smart home devices and other display scenarios. Among them, in the automotive display system, the system can meet the growing display demand, such as navigation, entertainment, driving assistance and other functions, by expanding the original single-channel display to a multi-channel display; this can not only improve the driving experience, but also improve the intelligence level of the car. In virtual reality devices, the system can realize multi-channel display by dividing one display content into multiple screens, providing a richer and more immersive visual experience; this is of great significance to the development and promotion of virtual reality devices. In home smart devices, the system can realize multi-channel display by dividing one display content into multiple screens, providing a more intuitive and convenient operation interface, and improving the user experience.

[0080] It can be understood that the image data display system provided in the above embodiment and the image data display method provided in the above embodiment belong to the same concept, wherein the specific manner in which the image data display method performs operations has been described in detail in the above embodiment, and will not be repeated here. In actual applications, the image data display system provided in the above embodiment can distribute the above functions to different functional modules as needed, that is, divide the internal structure of the image data display system into different functional modules, and then implement all or part of the functions of the corresponding functional modules through the image data display method described in the above embodiment, and this is not specifically limited here.

[0081] The embodiment of the present application also provides a vehicle-mounted terminal device, which may include a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program so that the vehicle-mounted terminal device executes Figure 1 The steps of the image data display method. Figure 4 FIG. 1 shows a schematic diagram of the structure of a vehicle-mounted terminal device 1000. Figure 4 As shown, the vehicle-mounted terminal device 1000 includes: a processor 1010 , a memory 1020 , a power supply 1030 , a display unit 1040 , and an input unit 1060 .

[0082] The processor 1010 is the control center of the vehicle terminal device 1000. It uses various interfaces and lines to connect various components, and executes various functions of the vehicle terminal device 1000 by running or executing computer programs / instructions stored in the memory 1020, thereby monitoring the vehicle terminal device 1000 as a whole. In the embodiment of the present application, when the processor 1010 calls the computer program stored in the memory 1020, the following is executed: Figure 1 The steps of the image data display method. Optionally, the processor 1010 may include one or more processing units; preferably, the processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and applications, and the modem processor mainly processes wireless communications. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be implemented separately on separate chips.

[0083] The memory 1020 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, various applications, etc.; the data storage area may store instruction data created according to the use of the vehicle-mounted terminal device 1000, etc. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage devices, etc.

[0084] The vehicle-mounted terminal device 1000 also includes a power supply 1030 (such as a battery) for supplying power to various components. The power supply can be logically connected to the processor 1010 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0085] The display unit 1040 can be used to display information input by the user or information provided to the user and various menus of the vehicle-mounted terminal device 1000, etc. In the embodiment of the present application, it is mainly used to display the display interface of each application in the vehicle-mounted terminal device 1000 and objects such as text and pictures displayed in the display interface. The display unit 1040 may include a display panel 1050. The display panel 1050 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.

[0086] The input unit 1060 may be used to receive information such as numbers or characters input by the user. The input unit 1060 may include a touch panel 1070 and other input devices 1080. The touch panel 1070, also known as a touch screen, may collect touch operations of the user on or near it (such as operations of the user using a finger, a stylus, or any other suitable object or accessory on or near the touch panel 1070).

[0087] Specifically, the touch panel 1070 can detect the user's touch operation, detect the signal brought by the touch operation, convert these signals into touch point coordinates, send them to the processor 1010, and receive and execute the command sent by the processor 1010. In addition, the touch panel 1070 can be implemented in various types such as resistive, capacitive, infrared and surface acoustic wave. Other input devices 1080 can include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, a joystick, etc.

[0088] Of course, the touch panel 1070 can cover the display panel 1050. When the touch panel 1070 detects a touch operation on or near it, it is transmitted to the processor 1010 to determine the type of touch event, and then the processor 1010 provides a corresponding visual output on the display panel 1050 according to the type of touch event. Figure 4 In the embodiment, the touch panel 1070 and the display panel 1050 are two independent components to realize the input and output functions of the vehicle-mounted terminal device 1000, but in some embodiments, the touch panel 1070 and the display panel 1050 can be integrated to realize the input and output functions of the vehicle-mounted terminal device 1000.

[0089] The vehicle-mounted terminal device 1000 may further include one or more sensors, such as a pressure sensor, a gravity acceleration sensor, a proximity light sensor, etc. Of course, according to the needs of specific applications, the vehicle-mounted terminal device 1000 may also include other components such as a camera.

[0090] The embodiment of the present application also provides a computer-readable storage medium, in which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, the above-mentioned device can perform the above-mentioned Figure 1 The steps of the image data display method.

[0091] It can be understood by those skilled in the art that Figure 4 This is only an example of a vehicle-mounted terminal device and does not constitute a limitation on the device. The device may include more or fewer components than shown in the figure, or combine certain components, or different components. For the convenience of description, the above parts are divided into modules (or units) according to their functions and described separately. Of course, when implementing this application, the functions of each module (or unit) can be implemented in the same or multiple software or hardware.

[0092] Those skilled in the art will appreciate that the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application, and it should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be applied to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0093] In another exemplary embodiment of the present application, the embodiment further provides a vehicle, which includes an image data display system as described in the above embodiment, or includes an on-board terminal device as described in the above embodiment. It can be understood that since the specific manner in which the image data display system and the on-board terminal device perform operations has been described in detail in the embodiment, the technical functions and effects of the vehicle provided by this embodiment can be referred to the above embodiment, and will not be repeated here.

[0094] It is to be understood that, although the terms first, second, etc. may be used to describe image processing areas, etc. in some embodiments of the present application, these terms are only used to distinguish image processing areas from each other. For example, without departing from the scope of some embodiments of the present application, the first image processing area may also be referred to as the second image processing area, and similarly, the second image processing area may also be referred to as the first image processing area.

[0095] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A method for displaying image data, characterized in that: The method comprises the following steps: In the first image processing area, multiple image data sources are spliced ​​based on display parameter information of a preset display area to obtain a spliced ​​image; The stitched image is transmitted from the first image processing area to the second image processing area by using a single channel established in advance or in real time between the first image processing area and the second image processing area, and the stitched image is split in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams; The multiple image data streams are respectively associated with the multiple display channels in the preset display area, and based on the association results, the multiple image data streams are transmitted to the preset display area, and the multiple image data sources are displayed in the preset display area.

2. The image data display method according to claim 1, characterized in that: The process of splicing multiple image data sources in the first image processing area based on the display parameter information of the preset display area includes: In the first image processing area, the left and right images of the multiple image data sources are spliced ​​based on the number of display channels in the display parameter information to obtain a spliced ​​image; or, in the first image processing area, the upper and lower images of the multiple image data sources are spliced ​​based on the number of display channels in the display parameter information to obtain a spliced ​​image; Alternatively, in the first image processing area, based on the resolution of each display channel in the display parameter information, left and right images of the multiple image data sources are spliced ​​to obtain a spliced ​​image; or, in the first image processing area, based on the resolution of each display channel in the display parameter information, upper and lower images of the multiple image data sources are spliced ​​to obtain a spliced ​​image; Alternatively, in the first image processing area, the multiple image data sources are spliced ​​together in left and right images based on the position mark information of each display channel in the display parameter information to obtain a spliced ​​image; or, in the first image processing area, the multiple image data sources are spliced ​​together in upper and lower images based on the position mark information of each display channel in the display parameter information to obtain a spliced ​​image.

3. The image data display method according to claim 1 or 2, characterized in that: The process of splitting the stitched image based on the display parameter information of the preset display area in the second image processing area includes: If the stitched image is obtained by stitching based on the number of display channels in the display parameter information, then in the second image processing area, splitting the multiple image data sources into left and right images based on the number of display channels in the display parameter information to obtain multiple image data streams; or, in the second image processing area, splitting the multiple image data sources into upper and lower images based on the number of display channels in the display parameter information to obtain multiple image data streams; Alternatively, if the stitched image is obtained by stitching based on the resolution of each display channel in the display parameter information, then in the second image processing area, the multiple image data sources are split into left and right images based on the resolution of each display channel in the display parameter information to obtain multiple image data streams; or, in the second image processing area, the multiple image data sources are split into upper and lower images based on the resolution of each display channel in the display parameter information to obtain multiple image data streams; Alternatively, if the spliced ​​image is obtained by splicing based on the position mark information of each display channel in the display parameter information, then in the second image processing area, the multiple image data sources are split into left and right screens based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams; or, in the second image processing area, the multiple image data sources are split into upper and lower screens based on the position mark information of each display channel in the display parameter information to obtain multiple image data streams.

4. The image data display method according to claim 2, characterized in that: After obtaining the spliced ​​image, the method further includes: If the resolution of the stitched image is inconsistent with the resolution of the preset display area, interpolation calculation is performed on each pixel in the stitched image based on each pixel in the preset display area, and a scaled stitched image is obtained according to the interpolation calculation result; and The scaled spliced ​​image is split in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams.

5. The image data display method according to claim 1, characterized in that: The process of establishing a single channel in the first image processing area and the second image processing area includes: Establishing a single channel between the first image processing area and the second image processing area based on a serial asynchronous communication protocol; Alternatively, a single channel is established between the first image processing area and the second image processing area based on a full-duplex synchronous communication protocol; Alternatively, a single channel is established between the first image processing area and the second image processing area based on a serial distributed communication protocol; Alternatively, a video interface between the first image processing area and the second image processing area is used as a corresponding single channel.

6. The image data display method according to claim 1, characterized in that: The method further comprises: adjusting the multiple display channels in the preset display area through a preconfigured interface, wherein the adjustment comprises: adjusting the resolution of each display channel and adjusting the position mark information of each display channel; And / or, performing interface signal conversion before displaying the multiple image data sources in the preset display area.

7. The image data display method according to claim 1, characterized in that: The process of acquiring the multiple image data sources includes: Acquire the headlight display pattern transmitted by each headlight module in the target vehicle; wherein the target vehicle includes: a new energy vehicle determined in advance or in real time, and a fuel vehicle determined in advance or in real time; A single vehicle light display pattern is used as one channel of image data source to obtain the multiple channels of image data sources.

8. An image data display system, characterized in that: The system comprises: A splicing module, configured to splice multiple image data sources in the first image processing area based on display parameter information of a preset display area to obtain a spliced ​​image; a splitting module, configured to transmit the stitched image from the first image processing area to the second image processing area by using a single channel established in advance or in real time between the first image processing area and the second image processing area, and to split the stitched image in the second image processing area based on the display parameter information of the preset display area to obtain a plurality of image data streams; The display module is used to associate the multiple image data streams with the multiple display channels in the preset display area respectively, and transmit the multiple image data streams to the preset display area based on the association results, and display the multiple image data sources in the preset display area.

9. A vehicle-mounted terminal device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the image data display method according to any one of claims 1 to 7.

10. A vehicle, characterized in that: The vehicle includes the image data display system as claimed in claim 8, or includes the vehicle-mounted terminal device as claimed in claim 9.

Images