Image processing method and apparatus, computer device and image display method

By decoding the image source data and black edge identification bit configuration, identifying and removing data in the black edge area, the problem of low bandwidth utilization efficiency in the LED control system is solved, and more efficient image transmission and display is achieved.

WO2025161593A1PCT designated stage Publication Date: 2025-08-07UNILUMIN GRP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/131004
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-02-04
Filing Date
2024-11-08
Publication Date
2025-08-07

AI Technical Summary

Technical Problem

When the existing LED control system transmits an image source with black edges, it does not process the black edge area, resulting in low data transmission bandwidth utilization efficiency.

Method used

By acquiring image source data, decoded into image digital signals, and analyzing it, black edge identification bits are configured, data in black edge areas are identified and removed, and the amount of data transmitted is reduced.

Benefits of technology

Improves bandwidth utilization during image transmission and ensures that the display screen can accurately display the screen.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024131004_07082025_PF_FP_ABST
    Figure CN2024131004_07082025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to an image processing method and apparatus, a computer device, a computer-readable storage medium and a computer program product. The method comprises: acquiring image source data, and decoding the image source data to obtain an image digital signal; analyzing the image digital signal, and, on the basis of an analysis result, configuring a black edge flag bit in the image digital signal; and performing black edge removal processing on the image digital signal on the basis of the black edge flag bit. Marking black edges of images by setting black edge flag bits and performing black edge removal processing can reduce bandwidth occupation by the black edges during transmission, thus improving the effective utilization rate of bandwidth. The present application further relates to an image display method, comprising: receiving an image digital signal subjected to black edge removal processing; on the basis of a black edge flag bit, performing data padding on the image digital signal subjected to black edge removal processing, so as to obtain pre-display data; and sending the pre-display data to a display screen for display.
Need to check novelty before this filing date? Find Prior Art

Description

Image processing method, device, computer equipment and image display method

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 2024101632197, filed on February 4, 2024, entitled “Image processing method, device, computer equipment and image display method,” which is incorporated herein by reference in its entirety. Technical Field

[0003] The present application relates to the field of image processing technology, and in particular to an image processing method, apparatus, computer equipment, computer-readable storage medium, computer program product, and image display method. Background Art

[0004] LED displays are becoming increasingly popular. To display an image, the desired image source is transmitted to the LED control system. The control system decodes the image source and outputs a control signal to the LED display. The driver circuit (also known as the driver IC) within the LED display controls the display module based on the control signal, enabling the display to display the desired image.

[0005] However, current common LED control systems, when inputting image sources with black borders, typically do not process the black-bordered areas. Instead, they treat the data in these areas as normal image data, processing them as usual before transmitting them through the network port without any difference. Due to the presence of black borders in image sources, transmitting data in these black areas of the image source will inevitably occupy the data transmission bandwidth, if the total bandwidth of the transmission channel is limited. This results in low bandwidth utilization during image transmission.

[0006] Summary of the Invention

[0007] Based on this, it is necessary to provide a more efficient image display method, apparatus, computer device, computer-readable storage medium and computer program product to address the above technical issues.

[0008] The present application provides an image processing method, the method comprising:

[0009] Acquiring image source data, and decoding the image source data to obtain an image digital signal;

[0010] Analyzing the image digital signal, and configuring a black border marker within the image digital signal according to the analysis result;

[0011] The image digital signal is subjected to black edge removal processing according to the black edge identification bit.

[0012] In one embodiment, analyzing the image digital signal and configuring a black border marker within the image digital signal according to the analysis result includes:

[0013] Dividing the image digital signal into image areas according to the pixel configuration of the image source data;

[0014] Perform black edge recognition on each divided image area to obtain a black edge recognition result;

[0015] The black edge identification bit of each image area in the image digital signal is configured according to the black edge recognition result.

[0016] In one embodiment, performing black edge recognition on each divided image region to obtain a black edge recognition result includes:

[0017] The RGB value of each divided image area is detected based on a detection threshold to obtain a black edge recognition result; the detection threshold is obtained according to the brightness conversion table of the display screen.

[0018] In one embodiment, the performing black edge removal processing on the image digital signal according to the black edge identification bit includes:

[0019] When the black edge identification bit indicates that the corresponding image digital signal has a black edge, the black edge image digital signal is replaced with a black edge image signal; the black edge image signal includes a position parameter and a black edge identification bit;

[0020] When the black border identification bit indicates that the corresponding image digital signal is not black-bordered, the image digital signal is retained; the retained image digital signal includes position parameters, image parameters and the black border identification bit.

[0021] In one embodiment, after performing black edge removal processing on the image digital signal according to the black edge identification bit, the method further includes:

[0022] receiving display position adjustment information;

[0023] The position parameters in each image digital signal after black border removal processing are adjusted according to the display position adjustment information.

[0024] In one embodiment, before acquiring the image source data, the method further includes:

[0025] Video source data is acquired, and the video source data is decomposed according to a time parameter to obtain each image source data.

[0026] The present application also provides an image display method, the image display method comprising:

[0027] Receiving the image digital signal after black edge removal processing;

[0028] Performing data filling on the image digital signal after black edge removal processing according to the black edge identification bit to obtain pre-display data;

[0029] The pre-display data is sent to a display screen for display.

[0030] The present application also provides an image processing device, comprising:

[0031] A decoding module, configured to obtain image source data and decode the image source data to obtain an image digital signal;

[0032] a black edge recognition module, configured to analyze the image digital signal and configure a black edge identification bit within the image digital signal according to the analysis result;

[0033] The black edge processing module is used to perform black edge removal processing on the image digital signal according to the black edge identification bit.

[0034] The present application also provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0035] Acquiring image source data, and decoding the image source data to obtain an image digital signal;

[0036] Analyzing the image digital signal, and configuring a black border marker within the image digital signal according to the analysis result;

[0037] The image digital signal is subjected to black edge removal processing according to the black edge identification bit.

[0038] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the following steps:

[0039] Acquiring image source data, and decoding the image source data to obtain an image digital signal;

[0040] Analyzing the image digital signal, and configuring a black border marker within the image digital signal according to the analysis result;

[0041] The image digital signal is subjected to black edge removal processing according to the black edge identification bit.

[0042] The present application also provides a computer program product, comprising a computer program, which, when executed by a processor, implements the following steps:

[0043] Acquiring image source data, and decoding the image source data to obtain an image digital signal;

[0044] Analyzing the image digital signal, and configuring a black border marker within the image digital signal according to the analysis result;

[0045] The image digital signal is subjected to black edge removal processing according to the black edge identification bit.

[0046] The above-mentioned image processing method, device, computer equipment, computer-readable storage medium and computer program product include obtaining image source data, decoding the image source data to obtain an image digital signal, analyzing the image digital signal, configuring the black edge identification bit in the image digital signal according to the analysis result, and performing black edge removal processing on the image digital signal according to the black edge identification bit. The black edges of the image are identified and marked by setting the black edge identification bit, and after the black edge removal processing, the bandwidth occupied by the black edge data during data transmission is reduced, thereby improving the effective utilization rate of the bandwidth during image transmission. The above-mentioned image display method includes receiving the image digital signal after the black edge removal processing, filling the image digital signal after the black edge removal processing with data according to the black edge identification bit, obtaining pre-display data, and sending the pre-display data to the display screen for display. By filling the image digital signal after the black edge removal processing with data, the data required for the display screen to display is supplemented, so that the display screen can accurately display the picture. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0048] FIG1 is a diagram illustrating an application environment of an image processing method according to an embodiment;

[0049] FIG2 is a schematic flow chart of an image processing method according to an embodiment;

[0050] FIG3 is a flowchart illustrating steps of analyzing an image digital signal and configuring a black border marker within the image digital signal according to the analysis result in one embodiment;

[0051] FIG4 is a schematic diagram of a flow chart of the steps for updating or adjusting a detection threshold in one embodiment;

[0052] FIG5 is a flow chart showing steps of performing black edge removal processing on an image digital signal according to a black edge flag in one embodiment;

[0053] FIG6 is a schematic flow chart of an image processing method in another embodiment;

[0054] FIG7 is a block diagram of the structure of an image processing device according to an embodiment;

[0055] FIG8 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and examples. The accompanying drawings provide embodiments of the present application, but the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0057] It will be understood that the terms "first," "second," etc., used herein may be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first resistor may be referred to as a second resistor, and similarly, a second resistor may be referred to as a first resistor without departing from the scope of this application. The first resistor and the second resistor are both resistors, but they are not the same resistor.

[0058] It can be understood that the “connection” in the following embodiments should be understood as “electrical connection”, “communication connection”, etc. if there is transmission of electrical signals or data between the connected circuits, modules, units, etc.

[0059] As used herein, the singular forms "a," "an," and "the" may also include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the terms "include," "comprising," "having," and the like specify the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof. Furthermore, the term "and / or" as used in this specification includes any and all combinations of the relevant listed items.

[0060] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application pertains. The terms used herein in the specification of this application are for the purpose of describing specific embodiments only and are not intended to limit this application.

[0061] The image processing method provided in the embodiment of the present application can be applied in the application environment shown in Figure 1. Specifically, the image sending device 102 is connected to the sending card 104, and the image sending device 102 is used to send the image source data to the sending card 104. The sending card 104 processes the image source data through the image processing method provided in each embodiment of the present application, specifically performing corresponding processing on the black edges in the image. The image sending device 102 is not limited and can be a terminal or a server, etc., or it can be a host computer 110, as long as it can store and send image source data. Among them, the terminal can be, but is not limited to, various personal computers, laptops, smart phones, tablets, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The server can be implemented as an independent server or a server cluster consisting of multiple servers.

[0062] Furthermore, the sending card 104 is connected to the host computer 110, and the host computer 110 can send a control signal to the sending card 104 to adjust the working status of the sending card 104 or the image processing process; the sending card 104 can also upload its own working status or received image source data to the host computer 110.

[0063] Furthermore, the sending card 104 can also send the processed data to the receiving card 106. After the receiving card 106 executes the image display method provided in each embodiment of the present application, it controls the display screen 108 to display the corresponding image. Typically, the display screen 108 includes multiple display areas, each display area corresponds to a receiving card 106, and each receiving card 106 forms a receiving card matrix. Each receiving card 106 has a display position identifier that matches the corresponding display area. The sending card 104 can communicate with each receiving card 106 to obtain the display position identifier of each receiving card 106, distribute the processed data according to the display position, and send the corresponding data according to the display position identifier.

[0064] Illustratively, the image sending device 102 is connected to the sending card 104 via a video transmission line, the sending card 104 is connected to the host computer 110 via USB, the sending card 104 is connected to the receiving card 106 via a network cable, and the receiving card 106 is connected to the display screen 108 via a control cable.

[0065] In an exemplary embodiment, as shown in FIG2 , an image processing method is provided, which is described by taking the method applied to the sending card 104 in FIG1 as an example, and includes the following steps 202 to 206 . Among them:

[0066] Step 202: Acquire image source data and decode the image source data to obtain an image digital signal.

[0067] Image source data refers to image data sent by the image transmitting device. This data is converted based on the desired image content and carries the corresponding image information. Specifically, the sending card receives the image source data from the image transmitting device and decodes it to produce a digital image signal. The decoding method is not limited; it only needs to be able to convert the image source data into a digital image signal.

[0068] Optionally, the decoded image digital signal includes the color corresponding to each pixel in the image and the position corresponding to each pixel. Exemplarily, the image digital signal includes but is not limited to parameters such as image parameters and position parameters.

[0069] Furthermore, in an exemplary embodiment, before obtaining the image source data in step 202, the method further includes step 702: obtaining video source data, and decomposing the video source data according to time parameters to obtain each image source data.

[0070] The image sending device is not only used to send image source data, but also video source data. Essentially, video source data consists of multiple image source data arranged in a specific order. Therefore, after acquiring the video source data, the sending card can break it down based on time parameters. These time parameters are derived from the predetermined order within the video source data, such as the frame number of each image source data within the video source data. Through this process, the video source data is broken down into multiple image source data, which are then processed sequentially.

[0071] In this embodiment, by decomposing the video source data to obtain the image source data, the image processing method of the present application is not limited to processing the black edges of a fixed image, but can also process the black edges of multiple images in a video, thereby broadening the scope of application of the image processing method and improving its applicability.

[0072] Exemplarily, the decoding process includes detecting the width and height of each image source data in the video source data. Taking video source data using line and field synchronization as an example, the following definitions are used: the field synchronization signal Vsync, the field synchronization signal rising edge Vsync_Posedge, the line synchronization signal Hsync, the line synchronization signal rising edge Hsync_Posedge, the image parameter Data, and the image parameter valid signal De.

[0073] After receiving the video source data, the sending card uses the rising edge of the horizontal and vertical synchronization signals as the basis for latching and clearing the counters in the sending card. The rising edge of the horizontal synchronization signal Hsync_Posedge is used to clear the image width counter and latch the count value, and the rising edge of the vertical synchronization signal Vsync_Posedge is used to clear the image height counter and latch the count value.

[0074] Specifically, when the image parameter valid signal De is valid, the image parameter Data is recorded. The image width counter increments until the rising edge of the horizontal sync signal Hsync_Posedge arrives, at which point the image width counter is reset to zero and latched in the image width register. When the rising edge of the horizontal sync signal Hsync_Posedge is valid, the image height counter increments by one until the rising edge of the vertical sync signal Vsync_Posedge arrives, at which point the image height counter is reset to zero and latched in the image height register. This completes the image width and height detection for a frame of image source data.

[0075] Step 204 : Analyze the image digital signal and configure a black edge marker within the image digital signal according to the analysis result.

[0076] Specifically, the digital image signal includes a black border indicator. The sending card analyzes and processes the digital image signal to configure the data within the black border indicator. Based on various parameters within the digital image signal, the sending card selects the required parameters for black border analysis and determines whether any pixel, column, or row within the digital image signal exhibits black borders. Based on the determination, the sending card configures the black border indicator within the digital image signal.

[0077] The analysis of the image digital signal and the configuration process of the black edge marker can be as follows: In an exemplary embodiment, as shown in FIG3 , step 204 includes steps 302 to 306 .

[0078] Step 302: Divide the image digital signal into image regions according to the pixel configuration of the image source data.

[0079] Specifically, the image information carried by the image source data can be broken down into a stacked combination of multiple pixels to form an image. Furthermore, the image digital signal can also include the corresponding positions of each pixel. The sending card can then match the pixel positions of the image digital signal and the image source data, dividing the image digital signal into image regions. This means dividing the image information to be displayed into regions, typically by rows or columns, which makes it easier to identify black edges.

[0080] Optionally, when the sending card divides the image digital signal into image regions, the division criteria include, but are not limited to, dividing the image digital signal into image regions based on the position of each pixel, dividing the image digital signal into image regions based on the number of pixels in each row, dividing the image digital signal into image regions based on the number of pixels in each column, and dividing the image digital signal into image regions based on a specified size and shape. Specifically, the sending card can divide the image region not only based on the number of pixels in each row, but also based on the number of pixels in every n rows, where n is a natural number greater than 1. The same principle applies to columns, which will not be further elaborated.

[0081] Step 304 : performing black edge recognition on each divided image region to obtain a black edge recognition result.

[0082] Specifically, after the image area is divided, black edge recognition is performed on each image area. Different black edge recognition results can be obtained according to different image area division methods. For example, when the image digital signal is divided according to the number of rows of pixels per row, the black edge recognition result obtained is a black row recognition result; when the image digital signal is divided according to the number of columns of pixels per column, the black edge recognition result obtained is a black column recognition result.

[0083] The sending card can identify black edges in each image area by determining the color of the pixels within the image area. If all pixels within the image area are black, the image area is determined to have black edges. The sending card can store black edge reference data indicating black pixel colors in the sending card, and then compare the black edge reference data with the pixels within the image area to determine whether the pixels within the pixel area are black.

[0084] In an exemplary embodiment, step 304 includes step 402: performing RGB value detection on each divided image region based on a detection threshold to obtain a black edge recognition result.

[0085] The detection threshold is derived from the display's brightness conversion table. This table, also known as the gamma value, is a correction method that aligns the display's internal brightness output with the human eye's light perception characteristics, compensating for the nonlinearity of the human eye's natural brightness perception. Different displays may have different brightness conversion tables. The sending card can interact with the receiving card to obtain the display's brightness conversion table. Alternatively, a user can send the display's brightness conversion table data to the sending card via a host computer.

[0086] The sending card includes a black edge detection module, which stores a detection threshold. To update or adjust the detection threshold, as shown in Figure 4, query the display's gamma table to obtain the detection threshold when the gamma conversion function is confirmed to be enabled, and then update the threshold to the black edge detection module. Otherwise, reset the detection threshold to 0.

[0087] Specifically, the detection threshold is the RGB value corresponding to black. The sending card detects the RGB values ​​of each image area based on the detection threshold. When the image area detected by the sending card consists of a single pixel, the detection threshold is directly compared with the RGB value of that pixel. When the image area detected by the sending card consists of multiple pixels, the detection threshold is multiplied by the number of pixels and then compared with the total RGB value of the image area. Optionally, when the image area detected by the sending card consists of multiple pixels, the detection threshold can also be compared with the RGB value of each pixel in sequence.

[0088] Step 306 : configuring the black edge identification bit of each image area in the image digital signal according to the black edge recognition result.

[0089] Specifically, after obtaining the black edge recognition result, the black edge identification bit of each image area is configured. There are many specific configuration methods, and two are described here as examples: the first is to configure a black edge identification bit for each image area. When the black edge recognition result indicates that the image area is a black edge, the black edge identification bit corresponding to the image area is configured to represent the black edge. The second is to configure a black edge identification bit for each pixel point. When the black edge recognition result indicates that the image area is a black edge, the black edge identification bits of all the pixels in the image area are configured to represent the black edge.

[0090] For example, the black edge flag may be set to 1 to represent a black edge, and may be set to 0 to represent a non-black edge.

[0091] In order to more clearly understand the above embodiment, an example is given below for illustration.

[0092] Exemplarily, the sending card includes an image row number counter. After receiving the video source data, the sending card uses the rising edge of the row and field synchronization signal as the basis for image row number counter detection. The image digital signal is divided into image regions according to the number of pixels per row. The rising edge of the row synchronization signal Hsync_Posedge is used to count the image row number counter and reset the image data detection. The rising edge of the field synchronization signal Vsync_Posedge is used to clear the image row number counter and latch the positions of the upper and lower black edges of the image. When the image parameter valid signal De is valid, the RGB values ​​of the image parameters within the image region are judged. If an RGB value exceeds the detection threshold, it indicates that this image region (row) is a non-black row, and the black row status flag is pulled low (set to 0) at the end of the row. If all RGB values ​​within the image region do not exceed the detection threshold, it indicates that this row is a completely black row, and the black row status flag is pulled high (set to 1) at the end of the row. When switching from a black row to a non-black row for the first time, the position of the previous black row is the boundary position of the upper black edge. The last time the non-black row is switched to the black row, the black row position is the boundary position of the lower black edge.

[0093] Furthermore, when the rising edge of the horizontal synchronization signal Hsync_Posedge arrives, the line number is determined. If a non-black line appears in the first line of the image, the upper black border does not exist. If a non-black line appears in the last line of the image, the lower black border does not exist. Therefore, the positions of the upper and lower black borders are updated at the rising edge of the horizontal synchronization signal Hsync_Posedge and the rising edge of the synchronization signal Vsync_Posedge. The positions of the upper and lower black borders can be obtained after each frame of image detection, thus achieving black border detection.

[0094] In this embodiment, by detecting and judging the black edges and marking the black edge identification bit, it is convenient for quickly identifying the black edges and subsequently processing the black edges. At the same time, if the image source data is input in the form of a data stream, the image processing method provided by this embodiment also has the advantages of high detection efficiency and high real-time performance. If the image source data has been cached, the complete image can also be divided into multiple image regions for simultaneous detection, such as detecting in the four directions of up, down, left, and right, which can reduce the time consumption of black edge detection.

[0095] Step 206: performing black edge removal processing on the image digital signal according to the black edge flag.

[0096] Specifically, the sending card detects the black border markers for each image region within the digital image signal. If a black border is detected in the image region, black border removal processing is performed. This black border removal processing can directly remove the image region with a black border, that is, delete the digital image signal corresponding to the image region with a black border. Alternatively, the data within the digital image signal can be simplified.

[0097] In an exemplary embodiment, as shown in FIG. 5 , step 206 includes steps 502 to 504 .

[0098] Step 502 : When the black-border flag indicates that the corresponding digital image signal has a black border, the digital image signal having a black border is replaced with a black-border image signal.

[0099] The black edge image signal includes a position parameter and a black edge flag. The position parameter is used to represent the image area and pixel position.

[0100] Specifically, if each image region is configured with a black border flag, the black border image signal can indicate that the image region has black borders. If each pixel is configured with a black border flag, the black border image signal can indicate that the pixel has a black border.

[0101] Step 504: When the black edge flag indicates that the corresponding digital image signal is not a black edge, retain the digital image signal.

[0102] The retained image digital signal includes position parameters, image parameters and black edge identification bits.

[0103] From this, we can see that the black-bordered image signal removes the image parameters of the digital image signal within the black-bordered area, thereby reducing the amount of data transmitted to the receiving card and thus alleviating the bandwidth transmission burden. At the same time, because the invalid black-bordered data is removed, the effective utilization of the bandwidth during image transmission is improved.

[0104] In an exemplary embodiment, as shown in FIG6 , after step 206 , the image processing method further includes steps 602 to 604 .

[0105] Step 602: Receive display position adjustment information.

[0106] Specifically, the sending card receives display position adjustment information from the host computer. The display position adjustment information is used to adjust the display position of the image. The information can be sent by a staff member operating the host computer or automatically sent by a software program stored in the host computer.

[0107] Step 604 : adjusting the position parameters of each image digital signal after black border removal according to the display position adjustment information.

[0108] Specifically, the image digital signal after black border removal includes the black border image signal and the retained image digital signal, which together constitute a complete image frame. Multiple frames of images constitute a video. Both the black border image signal and the retained image digital signal include position parameters, which specify the corresponding position of each pixel and enable positioning during display. The display position adjustment information is used to adjust these position parameters, changing the image's position on the display screen. The sending card adjusts these position parameters based on the display position adjustment information, either by moving the image's display area or cropping the image.

[0109] Exemplarily, the sending card includes a read image data address processing submodule, in which the position of the row of the image to be read and sent is determined. If the row number is located in the black-bordered image area, the data is not read from the cache, only the black row identification bit is given, and the position parameter and the black-border identification bit are used as the black-bordered image signal. If the row number is within the set display area (i.e., after the display position adjustment information is adjusted), the corresponding image row address (position parameter) is obtained by superimposing the offset (the offset is given by the display position adjustment information), and the image parameters and the black-border identification bit are combined as the adjusted image digital signal. This can achieve the offset display of the effective content area of ​​the video (image) without changing the display area of ​​the receiving card, meeting the applicability requirements.

[0110] The above-mentioned image processing method includes obtaining image source data, decoding the image source data to obtain an image digital signal, analyzing the image digital signal, configuring a black border flag within the image digital signal based on the analysis result, and performing black border removal processing on the image digital signal based on the black border flag. By setting the black border flag, the black borders of the image are identified and marked. After the black border removal processing, the bandwidth occupied by the black border data during data transmission is reduced, thereby improving the effective utilization of bandwidth during image transmission.

[0111] Based on the same inventive concept, the present application also provides an image display method, which is executed after the image processing method is executed, and includes steps 802 to 806.

[0112] Step 802: Receive the digital image signal after black edge removal processing.

[0113] The receiving card receives the image digital signal after black edge removal processing sent by the sending card, including the black edge image signal and the retained image digital signal.

[0114] Step 804 , performing data padding on the image digital signal after black border removal processing according to the black border flag to obtain pre-display data.

[0115] Specifically, both the black-bordered image signal and the retained digital image signal include a black-bordered identifier. The receiving card can identify the black-bordered identifier and process the black-bordered digital image signal based on the black-bordered identifier. Because the black-bordered image signal has invalid black-bordered image parameters removed during transmission from the sending card, the receiving card needs to fill in the image parameters within the black-bordered image signal. Specifically, the receiving card filters out the black-bordered image signal based on the black-bordered identifier and then fills the black-bordered image signal with black image parameters to complete the black-bordered image signal. The completed black-bordered image signal and the retained digital image signal are then subjected to image analysis to obtain pre-display data.

[0116] Step 806: Send the pre-display data to the display screen for display.

[0117] Alternatively, the receiving card can directly send the pre-display data to the display. Alternatively, after generating the pre-display data, the receiving card reads the pre-display data from memory, performs image processing such as brightness adjustment, chromaticity correction, and color gamut adjustment based on the display's driver IC circuit design and timing requirements, and then sends it to the display. The display's IC driver module then outputs the pre-display data according to the corresponding register configuration parameters and image grayscale data.

[0118] In this embodiment, the image display method includes receiving a digital image signal after black border removal processing, padding the digital image signal after black border removal processing with data according to a black border identification bit to obtain pre-display data, and sending the pre-display data to a display screen for display. By padding the digital image signal after black border removal processing with data, the data required for display on the display screen is supplemented, allowing the display screen to accurately display the image.

[0119] In order to better understand the above solution, a detailed explanation is given below in conjunction with a specific embodiment in combination with the application scenario shown in FIG1 .

[0120] In one embodiment, a sending card acquires video source data, decomposes the video source data according to a time parameter to obtain individual image source data, acquires the image source data, and decodes the image source data to obtain an image digital signal. The image digital signal is divided into image regions according to the pixel configuration of the image source data, and RGB values ​​are detected for each divided image region based on a detection threshold to obtain a black edge recognition result. Based on the black edge recognition result, a black edge flag is configured for each image region within the image digital signal. For example, the black edge flag can be set to 1 to indicate a black edge, and can be set to 0 to indicate a non-black edge. When the black edge flag indicates that the corresponding image digital signal has a black edge, the black edge image digital signal is replaced with a black edge image signal; when the black edge flag indicates that the corresponding image digital signal has a non-black edge, the image digital signal is retained.

[0121] The sending card also receives display position adjustment information sent by the host computer, and adjusts the position parameters in each image digital signal after black edge removal processing according to the display position adjustment information.

[0122] The receiving card receives the image digital signal after black border removal. If the sending card also receives display position adjustment information from the host computer, the receiving card receives the adjusted image digital signal after black border removal. The image digital signal after black border removal is padded with data according to the black border identification bit to obtain pre-display data, which is then sent to the display screen for display.

[0123] In this embodiment, by modifying the communication protocol frame, a black border flag is set, and the image parameters of the black border are removed, thereby reducing the amount of invalid data transmission and improving the effective bandwidth of the network port transmission. The present application also dynamically sets the detection threshold of the RGB value in combination with the Gamma table used by the display screen to achieve more accurate detection of the black border of the video that matches the display screen. On this basis, the present application also supports moving the position of the video effective content display area under the adjustment of the host computer, thereby improving the display freedom, being applicable to more use occasions, and improving applicability.

[0124] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0125] Based on the same inventive concept, embodiments of the present application also provide an image processing device for implementing the aforementioned image processing method. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations in one or more of the following image processing device embodiments can be found in the above-described limitations on the image processing method and will not be further elaborated here.

[0126] In an exemplary embodiment, as shown in FIG7 , an image processing apparatus is provided, including: a decoding module 720 , a black edge recognition module 740 , and a black edge processing module 760 , wherein:

[0127] The decoding module 720 is used to obtain image source data and decode the image source data to obtain an image digital signal.

[0128] The black edge recognition module 740 is used to analyze the image digital signal and configure the black edge identification bit in the image digital signal according to the analysis result.

[0129] The black edge processing module 760 is used to perform black edge removal processing on the image digital signal according to the black edge identification bit.

[0130] In one embodiment, the black edge recognition module 740 is also used to divide the image digital signal into image areas according to the pixel configuration of the image source data, perform black edge recognition on each divided image area, obtain a black edge recognition result, and configure the black edge identification bit of each image area in the image digital signal according to the black edge recognition result.

[0131] In one embodiment, the black edge recognition module 740 is further configured to perform RGB value detection on each divided image region based on a detection threshold to obtain a black edge recognition result. The detection threshold is obtained according to a brightness conversion table of the display screen.

[0132] In one embodiment, the black border processing module 760 is further configured to replace the black-bordered digital image signal with a black-bordered image signal when the black border identification bit indicates that the corresponding digital image signal is a black border, wherein the black-bordered image signal includes a position parameter and a black border identification bit. When the black border identification bit indicates that the corresponding digital image signal is not a black border, the image digital signal is retained; the retained image digital signal includes the position parameter, the image parameter, and the black border identification bit.

[0133] In one embodiment, the image processing device also includes an adjustment module for receiving display position adjustment information after the black border processing module 760 removes the black borders of the image digital signal according to the black border identification position, and adjusting the position parameters in each image digital signal after the black border removal processing according to the display position adjustment information.

[0134] In one embodiment, the image processing apparatus further includes a video processing module configured to obtain video source data before the decoding module 720 obtains the image source data, and to decompose the video source data according to a time parameter to obtain each image source data.

[0135] In one embodiment, the present application further provides an image display device for implementing the above-mentioned image display method. The image display device is configured to receive a digital image signal after black border removal processing after the image processing device executes the image processing, perform data padding on the digital image signal after black border removal processing according to the black border identification bit, obtain pre-display data, and send the pre-display data to a display screen for display.

[0136] Each module in the above-mentioned image processing device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0137] In an exemplary embodiment, a computer device is provided, which may be a terminal. A diagram of its internal structure may be shown in FIG8 . The computer device includes a processor, memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The input / output interface of the computer device is configured to exchange information between the processor and an external device. The communication interface of the computer device is configured to communicate with an external terminal via wired or wireless communication, where the wireless communication may be achieved via Wi-Fi, a mobile cellular network, NFC (near-field communication), or other technologies. When executed by the processor, the computer program implements an image processing method. The display unit of the computer device is configured to form a visually visible image and may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse.

[0138] Those skilled in the art will understand that the structure shown in FIG8 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0139] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0140] Obtaining image source data and decoding the image source data to obtain an image digital signal;

[0141] Analyze the image digital signal and configure the black edge marker in the image digital signal according to the analysis result;

[0142] The image digital signal is processed to remove the black edge according to the black edge flag.

[0143] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0144] The image digital signal is divided into image areas according to the pixel configuration of the image source data, black edge recognition is performed on each divided image area to obtain a black edge recognition result, and a black edge identification bit of each image area in the image digital signal is configured according to the black edge recognition result.

[0145] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0146] The RGB values ​​of each divided image area are detected based on the detection threshold to obtain the black edge recognition result; the detection threshold is obtained according to the brightness conversion table of the display screen.

[0147] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0148] When the black border identification bit indicates that the corresponding image digital signal has a black border, the black border image digital signal is replaced with a black border image signal, and the black border image signal includes a position parameter and a black border identification bit. When the black border identification bit indicates that the corresponding image digital signal has a non-black border, the image digital signal is retained; the retained image digital signal includes the position parameter, image parameters, and the black border identification bit.

[0149] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0150] Display position adjustment information is received, and position parameters in each image digital signal after black border removal processing are adjusted according to the display position adjustment information.

[0151] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0152] Obtain video source data, and disassemble the video source data according to time parameters to obtain each image source data.

[0153] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0154] The image digital signal after black edge removal processing is received, and data is filled in the image digital signal after black edge removal processing according to the black edge identification bit to obtain pre-display data, and the pre-display data is sent to the display screen for display.

[0155] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0156] Obtaining image source data and decoding the image source data to obtain an image digital signal;

[0157] Analyze the image digital signal and configure the black edge marker in the image digital signal according to the analysis result;

[0158] The image digital signal is processed to remove the black edge according to the black edge flag.

[0159] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0160] The image digital signal is divided into image areas according to the pixel configuration of the image source data, black edge recognition is performed on each divided image area to obtain a black edge recognition result, and a black edge identification bit of each image area in the image digital signal is configured according to the black edge recognition result.

[0161] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0162] The RGB values ​​of each divided image area are detected based on the detection threshold to obtain the black edge recognition result; the detection threshold is obtained according to the brightness conversion table of the display screen.

[0163] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0164] When the black border identification bit indicates that the corresponding image digital signal has a black border, the black border image digital signal is replaced with a black border image signal, and the black border image signal includes a position parameter and a black border identification bit. When the black border identification bit indicates that the corresponding image digital signal has a non-black border, the image digital signal is retained; the retained image digital signal includes the position parameter, image parameters, and the black border identification bit.

[0165] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0166] Display position adjustment information is received, and position parameters in each image digital signal after black border removal processing are adjusted according to the display position adjustment information.

[0167] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0168] Obtain video source data, and disassemble the video source data according to time parameters to obtain each image source data.

[0169] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0170] The image digital signal after black edge removal processing is received, and data is filled in the image digital signal after black edge removal processing according to the black edge identification bit to obtain pre-display data, and the pre-display data is sent to the display screen for display.

[0171] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0172] Obtaining image source data and decoding the image source data to obtain an image digital signal;

[0173] Analyze the image digital signal and configure the black edge marker in the image digital signal according to the analysis result;

[0174] The image digital signal is processed to remove the black edge according to the black edge flag.

[0175] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0176] The image digital signal is divided into image areas according to the pixel configuration of the image source data, black edge recognition is performed on each divided image area to obtain a black edge recognition result, and a black edge identification bit of each image area in the image digital signal is configured according to the black edge recognition result.

[0177] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0178] The RGB values ​​of each divided image area are detected based on the detection threshold to obtain the black edge recognition result; the detection threshold is obtained according to the brightness conversion table of the display screen.

[0179] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0180] When the black border identification bit indicates that the corresponding image digital signal has a black border, the black border image digital signal is replaced with a black border image signal, and the black border image signal includes a position parameter and a black border identification bit. When the black border identification bit indicates that the corresponding image digital signal has a non-black border, the image digital signal is retained; the retained image digital signal includes the position parameter, image parameters, and the black border identification bit.

[0181] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0182] Display position adjustment information is received, and position parameters in each image digital signal after black border removal processing are adjusted according to the display position adjustment information.

[0183] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0184] Obtain video source data, and disassemble the video source data according to time parameters to obtain each image source data.

[0185] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0186] The image digital signal after black edge removal processing is received, and data is filled in the image digital signal after black edge removal processing according to the black edge identification bit to obtain pre-display data, and the pre-display data is sent to the display screen for display.

[0187] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0188] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, and the like.

[0189] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0190] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. An image processing method, comprising: Acquiring image source data, and decoding the image source data to obtain an image digital signal; Analyzing the image digital signal, and configuring a black border marker within the image digital signal according to the analysis result; The image digital signal is subjected to black edge removal processing according to the black edge identification bit.

2. The method according to claim 1, wherein The analyzing the image digital signal and configuring the black edge identification bit in the image digital signal according to the analysis result includes: Dividing the image digital signal into image areas according to the pixel configuration of the image source data; Perform black edge recognition on each divided image area to obtain a black edge recognition result; The black edge identification bit of each image area in the image digital signal is configured according to the black edge recognition result.

3. The method according to claim 2, wherein: The step of performing black edge recognition on each divided image region to obtain a black edge recognition result includes: The RGB value of each divided image area is detected based on a detection threshold to obtain a black edge recognition result; the detection threshold is obtained according to the brightness conversion table of the display screen.

4. The method according to any one of claims 1 to 3, wherein The performing black edge removal processing on the image digital signal according to the black edge identification bit includes: When the black edge identification bit indicates that the corresponding image digital signal has a black edge, the black edge image digital signal is replaced with a black edge image signal; the black edge image signal includes a position parameter and a black edge identification bit; When the black border identification bit indicates that the corresponding image digital signal is not black-bordered, the image digital signal is retained; the retained image digital signal includes position parameters, image parameters and the black border identification bit.

5. The method according to any one of claims 1 to 4, wherein After performing black edge removal processing on the image digital signal according to the black edge identification bit, the method further includes: receiving display position adjustment information; According to the display position adjustment information, the image digital signal after the black edge removal process is processed Position parameters are adjusted.

6. The method according to any one of claims 1 to 5, wherein Before acquiring the image source data, the method further includes: Video source data is acquired, and the video source data is decomposed according to a time parameter to obtain each image source data.

7. The method according to any one of claims 1 to 6, wherein The method is applied to a sending card, and the sending card processes the image source data.

8. The method according to claim 7, wherein: The sending card is connected to an image sending device, and the image sending device is used to send the image source data to the sending card.

9. The method according to claim 8, wherein The sending card processes the image source data including: The sending card processes the black edge.

10. The method according to claim 8 or 9, wherein: The sending card is connected to a host computer, and the host computer sends a control signal to the sending card. The control signal is used to adjust the working state of the sending card or the image processing process.

11. The method according to claim 10, wherein: The sending card uploads its own working status or received image source data to the host computer.

12. The method according to claim 10 or 11, wherein: The sending card sends the processed data to the receiving card, and the receiving card controls the display screen to display the corresponding image.

13. The method according to claim 12, wherein: The display screen includes a plurality of display areas, each of the plurality of display areas corresponds to each of a plurality of receiving cards, and the plurality of receiving cards form a card matrix.

14. The method according to claim 13, wherein: The receiving card has a display position identifier that matches the corresponding display area.

15. The method according to claim 14, wherein The sending card communicates with the multiple receiving cards to obtain the display position identifiers of the multiple receiving cards. The sending card distributes the processed data according to the display positions and sends the corresponding data according to the display position identifiers.

16. The method according to claim 15, wherein The image sending device is connected to the sending card via a video transmission line, the sending card is connected to the host computer via a universal serial bus (USB), the sending card is connected to the receiving card via a network cable, and the receiving card is connected to the display screen via a control cable.

17. An image display method, comprising: Receiving the image digital signal after black edge removal processing; Performing data filling on the image digital signal after black edge removal processing according to the black edge identification bit to obtain pre-display data; The pre-display data is sent to a display screen for display.

18. An image processing apparatus, comprising: A decoding module, configured to obtain image source data and decode the image source data to obtain an image digital signal; a black edge recognition module, configured to analyze the image digital signal and configure a black edge identification bit within the image digital signal according to the analysis result; The black edge processing module is used to perform black edge removal processing on the image digital signal according to the black edge identification bit.

19. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 16 are implemented.

20. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

Citation Information

Patent Citations

  • Method and device for detecting black edge of video image

    CN105430382A

  • Method and device for removing black edge from video image

    CN105450908A

  • Image transmission method and device, terminal and storage medium

    CN111417007A

  • Display device and sound and picture synchronization method

    CN114979736A

  • Image processing method and device, computer equipment and image display method

    CN118075549A