Image processing method, and terminal device and computer-readable storage medium
By converting coordinate data according to the resolution mapping relationship between the LED display terminal and the annotation terminal in the image processing method, generating an annotation image matching with the high resolution, and superimposing it with the original image, the implementation of the annotation function on the LED display terminal is solved. Problem, improving image display effect and user experience.
Patent Information
- Application Number
- PCT/CN2023/094008
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-12
- Publication Date
- 2024-11-21
AI Technical Summary
The existing image processing methods cannot implement the annotation function on the LED display terminal because the resolution of the annotation image is limited by the resolution of the annotation terminal and cannot be superimposed with the original image of the high-resolution LED display terminal.
By receiving the original image of the second terminal and the first coordinate data of the first terminal, the first coordinate data is converted into a first batch of annotations with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal. Images, and overlay them with the original image to generate the target image for annotation.
It realizes the annotation of images by users on the LED display terminal, improves the display effect of images and user experience, and meets the annotation needs of large LED screens.
Smart Images

Figure CN2023094008_21112024_PF_FP_ABST
Abstract
Description
Image processing method, terminal device and computer-readable storage medium Technical Field
[0001] The present application relates to the field of display technology, and in particular to an image processing method, a terminal device, and a computer-readable storage medium. Background Art
[0002] When existing display terminals are used for information publishing or demonstration, in order to facilitate modification of the displayed original image, users will perform annotation operations through the annotation terminal to obtain an annotated image, and by superimposing the original image with the annotated image, obtain the annotated target image, so that the display terminal can display the target image, thereby realizing the annotation function of the display terminal.
[0003] However, the annotated images generated by existing image processing methods are limited by the resolution of the annotation terminal, which typically has a resolution of 4K. When the display terminal is a large light-emitting diode (LED) display device, the resolution of the display terminal is usually greater than 4K, making it impossible to superimpose the annotated image on the original image. Consequently, the annotation function of the LED display terminal cannot be realized, which is not conducive to information release and presentation on the display terminal. Technical issues
[0004] The annotation function of the LED display terminal cannot be realized. Technical Solutions
[0005] In view of this, in order to solve the above technical problems, the present application provides an image processing method, a terminal device, and a computer-readable storage medium. To achieve the above purpose, the present application provides a first technical solution: providing an image processing method, comprising: receiving an original image from a second terminal and first coordinate data from a first terminal, wherein the resolution of the second terminal is greater than the resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; converting the first coordinate data into a first batch of annotated images with the same resolution as the second terminal according to a resolution mapping relationship between the second terminal and the first terminal; superimposing the first batch of annotated images with the original image to obtain a target image; and sending the target image to the second terminal so that the annotated target image is displayed on the second terminal.
[0006] The first coordinate data corresponds to the resolution of the first terminal; and converting the first coordinate information into the first batch of annotation images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal includes: obtaining the resolution of the second terminal; obtaining second coordinate data corresponding to the first coordinate data according to the resolution mapping relationship between the second terminal and the first terminal, the second coordinate data corresponding to the resolution of the second terminal; and generating the first batch of annotation images according to the second coordinate data, so that the first batch of annotation images have the same resolution as the second terminal.
[0007] Before receiving the original image of the second terminal and the first coordinate data of the first terminal, the image processing method also includes: obtaining a second annotated image of the first terminal, wherein the second annotated image is a binary image generated by the first terminal in response to an annotation operation; identifying the second annotated image to obtain the first coordinate data, and the first coordinate data is used to indicate the annotation position of the annotation operation.
[0008] The first batch of annotation images are binary images, the original image is a true color image, and the resolution mapping relationship between the second terminal and the first terminal is determined by the correspondence between the bit depth of the pixel points of the original image and the pixel points of the second annotation image, so that the resolution of the first batch of annotation images is the same as that of the original image.
[0009] The resolution of the second terminal and the first terminal is mapped by the horizontal pixel points of the original image and the vertical pixel points of the second annotated image; or the resolution of the second terminal and the first terminal is mapped by the horizontal pixel points of the original image and the horizontal pixel points of the second annotated image.
[0010] The original image includes first channel pixels, second channel pixels and third channel pixels, and the bit depths of the first channel pixels, the second channel pixels and the third channel pixels correspond one-to-one to the pixel points of the first batch injection images.
[0011] The first channel pixel is a red channel pixel, the second channel pixel is a green channel pixel, and the third channel pixel is a blue channel pixel.
[0012] In order to solve the above technical problems, the present application provides a second technical solution: a terminal device is provided, comprising a processor and a memory connected to the processor, wherein program data is stored in the memory, and the processor calls the program data stored in the memory to execute the image processing method as described above.
[0013] In order to solve the above technical problems, the present application provides a third technical solution: a terminal device is provided, including a receiving module, a mapping module, an overlay module and a display module; the receiving module is used to receive the original image of the second terminal and the first coordinate data of the first terminal, the resolution of the second terminal is greater than the resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; the mapping module is used to convert the first coordinate data into a first batch of annotated images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal; the overlay module is used to overlay the first batch of annotated images with the original image to obtain a target image; the display module is used to send the target image to the second terminal to display the annotated target image on the second terminal.
[0014] In order to solve the above technical problems, the present application provides a fourth technical solution: providing a computer-readable storage medium storing program instructions, wherein the program instructions are executed to implement the image processing method as described above. Beneficial effects
[0015] Different from the existing technology, the image processing method of the present application receives the original image of the second terminal and the first coordinate data of the first terminal, and converts the first coordinate data into a first batch of annotated images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal, and superimposes the first batch of annotated images with the original image to obtain the annotated target image. Since the resolution of the first batch of annotated images is the same as that of the original image, the image processing method of the present application can directly superimpose the first batch of annotated images with the original image, thereby enabling users to annotate the displayed image, improving the display effect of the image, and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0017] FIG1 is a flow chart of a first embodiment of an image processing method provided by the present application;
[0018] FIG2 is a schematic diagram of the process of superimposing the first batch of annotation images with the original image in FIG1 ;
[0019] FIG3 is a flow chart of a second embodiment of the image processing method provided by the present application;
[0020] FIG4 is a schematic flow chart of a third embodiment of the image processing method provided by the present application;
[0021] FIG5 is a schematic diagram of an embodiment of a resolution mapping relationship provided by the present application;
[0022] FIG6 is a schematic structural diagram of an embodiment of a second annotated image provided by the present application;
[0023] FIG7 is a schematic structural diagram of a first embodiment of a terminal device provided by the present application;
[0024] FIG8 is a schematic structural diagram of a second embodiment of a terminal device provided by the present application;
[0025] FIG9 is a schematic structural diagram of a third embodiment of a terminal device provided by the present application;
[0026] FIG10 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application. DETAILED DESCRIPTION
[0027] To enable those skilled in the art to better understand the technical solutions of this application, the present application is further described below in conjunction with the accompanying drawings and specific embodiments. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of this application.
[0028] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.
[0029] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0030] When existing display terminals are used for information publishing or demonstration, in order to facilitate modification of the displayed original image, users will perform annotation operations through the annotation terminal to obtain an annotated image, and by superimposing the original image with the annotated image, obtain the annotated target image, so that the display terminal can display the target image, thereby realizing the annotation function of the display terminal.
[0031] On a large LED display screen, it is usually necessary to display multiple video sources at the same time. The video sources can be original images output by PC, playback box, set-top box, etc. The annotated image is annotated within the range of the entire LED display screen. If the integration of the video source and the annotated image is completed on the PC side, this can only complete the annotation of one of the video signals. The problem to be solved in this application is to perform annotations within the range of the entire LED display screen, no matter how many video signals are currently displayed on the screen at the same time. When all signal sources are PCs, each PC can only process the corresponding annotation channel, and eventually integration is still required. In actual applications, multiple video sources are usually not all PCs. When the video source is non-PC output, there is no way to complete the integration of multiple video sources and annotation images on the PC side.
[0032] In scenarios such as large conferences, press conferences, and lecture halls where information is released or presented, the display terminal is typically a large LED display. Users can better communicate information through the display terminal. They can use tablets, mobile phones, and other communication devices as annotation terminals to annotate the content displayed on the display terminal. The content displayed on the annotation terminal is the preview screen of the LED display. The preview screen is the real-time image currently displayed on the LED display. The resolution of the preview screen is consistent with the resolution of the annotation terminal, which is usually smaller than the resolution of the LED display. The real-time image of the LED display can be a composite image of multiple video sources. A video controller or video splicing controller can encode the real-time image of the LED display via H.264 and send it to the annotation terminal for display. However, the resolution of the annotation terminal is typically 4K, and the annotated image is limited by the resolution of the annotation terminal, resulting in a 4K resolution. When the display terminal is a large LED display device, the resolution of the display terminal is greater than 4K, making it impossible to directly overlay the annotated image with the original image. Users cannot annotate the LED display terminal using this method, which is not conducive to the information transmission of the display terminal.
[0033] In view of this, the present application proposes an image processing method, which converts the first coordinate data into a first batch of annotated images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal (i.e., the display terminal) and the first terminal (i.e., the annotation terminal), and superimposes the first batch of annotated images with the original image to obtain an annotated target image, thereby enabling the user to annotate the displayed image, improving the image display effect, and enhancing the user experience. The image processing method can be applied to a terminal device, for example, the terminal device can be an image annotation device, and the terminal device can perform image processing on the annotated image of the first terminal through a programmable logic device such as a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA).
[0034] The terminal device of the present application may be a server or a system comprising a server and a local terminal. For example, the terminal device of the present application may be a server of a second terminal, a sending card, a splicing controller, or other device integrated into the second terminal, or an independent terminal device connected to the second terminal. The terminal device is not specifically limited herein. Accordingly, the various components of the terminal device, such as the various units, subunits, modules, and submodules, may be entirely located in the server or separately located in the server and the local terminal.
[0035] Please refer to Figures 1-2. Figure 1 is a flowchart of the first embodiment of the image processing method provided by this application, and Figure 2 is a flowchart of superimposing the first batch of annotation images with the original image in Figure 1. As shown in Figure 1, in this embodiment, the image processing method includes the following steps:
[0036] Step S11: receiving an original image of a second terminal and first coordinate data of a first terminal, wherein a resolution of the second terminal is greater than a resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal.
[0037] Specifically, the second terminal is used to display and demonstrate information on the display image, including information demonstration equipment such as LED display screens used in office, teaching and other activity scenes. The first terminal is used to annotate the annotation image corresponding to the display image, so that the user can annotate the display image through the first terminal. The first terminal includes but is not limited to a device that can be connected to the first terminal and is easy to carry or use. For example, the first terminal can be a mobile device such as a mobile phone or tablet computer. It can be understood that the second terminal includes at least a second display screen for displaying the display image; the first terminal includes at least a first display screen for generating first coordinate data based on the user's annotation operation. The original image is the video source image input to the second terminal.
[0038] In an optional embodiment of the present application, the display content and annotation content of the second terminal are both displayed on the display layer. The first coordinate data can be the coordinates of the annotation content on the display layer entered by the user when performing the annotation operation. For example, the annotation content can be annotation effects or styles such as annotation lines, annotation boxes, area highlights, and font overlays. The annotation content can be generated based on the user's style selection and is not specifically limited here. This embodiment only scales the annotation content according to the resolution mapping relationship of step S12 to obtain new annotation content (i.e., the first batch of annotation images).
[0039] In an optional embodiment of the present application, the display content of the second terminal is displayed on the display layer. In the annotation state, the second terminal generates a transparent layer covering the display layer, and the annotation content is displayed on the transparent layer. In this embodiment, the first coordinate data can be the coordinates of the annotation content in the transparent layer. This embodiment only proportionally enlarges the annotation content according to the resolution mapping relationship of step S12 to obtain new annotation content (i.e., the first batch of annotation images).
[0040] In an optional embodiment of the present application, the display content of the second terminal is displayed on the display layer. In the annotation state, the second terminal generates a transparent layer covering the display layer, and the annotation content is displayed on the transparent layer. In this embodiment, the first coordinate data can be the coordinates of the entire transparent layer containing the annotation content. This embodiment can proportionally enlarge the entire transparent layer containing the annotation content according to the resolution mapping relationship of step S12 to obtain a new transparent layer (i.e., the first batch of annotation images).
[0041] It can be understood that the original image of the second terminal is generated according to the resolution of the second terminal, and the first coordinate data of the first terminal is generated according to the resolution of the first terminal. The first coordinate data has a resolution difference from the original image, so that the first coordinate data cannot be directly applied to the original image.
[0042] Step S12: converting the first coordinate data into a first batch of annotation images having the same resolution as that of the second terminal according to the resolution mapping relationship between the second terminal and the first terminal.
[0043] Because the first coordinate data and the original image have different resolutions, after acquiring the first coordinate data and the original image, the first coordinate data is converted into a first batch of annotation images having the same resolution as the second terminal based on a resolution mapping relationship between the second terminal and the first terminal. Because the first coordinate data includes the coordinate data of the annotation content entered by the user, the first batch of annotation images converted from the first coordinate data is used to display the annotation content entered by the user.
[0044] The terminal device pre-stores a resolution mapping relationship between the second terminal and the first terminal, so that after acquiring the first coordinate data, the first coordinate data can be converted into the first batch of annotation images with the same resolution as the second terminal.
[0045] Step S13: Superimpose the first batch of annotation images with the original image to obtain the target image.
[0046] As shown in FIG2 , since the first batch of annotated images have the same resolution as the original image, after obtaining the first batch of annotated images, the annotation contents of the first batch of annotated images are directly superimposed on the original image so that the target image includes the annotation contents input by the user.
[0047] Among them, the annotation content of the first batch of annotated images is different according to the user's annotation operation. The specific implementation method of the user realizing annotation through the first terminal is shown in Figure 2, Figure 2 (a) is a schematic diagram of the operation of adding a labeling box to the original image, Figure 2 (b) is a schematic diagram of the operation of highlighting an area of the original image, and Figure 2 (c) is a schematic diagram of the operation of superimposing fonts on the original image. It can be understood that the annotation content given in Figure 2 is only for reference. Since the user can input the first coordinate data through the first terminal, the input style of the first coordinate data can correspond to a variety of annotation styles, so that the image processing method of this embodiment can achieve a variety of annotation effects, thereby improving the information transmission effect of the second terminal.
[0048] Step S14: sending the target image to the second terminal so that the annotated target image is displayed on the second terminal.
[0049] After obtaining the superimposed target image, the target image is sent to the second terminal to display the annotated target image on the second terminal, so that the annotated content can be read through the second terminal. When the user presents information through the second terminal, the information can be better conveyed, thereby improving the user experience.
[0050] In an embodiment of the present application, the image processing method receives the original image of the second terminal and the first coordinate data of the first terminal, converts the first coordinate data into a first batch of annotation images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal, and superimposes the first batch of annotation images with the original image to obtain the annotated target image. Since the first batch of annotation images have the same resolution as the original image, the image processing method of this embodiment can directly superimpose the first batch of annotation images with the original image to enable the user to annotate the displayed image, improve the display effect of the image, and enhance the user's usage experience.
[0051] In one embodiment, please refer to FIG3 , which is a flow chart of a second embodiment of the image processing method provided by the present application. As shown in FIG3 , in this embodiment, step S12 includes the following steps:
[0052] Step S21: Obtain the resolution of the second terminal.
[0053] The resolution of the second terminal is the resolution of the display terminal. It can be understood that in this embodiment, the resolution of the second terminal is greater than the resolution of the first terminal. For example, the resolution of the first terminal is 4K and the resolution of the second terminal is 8K.
[0054] Step S22: acquiring second coordinate data corresponding to the first coordinate data according to the resolution mapping relationship between the second terminal and the first terminal, where the second coordinate data corresponds to the resolution of the second terminal.
[0055] Specifically, after obtaining the resolution of the second terminal, since the first coordinate data is coordinate data generated according to the resolution of the first terminal, the first coordinate data can be converted into second coordinate data corresponding to the resolution of the second terminal according to the resolution mapping relationship between the second terminal and the first terminal.
[0056] Step S23: generating a first batch of annotation images according to the second coordinate data, so that the first batch of annotation images have the same resolution as that of the second terminal.
[0057] After acquiring the second coordinate data, a first batch of annotated images is generated according to the second coordinate data, so as to perform a step of superimposing the first batch of annotated images with the original image after acquiring the corresponding annotated image.
[0058] In an embodiment of the present application, the image processing method obtains the resolution of the second terminal, and obtains second coordinate data corresponding to the first coordinate data based on the resolution mapping relationship between the second terminal and the first terminal. The second coordinate data corresponds to the resolution of the second terminal, and a first batch of annotation images is generated based on the second coordinate data so that the first batch of annotation images have the same resolution as the second terminal, so as to achieve the superposition of the first batch of annotation images and the original image, realize the user's annotation of the displayed image, improve the display effect of the image, and improve the user's usage experience.
[0059] In one embodiment, please refer to FIG4 , which is a flow chart of a third embodiment of the image processing method provided by the present application. As shown in FIG4 , in this embodiment, before step S11 , the image processing method may further include the following steps:
[0060] Step S31: Acquire a second annotated image of the first terminal, wherein the second annotated image is a binary image generated by the first terminal in response to an annotation operation.
[0061] Specifically, the first terminal is an annotation terminal, and the user performs an annotation operation on the first terminal to obtain a second annotated image of the first terminal.
[0062] Step S32: Identify the second annotated image to obtain first coordinate data, where the first coordinate data is used to indicate an annotation position of the annotation operation.
[0063] It can be understood that the second annotated image is a binary image generated by the first terminal in response to the annotation operation. The grayscale value of the pixel points of the second annotated image can be 0 or 255. The annotation position when the user performs the annotation operation on the first terminal can be reflected in the grayscale value change of the second annotated image. For example, the grayscale value of the unannotated area of the second annotated image is 0, and the grayscale value of the annotated area is 255, or the grayscale value of the unannotated area is 255, and the grayscale value of the annotated area is 0.
[0064] After acquiring the second annotated image, the grayscale value changes of the second annotated image are identified to obtain the first coordinate data of the user's annotation. The first coordinate data is used to indicate the annotation location of the annotation operation. For example, when the grayscale value of the unannotated area is 255, the first coordinate data can be obtained by identifying the location of the pixel with a grayscale value of 0 in the second annotated image. The image processing method of steps S11-S14 is then performed based on the original image and the first coordinate data.
[0065] In an embodiment of the present application, the image processing method obtains the second annotated image of the first terminal and obtains the first coordinate data by identifying the second annotated image, so as to convert the first coordinate data into the first annotated image with the same resolution as the second terminal, thereby realizing the superposition of the first annotated image and the original image, enabling the user to annotate the displayed image, improving the display effect of the image, and improving the user's usage experience.
[0066] In one embodiment, the first batch of annotation images are binary images, and the resolution mapping relationship between the second terminal and the first terminal is determined by the correspondence between the bit depth of the pixel points of the second annotation image and the pixel points of the original image, so that the resolution of the first batch of annotation images is the same as that of the original image.
[0067] Specifically, bit depth is used to represent the color depth of an image and is used to record the pixel color value. In this embodiment, because the resolution of the second terminal is greater than that of the first terminal, when mapping the low-resolution first coordinate data to a first batch of annotated images with the same second resolution, in order to improve the annotation effect of the first batch of annotated images, the resolution mapping relationship between the second terminal and the first terminal is obtained by the correspondence between the bit depth of the pixels of the second annotated image and the pixels of the original image. This allows one pixel of the second annotated image to correspond to multiple pixels of the original image, thereby expanding the user's annotated first coordinate data. This allows image processing to be performed on the high-resolution second terminal to meet the annotation requirements of large LED screens.
[0068] Furthermore, since the resolution mapping relationship between the second terminal and the first terminal is determined by the correspondence between the bit depth of the pixel points of the second annotated image and the pixel points of the original image, that is, one bit depth of the pixel points of the second annotated image corresponds to one pixel point of the original image, for example, when the original image is an RGB image, the pixel points of the second annotated image include the bit depths of three color channels, and each color channel generally includes 8 bit depths, that is, the bit depth of one pixel point of the second annotated image can correspond to 24 pixel points of the second annotated image respectively.
[0069] Please refer to Figure 5, which is a schematic diagram of an embodiment of the resolution mapping relationship provided in this application. As shown in Figure 5, in one embodiment, the resolution of the second terminal and the first terminal are mapped by the horizontal pixels of the original image and the vertical pixels of the second annotated image; or, the resolution of the second terminal and the first terminal are mapped by the horizontal pixels of the original image and the horizontal pixels of the second annotated image.
[0070] Specifically, the resolutions of the first terminal and the second terminal include horizontal pixels and vertical pixels, and the mapping direction of the resolution of the second terminal to the first terminal includes at least a first direction and a second direction. Figure 5(a) is a schematic diagram of mapping the resolution of the second terminal to the first terminal in the first direction, and Figure 5(b) is a schematic diagram of mapping the resolution of the second terminal to the first terminal in the second direction.
[0071] The mapping in the first direction may be a mapping of horizontal pixels of the original image to vertical pixels of the second annotated image, or the mapping in the first direction may be a mapping of horizontal pixels of the original image to horizontal pixels of the second annotated image. For example, in FIG5(a), the image resolution of the second terminal is 3840*1080, the number of horizontal pixels of the second terminal is 3840, and the number of vertical pixels is 1080. The bit depth of one pixel of the original image is respectively mapped to 24 consecutive horizontal pixels of the second annotated image. The resolution of the second annotated image can be calculated to be 160*1080.
[0072] In another embodiment, the mapping in the second direction can be a mapping of pixels of the original image and part of the horizontal pixels and part of the vertical pixels of the second annotated image. For example, as shown in (b) of Figure 5, the image resolution of the second terminal is 3840*1080. When the bit depth of one pixel of the original image corresponds to 12 horizontal pixels and 8 vertical pixels of the second annotated image, the resolution of the second annotated image can be calculated to be 320*540.
[0073] Understandably, the mapping directions of the original image and the second annotated image may not be uniform, as long as the bit depth of the pixels of the second annotated image corresponds to the pixels of the original image. Because the image processing method of this embodiment can convert the first coordinate data into a first annotated image with the same resolution as the second terminal through the resolution mapping relationship between the second terminal and the first terminal, the annotation range of the low-resolution second annotated image is expanded. This image processing method can meet the requirements of high-resolution LED display screens and improve the user experience.
[0074] In one embodiment, the second annotation image includes first channel pixels, second channel pixels, and third channel pixels, and the bit depths of the first channel pixels, the second channel pixels, and the third channel pixels correspond one-to-one to the pixels of the first annotation image.
[0075] Specifically, the first channel pixel, the second channel pixel, and the third channel pixel are used to represent the color information of each pixel in different color channels. The second annotated image includes multiple pixels. For example, when the resolution of the second annotated image is 1920*1080, the second annotated image has 1920 horizontal pixels and 1080 vertical pixels. Each pixel includes a first channel pixel R, a second channel pixel G, and a third channel pixel B. The bit depths of the first channel pixel, the second channel pixel, and the third channel pixel are respectively used to represent the bit depth required for the color channel.
[0076] As can be understood, the image processing method of this embodiment aligns the number of bits in the first, second, and third channels of each pixel in the second annotated image with the pixels in the first annotated image to obtain a resolution mapping relationship between the second terminal and the first terminal. Multiple pixels in the first annotated image can indicate the location of a pixel in the second annotated image, allowing users to annotate images on the high-resolution second terminal using the low-resolution first terminal, thereby improving image display quality.
[0077] In an optional embodiment, each first channel pixel, second channel pixel, and third channel pixel respectively includes a bit depth of 8, and each bit depth of the second annotation image corresponds to a pixel point of the first annotation image, so that each pixel point of the second annotation image can indicate the pixel point position of 24 first annotation images, so as to convert the second annotation image of the first terminal into the first annotation image with the same resolution as the second terminal.
[0078] In one embodiment, please refer to Figure 6, which is a schematic diagram of the structure of an embodiment of the second annotated image provided by this application. As shown in Figure 6, the first channel pixel is a red channel pixel (R), the second channel pixel is a green channel pixel (G), and the third channel pixel is a blue channel pixel (B).
[0079] Specifically, the first terminal and the second terminal are devices that display different colors through the three primary colors of light (red, green, and blue). The first channel pixels, second channel pixels, and third channel pixels of the second annotation image of the first terminal include but are not limited to red channel pixels, green channel pixels, and blue channel pixels; for example, the first channel pixels are red channel pixels, the second channel pixels are green channel pixels, and the third channel pixels are blue channel pixels.
[0080] Please refer to Figure 7, which is a structural diagram of the first embodiment of the terminal device provided by the present application. As shown in Figure 7, the terminal device of this embodiment can be used for image processing of an LED all-in-one machine or an LED display screen. Specifically, the terminal device can be a programmable logic device integrated on a sending card, a splicing controller and other components of the LED display screen. The terminal device is connected to the LED display screen and is connected to the annotation terminal through an HDMI interface chip to obtain the first coordinate data of the annotation terminal. Since the terminal device processes the original image of the LED display screen according to the first coordinate data, when the LED display screen is connected to multiple video sources, the terminal device can integrate the annotation content of the multiple video sources and send the annotated target image to the LED display screen to achieve full-screen annotation of the LED display screen.
[0081] Please refer to Figure 8, which is a schematic diagram of the structure of the second embodiment of the terminal device provided by this application. As shown in Figure 8, the terminal device 100 includes a processor 101 and a memory 102 connected to the processor 101, wherein the memory 102 stores program data, and the processor 101 calls the program data stored in the memory 102 to execute the above-mentioned image processing method.
[0082] Optionally, in one embodiment, the processor 101 is used to execute program data to implement the following method: receiving an original image of a second terminal and first coordinate data of a first terminal, wherein the resolution of the second terminal is greater than the resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; converting the first coordinate data into a first batch of annotated images having the same resolution as the second terminal according to a resolution mapping relationship between the second terminal and the first terminal; superimposing the first batch of annotated images with the original image to obtain a target image; and sending the target image to the second terminal to display the annotated target image on the second terminal.
[0083] The processor 101 may also be referred to as a CPU (Central Processing Unit). The processor 101 may be an electronic chip having signal processing capabilities. The processor 101 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The general-purpose processor may be a microprocessor or any conventional processor.
[0084] The memory 102 can be a memory stick, a TF card, etc., and can store all the information in the terminal device 100, including the input raw data, computer programs, intermediate operation results and final operation results, which are all stored in the memory 102. It stores and retrieves information according to the location specified by the processor 101. With the memory 102, the terminal device 100 has a memory function and can ensure normal operation. The memory 102 of the terminal device 100 can be divided into main memory (internal memory) and auxiliary memory (external memory) according to its purpose. There is also a classification method of dividing it into external memory and internal memory. External memory is usually a magnetic medium or an optical disk, etc., which can store information for a long time. Memory refers to the storage component on the motherboard, which is used to store the data and programs currently being executed, but is only used to temporarily store programs and data. If the power is turned off or the power is cut off, the data will be lost.
[0085] Please refer to Figure 9, which is a schematic diagram of the structure of the third embodiment of the terminal device provided by this application. As shown in Figure 9, this application also provides another terminal device 100, which includes a receiving module 103, a mapping module 104, an overlay module 105 and a display module 106.
[0086] The receiving module 103 is used to receive the original image of the second terminal and the first coordinate data of the first terminal. The resolution of the second terminal is greater than that of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; the mapping module 104 is used to convert the first coordinate data into a first batch of annotated images with the same resolution as the second terminal according to the resolution mapping relationship between the second terminal and the first terminal; the overlay module 105 is used to overlay the first batch of annotated images with the original image to obtain a target image; the display module 106 is used to send the target image to the second terminal to display the annotated target image on the second terminal.
[0087] In one embodiment of the present application, the various modules in the terminal device 100 can be individually or all combined into one or more units to form a unit, or one (or more) of the units can be further divided into multiple functionally smaller sub-units to achieve the same operation without affecting the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In actual applications, the functions of a module can also be implemented by multiple units, or the functions of multiple modules can be implemented by one unit.
[0088] Please refer to Figure 10, which is a schematic diagram of the structure of an embodiment of a computer-readable storage medium provided by the present application. As shown in Figure 10, the computer-readable storage medium 110 stores program instructions 111 that can implement all the above methods.
[0089] If the integrated units of the functional units in the various embodiments of the present application are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium 110. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer-readable storage medium 110 includes a number of instructions in a program instruction 111 to enable a computer device (which can be a personal computer, a system server, or a network device, etc.), an electronic device (such as MP3, MP4, etc., or a mobile terminal such as a mobile phone, a tablet computer, a wearable device, or a desktop computer, etc.) or a processor to execute all or part of the steps of the methods of the various embodiments of the present application.
[0090] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-readable storage media 110 (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0091] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the embodiment of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, and the combination of the process and / or box in the flowchart and / or block diagram can be implemented by a computer-readable storage medium 110. These computer-readable storage media 110 can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the program instructions 111 executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.
[0092] These computer-readable storage media 110 may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the program instructions 111 stored in the computer-readable storage medium 110 produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0093] These computer-readable storage media 110 can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the program instructions 111 executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0094] Any process or method description in a flowchart or otherwise described herein can be understood to represent a module, segment or portion of code including one or more executable instructions for implementing a specific logical function or process step, and the scope of the preferred embodiments of the present application includes alternative implementations in which the functions may be performed in a different order than shown or discussed, including performing the functions substantially simultaneously or in a reverse order depending on the functions involved, as will be understood by those skilled in the art to which the embodiments of the present application pertain. The logic and / or steps represented in a flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical function, and can be embodied in any computer-readable medium for use by an instruction execution system, apparatus or device (which can be a personal computer, server, network device or other system that can fetch instructions from and execute instructions on an instruction execution system, apparatus or device), or in conjunction with such instruction execution system, apparatus or device.
[0095] The above is only an implementation method of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. An image processing method, It is characterized in that include: Receiving an original image of a second terminal and first coordinate data of a first terminal, wherein a resolution of the second terminal is greater than a resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; converting the first coordinate data into a first batch of injection images having the same resolution as that of the second terminal according to a resolution mapping relationship between the second terminal and the first terminal; Superimposing the first batch of injection images with the original image to obtain a target image; The target image is sent to the second terminal, so that the annotated target image is displayed on the second terminal.
2. The image processing method according to claim 1, It is characterized in that The first coordinate data corresponds to a resolution of the first terminal; and the converting the first coordinate information into a first batch of images having the same resolution as the second terminal according to a resolution mapping relationship between the second terminal and the first terminal includes: Acquire the resolution of the second terminal; Acquire second coordinate data corresponding to the first coordinate data according to a resolution mapping relationship between the second terminal and the first terminal, where the second coordinate data corresponds to the resolution of the second terminal; The first batch of injection images are generated according to the second coordinate data so that the first batch of injection images have the same resolution as that of the second terminal.
3. The image processing method according to claim 2, It is characterized in that Before receiving the original image of the second terminal and the first coordinate data of the first terminal, the image processing method further includes: Acquire a second annotated image of the first terminal, wherein the second annotated image is a binary image generated by the first terminal in response to an annotation operation; The second annotated image is identified to obtain the first coordinate data, where the first coordinate data is used to indicate an annotation position of the annotation operation.
4. The image processing method according to claim 3, It is characterized in that The resolution mapping relationship between the second terminal and the first terminal is determined by the corresponding relationship between the bit depth of the pixel points of the second annotated image and the pixel points of the original image, so that the resolution of the first annotated image is the same as that of the original image.
5. The image processing method according to claim 4, It is characterized in that The resolution of the second terminal and the first terminal is mapped by the horizontal pixel points of the original image and the vertical pixel points of the second annotated image; or, the resolution of the second terminal and the first terminal is mapped by the horizontal pixel points of the original image and the horizontal pixel points of the second annotated image.
6. The image processing method according to claim 3, It is characterized in that The second annotation image includes first channel pixels, second channel pixels and third channel pixels, and the bit depths of the first channel pixels, the second channel pixels and the third channel pixels correspond one-to-one to the pixel points of the first annotation image.
7. The image processing method according to claim 6, It is characterized in that The first channel pixel is a red channel pixel, the second channel pixel is a green channel pixel, and the third channel pixel is a blue channel pixel.
8. A terminal device, It is characterized in that It comprises a processor and a memory connected to the processor, wherein the memory stores program data, and the processor calls the program data stored in the memory to execute the image processing method according to any one of claims 1 to 7.
9. A terminal device, It is characterized in that include: a receiving module, configured to receive an original image of a second terminal and first coordinate data of a first terminal, wherein a resolution of the second terminal is greater than a resolution of the first terminal, and the first coordinate data is generated according to the resolution of the first terminal; A mapping module, configured to convert the first coordinate data into a first batch of injection images having the same resolution as that of the second terminal according to a resolution mapping relationship between the second terminal and the first terminal; A superposition module, used for superimposing the first batch of injection images with the original image to obtain a target image; The display module is used to send the target image to the second terminal, so as to display the annotated target image on the second terminal.
10. A computer-readable storage medium, It is characterized in that Program instructions are stored, and the program instructions are executed to implement the image processing method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Video signal labeling method, system and device
CN104092958A
Projection screen annotation method and system
CN107168674A
Comment display method, device and equipment and storage medium
CN108459836A
Video transmission method and device
CN109413445A
Courseware annotation method, system and device and storage medium
CN112579025A
