An image data transmission method, a sending terminal, a receiving terminal and an apparatus
By identifying the region of the target object in the image and generating additional image data to replace the color image data, the problem of network resource consumption caused by the increase in image data volume is solved, and efficient image data transmission is achieved.
Patent Information
- Application Number
- CN202210038563.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-13
- Publication Date
- 2025-12-19
- Estimated Expiration
- 2042-01-13
AI Technical Summary
When a terminal uploads image data to a cloud server, the addition of an alpha channel increases the amount of image data and consumes more network resources.
The sending terminal identifies the region containing the target object in the image, generates additional image data, replaces the color image data of the target region, and sends the replaced image data to the server. The receiving terminal extracts transparency information and color image data from the image data to generate the target image.
It reduces the consumption of network resources and improves the efficiency of image data transmission.
Smart Images

Figure CN116489365B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of data transmission, in particular to an image data transmission method, a sending terminal, a receiving terminal and an apparatus. BACKGROUND
[0002] With the development of computer technology, image processing technology is applied more and more. For example, in the scene of uploading video data to a cloud server by a terminal, after collecting the video, the terminal can perform image processing on each frame of image in the video, and upload the image data after processing to the cloud server.
[0003] In computer graphics, an RGB color model is composed of three color channels of red, green and blue, each channel occupies 8-bit color depth, a total of 24 bits, which contains all color information. In order to realize the transparency effect of graphics, another 8-bit additional information is added in the processing and storage of graphics files. This additional channel information representing the transparency of each pixel in the graphics is the Alpha channel. When the terminal uploads image data to the cloud server, since the original image data is RGB color data, after adding the Alpha channel, the image data uploaded by the terminal to the cloud server also includes additional information, which greatly increases the image data amount of a frame of image, resulting in that the terminal needs to occupy a large network resource when uploading image data to the cloud server. SUMMARY
[0004] The present application provides an image data transmission method, a sending terminal, a receiving terminal and an apparatus, which are used to reduce the network resource occupied when the terminal uploads image data to the cloud server.
[0005] In a first aspect, the present application provides an image data transmission method, comprising:
[0006] The sending terminal collects an image containing a target object;
[0007] The sending terminal identifies a region where the target object is located in the image, and generates additional image data of the image based on the identified region where the target object is located; wherein the additional image data is used to represent the transparency information of each pixel point in the image;
[0008] The sending terminal replaces the color image data of a target region of the image with the additional image data, and sends the image data of the image after replacement to a server; wherein the target region is a part of the image agreed by the sending terminal and a receiving terminal in advance, and the target object is located outside the target region.
[0009] Optionally, the sending terminal identifies a region in the image where a target object is located, generates additional image data of the image based on the identified region where the target object is located, including:
[0010] The sending terminal identifies a region in the image where a target object is located based on the trained image segmentation model.
[0011] The sending terminal determines the transparency information corresponding to each pixel point in the image according to the region in the image where the target object is located and a background region other than the region where the target object is located.
[0012] The sending terminal generates additional image data of the image according to the transparency information corresponding to each pixel point in the image.
[0013] Optionally, the color image data includes color parameters of multiple color channels.
[0014] The sending terminal replaces the color image data of the target region of the image using the additional image data, including:
[0015] The sending terminal divides the additional image data into multiple equal parts of additional image sub-data according to the number of color channels, and the sending terminal deletes the color parameters corresponding to the target region in the color parameters of each color channel; wherein the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data.
[0016] The sending terminal adds the multiple equal parts of additional image sub-data to the positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule.
[0017] In a second aspect, the embodiments of the present application provide an image data transmission method, and the method includes:
[0018] The receiving terminal obtains image data from a server.
[0019] The receiving terminal determines additional image data used to represent transparency information of each pixel point in the image from the obtained image data, and obtains color image data of other regions in the image data other than a target region.
[0020] The receiving terminal generates a target image according to the obtained color image data of the other regions and the additional image data; wherein the target region is a part of the image agreed by the sending terminal and the receiving terminal in advance.
[0021] Optionally, the color image data includes color parameters of multiple color channels.
[0022] The receiving terminal determines additional image data from the acquired image data to represent the transparency information of each pixel in the image, including:
[0023] The receiving terminal extracts additional image sub-data from the position corresponding to the target area in the color parameters of each color channel according to a preset replacement rule.
[0024] The receiving terminal will combine the extracted additional image sub-data into the additional image data;
[0025] The plurality of additional image sub-data is obtained by the sending terminal dividing the additional image data into multiple equal parts according to the number of color channels, and the plurality of additional image sub-data is added by the sending terminal to the position corresponding to the target area in the color parameters of each color channel according to the preset replacement rule.
[0026] Optionally, the receiving terminal generates a target image based on the acquired color image data of the other regions and the additional image data, including:
[0027] The receiving terminal determines the color parameters of each color channel corresponding to the other regions from the color image data of the other regions;
[0028] For any given color channel, the receiving terminal determines the color parameters of all regions corresponding to the color channel based on the color parameters of other regions corresponding to the color channel and the preset color parameters of the target region corresponding to the color channel.
[0029] The receiving terminal generates a reference image based on the color parameters of all regions corresponding to each color channel.
[0030] The receiving terminal generates a target image based on the reference image and the additional image data.
[0031] Thirdly, embodiments of this application provide a transmitting terminal, including a processor, a camera, and a transceiver unit;
[0032] The camera is used to capture images containing the target object;
[0033] The processor is configured to identify the region where a target object is located in the image, generate additional image data for the image based on the identified region where the target object is located, and replace the color image data of the target region of the image with the additional image data; wherein, the additional image data is used to represent the transparency information of each pixel in the image, and the target region is a region where the non-target object is located at a preset position agreed upon by the sending terminal and the receiving terminal;
[0034] The transceiver is configured to send the image data of the image after replacement to a server, so that a receiving terminal obtains the image data of the image from the server and performs image processing on the image according to the obtained image data.
[0035] In a fourth aspect, an embodiment of the present application provides a receiving terminal, including a processor and a transceiver.
[0036] The transceiver is configured to obtain image data of an image from a server.
[0037] The processor is configured to determine, from the obtained image data, additional image data used to represent transparency information of each pixel point in the image, and obtain color image data of other regions in the image data except a target region; generate the image according to the obtained color image data of the other regions except the target region, and perform image processing on the image according to the additional image data; wherein the target region is a region where a non-target object in a preset position agreed by the sending terminal and the receiving terminal is located.
[0038] In a fifth aspect, an embodiment of the present application provides an image data transmission device, including:
[0039] The acquisition module is configured to acquire an image containing a target object.
[0040] The identification module is configured to identify a region where the target object is located in the image, and generate additional image data of the image based on the identified region where the target object is located; wherein the additional image data is used to represent transparency information of each pixel point in the image.
[0041] The processing module is configured to replace color image data of a target region of the image with the additional image data, and send image data of the image after replacement to a server; wherein the target region is a part of the image agreed by the sending terminal and a receiving terminal in advance, and the target object is located outside the target region.
[0042] In a sixth aspect, an embodiment of the present application provides an image data transmission device, including:
[0043] The acquisition module is configured to obtain image data from a server.
[0044] The determination module is configured to determine, from the obtained image data, additional image data used to represent transparency information of each pixel point in the image, and determine color image data of other regions in the image data except a target region.
[0045] The generating module is configured to generate a target image according to the color image data of the other region and the additional image data; and the target region is a part of the image agreed by the sending terminal and the receiving terminal in advance.
[0046] In a seventh aspect, an embodiment of the present application provides a computer readable storage medium including program codes, when the program codes are run on a computer device, the program codes are used to make the computer device execute the steps of the method in any one of the first aspect or the second aspect.
[0047] Since the sending terminal in the embodiment of the present application identifies the region where the target object is located in the image after collecting the image containing the target object, generates the additional image data representing the transparency information of each pixel point in the image, replaces the color image data of the target region of the image with the additional image data before uploading the image data of the image to the server, and sends the image data of the image after the replacement to the server, the color image data of the target region in the image data uploaded to the server by the sending terminal is replaced with the additional image data, so that the total data amount of the image data uploaded to the server does not increase, thereby reducing the network resources occupied by the sending terminal when uploading the image data to the server and improving the transmission efficiency. BRIEF DESCRIPTION OF DRAWINGS
[0048] Figure 1 FIG. 1 is a structural schematic diagram of an image data transmission system according to an embodiment of the present application;
[0049] Figure 2 FIG. 3 is a structural schematic diagram of a terminal according to an embodiment of the present application;
[0050] Figure 3 FIG. 5 is a software structure block diagram of a terminal according to an embodiment of the present application;
[0051] Figure 4 FIG. 7 is a schematic diagram of a user interface of a terminal according to an embodiment of the present application;
[0052] Figure 5 FIG. 9 is a schematic diagram of an RGB image according to an embodiment of the present application;
[0053] Figure 6 FIG. 11 is a schematic diagram of an alpha channel image according to an embodiment of the present application;
[0054] Figure 7 FIG. 13 is a schematic diagram of R image, G image and B image after cropping according to an embodiment of the present application;
[0055] Figure 8 FIG. 15 is a schematic diagram of R image, G image and B image according to an embodiment of the present application;
[0056] Figure 9 A schematic diagram of an image of an alpha channel obtained by splicing of an embodiment of the present application;
[0057] Figure 10 A schematic diagram of a target image of an embodiment of the present application;
[0058] Figure 11 A flowchart of a data transmission method of an embodiment of the present application;
[0059] Figure 12 A flowchart of an image data transmission method of an embodiment of the present application;
[0060] Figure 13 A flowchart of another image data transmission method of an embodiment of the present application;
[0061] Figure 14 A structural schematic diagram of an image data transmission device of an embodiment of the present application;
[0062] Figure 15 A structural schematic diagram of another image data transmission method of an embodiment of the present application. DETAILED DESCRIPTION
[0063] In the embodiments of the present application, the term "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.
[0064] In the embodiments of the present application, the term "a plurality of" means two or more, and other quantifiers are similar.
[0065] The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.
[0066] As shown in the drawings, Figure 1 An image data transmission system of an embodiment of the present application includes a sending terminal 10, a server 11 and a receiving terminal 12;
[0067] The sending terminal 10 is configured to collect a video stream containing a target object; for any one image in the video stream, the sending terminal 10 identifies a region in the image where the target object is located, generates additional image data of the image based on the identified region where the target object is located, replaces color image data of a target region of the image with the additional image data, and sends image data of the replaced image to the server 11;
[0068] The receiving terminal 12 acquires image data of each image in the video stream from the server 11, determines additional image data for indicating transparency information of each pixel in the image from the acquired image data, and acquires color image data of other regions in the image except the target region; generates a target generated image based on the acquired color image data of other regions in the image except the target region and the additional image data.
[0069] The target region is a part of the image agreed by the sending terminal and the receiving terminal in advance, and the target object is located outside the target region.
[0070] The structure of the sending terminal and the receiving terminal in the embodiments of the present application can be as shown in Figure 2 The structure of the terminal 200 is as shown in Figure 2
[0071] The embodiments will be described below with the terminal 200 as an example. It should be understood that, Figure 2 The terminal 200 shown in is only an example, and the terminal 200 can have more or fewer components than those shown in Figure 2 The various components shown in the figure can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0072] Figure 2 The hardware configuration block diagram of the terminal 200 according to the exemplary embodiments is exemplarily shown in Figure 2 As shown in, the terminal 200 includes radio frequency (RF) circuit 210, memory 220, display unit 230, camera 240, sensor 250, audio circuit 260, Wireless Fidelity (Wi-Fi) module 270, processor 280, Bluetooth module 281, and power supply 290, etc.
[0073] The RF circuit 210 can be used for receiving and sending signals in the process of transceiving information or talking, and can receive downlink data of a base station and hand over the downlink data to the processor 280 for processing, and can send uplink data to the base station. Generally, the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like.
[0074] The memory 220 can be used to store software programs and data. The processor 280 performs various functions and data processing of the terminal 200 by running the software programs or data stored in the memory 220. The memory 220 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. The memory 220 stores an operating system that enables the terminal 200 to operate. In the present application, the memory 220 can store an operating system and various application programs, and can further store codes for executing the methods described in the embodiments of the present application.
[0075] The display unit 230 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the terminal 200. Specifically, the display unit 230 can include a touch screen 231 arranged on the front of the terminal 200, and can collect touch operations of the user on or near the touch screen 231, such as clicking buttons, dragging scroll boxes, and the like.
[0076] The display unit 230 can also be used to display information input by the user or information provided to the user, and a graphical user interface (GUI) of various menus of the terminal 200. Specifically, the display unit 230 can include a display screen 232 arranged on the front of the terminal 200. The display screen 232 can be configured in the form of a liquid crystal display, a light-emitting diode, or the like. The display unit 230 can be used to display various graphical user interfaces described in the present application.
[0077] The touch screen 231 can be overlaid on the display screen 232, or the touch screen 231 can be integrated with the display screen 232 to realize the input and output functions of the mobile terminal 200. After integration, the touch screen 231 can be referred to as a touch display screen. The display unit 230 in the present application can display application programs and corresponding operation steps.
[0078] The camera 240 can be used to capture still images or videos. An object projects an optical image through a lens to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then passed to the processor 180 to be converted into a digital image signal.
[0079] The terminal 200 can also include at least one sensor 250, such as an acceleration sensor 251, a distance sensor 252, a fingerprint sensor 253, a temperature sensor 254. The terminal 200 can also be configured with a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and other sensors.
[0080] The audio circuit 260, the speaker 261, and the microphone 262 can provide an audio interface between the user and the terminal 200. The audio circuit 260 can convert the received audio data into an electrical signal, which is transmitted to the speaker 261 and converted into a sound signal by the speaker 261. The terminal 200 can also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 262 converts the collected sound signal into an electrical signal, which is received by the audio circuit 260 and converted into audio data, which is then output to the RF circuit 210 for transmission to another terminal, for example, or to the memory 220 for further processing. In this application, the microphone 262 can obtain the user's voice.
[0081] Wi-Fi belongs to a short-range wireless transmission technology. The terminal 200 can help the user to send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 270, which provides the user with wireless broadband Internet access.
[0082] The processor 280 is the control center of the terminal 200, which connects all parts of the terminal through various interfaces and lines, and performs various functions and processes data of the terminal 200 by running or executing software programs stored in the memory 220 and calling data stored in the memory 220. In some embodiments, the processor 280 can include one or more processing units; the processor 280 can also integrate an application processor and a baseband processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the baseband processor mainly processes wireless communication. It can be understood that the above-mentioned baseband processor can also not be integrated into the processor 280. In this application, the processor 280 can run the operating system, the application program, the user interface display and the touch response, and the processing method described in the embodiments of the application. In addition, the processor 280 is coupled with the display unit 230.
[0083] Bluetooth module 281 is configured to interact with other Bluetooth devices having Bluetooth modules via Bluetooth protocol. For example, terminal 200 can establish a Bluetooth connection with a wearable electronic device (e.g., a smart watch) also having a Bluetooth module via Bluetooth module 281, and thus exchange data.
[0084] Terminal 200 also includes a power supply 290 (e.g., a battery) to supply power to the various components. The power supply can be logically connected to processor 280 via a power management system, which can enable functions such as managing charging, discharging, and power consumption. Terminal 200 can also be configured with a power button to turn the terminal on and off, and to lock the screen, etc.
[0085] Figure 3 is a software structure block diagram of terminal 200 according to an embodiment of the present application.
[0086] The layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0087] The application layer can include a series of application packages.
[0088] As shown in Figure 3 , the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
[0089] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.
[0090] As shown in Figure 3 , the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0091] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take screenshots, etc.
[0092] The content provider is used to store and obtain data, and to make the data accessible to applications. The data can include videos, images, audio, dialed and received calls, browsing history and bookmarks, phonebook, etc.
[0093] The view system includes visual controls, such as controls that display text, controls that display pictures, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon can include a view that displays text and a view that displays a picture.
[0094] The telephony manager is used to provide the communication function of the terminal 200. For example, the management of the call state (including the connection, hang-up, etc.).
[0095] The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.
[0096] The notification manager enables the application to display notification information in the status bar, which can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, the message reminder, etc. The notification manager can also be a notification that appears in the top status bar of the system in the form of a chart or a scrolling text, such as a notification of an application running in the background, and can also be a notification that appears on the screen in the form of a dialog window. For example, the text information is prompted in the status bar, the prompt sound is emitted, the terminal is vibrated, the indicator light is blinked, etc.
[0097] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0098] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
[0099] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the stack management, the thread management, the security and exception management, and the garbage collection, etc.
[0100] The system library can include multiple functional modules. For example: the surface manager, the media library, the three-dimensional graphics processing library (for example: OpenGL ES), the 2D graphics engine (for example: SGL), etc.
[0101] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
[0102] The media library supports multiple commonly used audio, video format playback and recording, and static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0103] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.
[0104] The 2D graphics engine is a drawing engine for 2D drawing.
[0105] The kernel layer is a layer between hardware and software. The kernel layer at least contains display drivers, camera drivers, audio drivers, and sensor drivers.
[0106] The following describes the working flow of the terminal 200 software and hardware in the capturing and photographing scenario.
[0107] When the touch screen 231 receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, a timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer, and identifies the control corresponding to the input event. Taking the touch operation as a touch single-click operation, and the control corresponding to the single-click operation as the control of the camera application icon as an example, the camera application calls the interface of the application framework layer, starts the camera application, and then starts the camera driver through the kernel layer, and captures a still image or a video through the camera 240.
[0108] The terminal 200 in the embodiments of the present application can be a mobile phone, a tablet computer, a wearable device, a notebook computer, a television, or the like.
[0109] Figure 4 is a schematic diagram for showing a user interface on a terminal (for example, the terminal 200 of Figure 2 In some implementations, a user can open a corresponding application by touching an application icon on the user interface, or open a corresponding folder by touching a folder icon on the user interface.
[0110] It should be noted that the target object in the embodiments of the present application is a focus object in an image that a user pays attention to, for example, the target object can be a person, an animal, a building, a plant, or the like.
[0111] The following description takes a person as an example of the target object, and the image data transmission manner when the target object is another object is the same as that when the target object is a person.
[0112] The sending terminal collects a video containing a person through a camera, and decodes the video data collected by the camera to obtain an RGB image frame.
[0113] For any one frame of image, human body detection is performed on the person in the image to determine whether the image contains a person; if the image does not contain a person, the image is discarded, and the next frame of image is obtained by continuing to collect through the camera; after it is determined that the image contains a person, it is further determined whether the person is located outside the target region in the image.
[0114] The target region is a part of the image predetermined by the sending terminal and the receiving terminal, and since the color image data of the target region needs to be cropped when uploaded to the server, it is necessary to ensure that the person is not located in the target region.
[0115] For example, the target region can be the region at both ends of the image, and it is necessary to determine whether the person is located in the middle of the image; or the target region can be the region at the left end of the image, and it is necessary to determine whether the person is located in the right region of the image.
[0116] If it is determined that the person is not located outside the target region in the image, the sending terminal adjusts the focus of the camera, adjusts the shooting angle of the camera, and collects the next frame of image until it is determined that the person is located outside the target region in the image, and it is determined that the video image meeting the requirements is collected.
[0117] After the image containing the target object is collected through the camera, the sending terminal identifies the region where the target object is located in the image based on the trained image segmentation model; determines the transparency information corresponding to each pixel point in the image according to the region where the target object is located in the image and the background region other than the region where the target object is located; and generates additional image data of the image according to the transparency information corresponding to each pixel point in the image.
[0118] Each pixel point in the image of the embodiment of the present application corresponds to color image data and additional image data;
[0119] It should be noted that the additional image data of the embodiment of the present application can be additional image data of an alpha channel;
[0120] Alpha channel (α Channel or Alpha Channel) refers to the transparency and translucency of a picture. For example, a bitmap using 32 bits to store each pixel, every 8 bits respectively represents the color parameters of R channel, the color parameters of G channel, the color parameters of B channel, and the additional image data of alpha channel. In this case, the additional image data of alpha channel is a value in the range of 0-1, and the additional image data of alpha channel can represent 256 levels of translucency, because the alpha channel has 8 bits and can have 256 different data representation possibilities.
[0121] For example, after identifying the person region and the background region of the image based on the image segmentation model, the value of the additional image data of the alpha channel of the pixel point of the person region tends to 0, and the value of the additional image data of the alpha channel of the pixel point of the background region tends to 1.
[0122] The color image data of the embodiment of the present application comprises color parameters of multiple color channels;
[0123] For example, the color channels of the embodiment of the present application comprise R channel, G channel and B channel, and the color image data comprises color parameters of R channel, color parameters of G channel and color parameters of B channel.
[0124] After generating the additional image data of the image, the additional image data is divided into multiple additional image sub-data according to the number of color channels;
[0125] For example, the resolution of the image is 1920*1080, and the additional image data is divided into six additional image sub-data, and the pixel number corresponding to each additional image sub-data is 320*1080.
[0126] The sending terminal of the embodiment of the present application replaces the color image data of the target region of the image with the additional image data;
[0127] An optional implementation is that the sending terminal divides the additional image data into multiple equal additional image sub-data according to the number of color channels; and the sending terminal deletes the color parameters corresponding to the target region in the color parameters of each color channel; wherein the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data; and the sending terminal adds the multiple equal additional image sub-data to the positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule.
[0128] It should be noted that, since the sending terminal of the embodiment of the present application replaces the color image data of the target region of the image with the additional image data, and the color image data of the target region of the image is composed of the color parameters of each color channel, and the multiple equal additional image sub-data after division needs to be added to the color parameters of each color channel uniformly, the additional image data needs to be divided uniformly according to the number of color channels;
[0129] For example, the embodiment of the present application comprises three color channels, and the additional image data needs to be divided into N additional image sub-data, and N is a multiple of 3.
[0130] When the sending terminal of the embodiment of the present application replaces the color image data, the color image data of the target region needs to be deleted first, and then the additional image data after division is added to the position of the color image data of the target region after deletion.
[0131] As shown in the resolution of the RGB image of 1920*1080, the image is segmented by using a person segmentation algorithm to obtain an alpha channel image as shown in Figure 5 Figure 6 Figure 6 The values of all pixel points in the alpha channel image shown in the image form the additional image data of the image;
[0132] The additional image data of the image is evenly divided into six parts, that is, the alpha channel image shown in Figure 6 is divided into 6 regions, that is, the size of each region is 320*1080.
[0133] The sending terminal clips the color parameters of each color channel of the collected image, and clips the color parameters corresponding to the target region in each color channel;
[0134] For example, the target region is the region at the left and right ends of the image; as shown in the resolution of the RGB image of 1920*1080, the dashed box marked is the target region set in advance in the image, and the size of the target region is 320*1080. The target region of the image is clipped; since each channel of the RGB image is taken out alone It is a gray image with the same size as the original image, and each channel gray image is represented by R, G, and B, so the target region of each channel gray image is clipped, and the clipped R, G, and B are shown in Figure 5 Figure 7
[0135] When the sending terminal replaces the color image data of the target region of the image with the additional image data, the replacement is performed according to the preset replacement rule;
[0136] For example, referring to the additional image data division mode shown in Figure 6 and the R, G, and B images after clipping shown in Figure 7 The replacement rule of the present application embodiment can be:
[0137] According to the order of the alpha channel image from left to right, the additional image sub-data of each region after division is marked as 1, 2, 3, 4, 5, and 6, respectively;
[0138] The additional image sub-data of region 1 is added to the target region clipped at the left end of the R image;
[0139] The additional image sub-data of region 2 is added to the target region clipped at the right end of the R image;
[0140] The additional image sub-data of region 3 is added to the target region clipped at the left end of the G image;
[0141] adding the additional image sub-data of region 4 to the target region cropped off at the right end of the G image;
[0142] adding the additional image sub-data of region 5 to the target region cropped off at the left end of the B image;
[0143] adding the additional image sub-data of region 6 to the target region cropped off at the right end of the B image.
[0144] The color image data of the target region of the image is replaced by the additional image data as described above, and after the replacement is completed, image data with the same size as the color image data of the original image is obtained, which includes the additional image data of the image and the color image data of other regions except the target region; the sending terminal uploads the image data obtained after the replacement to the server.
[0145] The receiving terminal of the embodiment of the present application can obtain image data from the server, determine additional image data for representing transparency information of each pixel point in the image from the obtained image data, and obtain color image data of other regions except the target region in the image data; and generate a target image according to the obtained color image data of other regions and the additional image data.
[0146] Since the image data obtained by the receiving terminal from the server is uploaded by the sending terminal, and the image data uploaded by the sending terminal to the server replaces the color image data of the target region of the image by the additional image data as described above, the image data obtained by the receiving terminal from the server includes the additional image data and the color image data of other regions except the target region.
[0147] When the receiving terminal determines the additional image data from the obtained image data, the following methods can be specifically used:
[0148] The receiving terminal extracts additional image sub-data from the positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; and the receiving terminal groups the extracted multiple additional image sub-data into additional image data.
[0149] It should be noted that the preset replacement rule is a replacement rule agreed upon by the sending terminal and the receiving terminal in advance, so that after the receiving terminal receives the image data, the image data can be accurately parsed and the additional image data of the image can be restored.
[0150] The image data received by the receiving terminal includes image data of an R channel, image data of a G channel, and image data of a B channel; and the image data of the R image, the G image, and the B image all contain additional image sub-data.
[0151] For example, as shown in the R image, the G image, the B image, and the left and right ends of each image are additional image sub-data added; Figure 8
[0152] In generating the additional image, the receiving terminal restores the additional image data according to a preset replacement rule:
[0153] The left end of the R image is cropped to a region with a size of 320x1080, numbered as region 1; similarly, the right side is also cropped to a region with a size of 320x1080, numbered as region 2;
[0154] The left end of the G image is cropped to a region with a size of 320x1080, numbered as region 3; similarly, the right side is also cropped to a region with a size of 320x1080, numbered as region 4;
[0155] The left end of the B image is cropped to a region with a size of 320x1080, numbered as region 5; similarly, the right side is also cropped to a region with a size of 320x1080, numbered as region 6;
[0156] Finally, the images in the alpha channel with a size of 1920x1080 are obtained by splicing in the order of the numbers, and the spliced image in the alpha channel is as shown in Figure 9
[0157] It should be noted that the pixel values of the image in the alpha channel obtained by splicing in the embodiments of the present application form the additional image data; after the images in each color channel are cropped, the data of each pixel point in the retained region is the color image data of other regions.
[0158] After the additional image data and the color image data of other regions are determined from the obtained image data, the present application generates a target image;
[0159] In the implementation, the receiving terminal determines the color parameters of other regions corresponding to each color channel from the color image data of other regions; for any one color channel, the receiving terminal determines the color parameters of all regions corresponding to the color channel according to the color parameters of other regions corresponding to the color channel and the preset color parameters of the target region corresponding to the color channel; the receiving terminal generates a reference image according to the color parameters of all regions corresponding to each color channel; and generates a target image according to the reference image and the additional image data.
[0160] Since the image data obtained by the receiving terminal from the server only contains color image data of other regions, the receiving terminal needs to determine color image data of the target region when restoring the image; the embodiment of the application pre-sets preset color parameters of the target region corresponding to each color channel in the receiving terminal, so that the receiving terminal can generate a complete reference image according to the color image data of other regions obtained from the server and the preset color parameters of the target region corresponding to each color channel.
[0161] In implementation, the receiving terminal can first generate an image corresponding to each color channel, and then superimposes the images corresponding to each color channel to obtain a complete reference image.
[0162] In implementation, the receiving terminal can first generate an image corresponding to each color channel, and then superimposes the images corresponding to each color channel to obtain a complete reference image.
[0163] The reference image generated by the receiving terminal of the embodiment of the application can be an RGB image.
[0164] In addition, the receiving terminal of the embodiment of the application generates a target image according to the reference image and additional image data after generating the reference image.
[0165] In implementation, the receiving terminal generates an image of an alpha channel according to the parsed additional image data, superimposes the image of the alpha channel and the reference image to generate a target image.
[0166] For example, as shown in FIG. 4, the reference image A and the image B of the alpha channel are superimposed to obtain the target image C. Figure 10
[0167] After generating the target image, the receiving terminal of the embodiment of the application can process the target image based on the additional image data corresponding to the target image.
[0168] For example, since the additional image data is used to represent transparency information of each pixel point in the target image, the additional image data can be used to distinguish the person and the background in the target image, and the receiving terminal can flexibly replace the background region of the target image based on the additional image data.
[0169] It should be noted that the way in which the receiving terminal replaces the background region of the target image according to the additional image data is one of the processing manners in which the receiving terminal processes the target image according to the additional image data, and the way in which the receiving terminal processes the target image according to the additional image data is not limited to the above example.
[0170] As shown in FIG. 5, the receiving terminal can replace the background region of the target image according to the additional image data. Figure 11 As shown, the image data transmission method flowchart of the embodiment of the present application includes the following steps:
[0171] Step S1101, the sending terminal collects an image containing a target object;
[0172] Step S1102, the sending terminal identifies a region where the target object is located in the image based on the trained image segmentation model;
[0173] Step S1103, the sending terminal determines the transparency information corresponding to each pixel point in the image according to the region where the target object is located in the image and the background region other than the region where the target object is located;
[0174] Step S1104, the sending terminal generates additional image data of the image according to the transparency information corresponding to each pixel point in the image;
[0175] Step S1105, the sending terminal divides the additional image data into multiple equal parts of additional image sub-data according to the number of color channels, and the sending terminal deletes the color parameters corresponding to the target region in the color parameters of each color channel;
[0176] The data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data;
[0177] Step S1106, the sending terminal adds the multiple equal parts of additional image sub-data to the positions corresponding to the target region in the color parameters of each color channel respectively according to the preset replacement rule;
[0178] Step S1107, the sending terminal sends the image data of the image after replacement to the server;
[0179] Step S1108, the receiving terminal acquires the image data from the server;
[0180] Step S1109, the receiving terminal extracts the additional image sub-data from the positions corresponding to the target region in the color parameters of each color channel respectively according to the preset replacement rule;
[0181] Step S1110, the receiving terminal assembles the multiple extracted additional image sub-data into additional image data;
[0182] The multiple additional image sub-data are obtained by the sending terminal dividing the additional image data into multiple equal parts according to the number of color channels, and the multiple additional image sub-data are added to the positions corresponding to the target region in the color parameters of each color channel respectively by the sending terminal according to the preset replacement rule;
[0183] Step S1111, the receiving terminal determines the color parameters of other regions corresponding to each color channel from the color image data of other regions;
[0184] Step S1112, for any one color channel, the receiving terminal determines the color parameters of all regions corresponding to the color channel according to the color parameters of other regions corresponding to the color channel and the preset color parameters of the target region corresponding to the color channel;
[0185] Step S1113, the receiving terminal generates a reference image according to the color parameters of all regions corresponding to each color channel;
[0186] Step S1114, the receiving terminal generates a target image according to the reference image and the additional image data.
[0187] As shown in the image data transmission method of the embodiments of the present application, applied to the sending terminal side, comprising the following steps: Figure 12
[0188] Step S1201, the sending terminal collects an image containing a target object;
[0189] Step S1202, the sending terminal identifies the region where the target object is located in the image, and generates additional image data of the image based on the identified region where the target object is located; wherein the additional image data is used to represent the transparency information of each pixel point in the image;
[0190] Step S1203, the sending terminal replaces the color image data of the target region of the image with the additional image data, and sends the image data of the image after replacement to the server; wherein the target region is a part of the image agreed by the sending terminal and the receiving terminal in advance, and the target object is located outside the target region.
[0191] Optionally, the sending terminal identifies the region where the target object is located in the image, and generates additional image data of the image based on the identified region where the target object is located, comprising:
[0192] The sending terminal identifies the region where the target object is located in the image based on the trained image segmentation model;
[0193] The sending terminal determines the transparency information corresponding to each pixel point in the image according to the region where the target object is located in the image and the background region other than the region where the target object is located;
[0194] The sending terminal generates additional image data of the image according to the transparency information corresponding to each pixel point in the image.
[0195] Optionally, the color image data comprises color parameters of multiple color channels.
[0196] The sending terminal replaces the color image data of the target region of the image with the additional image data, comprising:
[0197] The sending terminal divides the additional image data into multiple equal parts of additional image sub-data according to the number of color channels; and the sending terminal deletes the color parameters corresponding to the target region in the color parameters of each color channel; wherein the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data.
[0198] The sending terminal adds the multiple equal parts of additional image sub-data to the positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule.
[0199] As shown in the image data transmission method of the embodiments of the present application, applied to the receiving terminal side, comprising the following steps: Figure 13
[0200] Step S1301, the receiving terminal acquires image data from a server;
[0201] Step S1302, the receiving terminal determines additional image data for indicating transparency information of each pixel point in the image from the acquired image data, and acquires color image data of other regions except the target region in the image data;
[0202] Step S1303, the receiving terminal generates a target image according to the acquired color image data of the other regions and the additional image data; wherein the target region is a part of the image agreed by the sending terminal and the receiving terminal in advance.
[0203] Optionally, the color image data comprises color parameters of multiple color channels.
[0204] The receiving terminal determines additional image data for indicating transparency information of each pixel point in the image from the acquired image data, comprising:
[0205] The receiving terminal extracts additional image sub-data from the positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule;
[0206] The receiving terminal assembles the extracted multiple additional image sub-data into the additional image data;
[0207] The multiple additional image sub-data are obtained by dividing the additional image data into multiple equal parts according to the number of the color channels, and the multiple additional image sub-data are added to positions corresponding to the target region in the color parameters of each color channel according to the preset replacement rule.
[0208] Optionally, the receiving terminal generates a target image according to the color image data of the other region and the additional image data, including:
[0209] The receiving terminal determines the color parameters of the other region corresponding to each color channel from the color image data of the other region.
[0210] For any one color channel, the receiving terminal determines the color parameters of the entire region corresponding to the color channel according to the color parameters of the other region corresponding to the color channel and the preset color parameters of the target region corresponding to the color channel.
[0211] The receiving terminal generates a reference image according to the color parameters of the entire region corresponding to each color channel.
[0212] The receiving terminal generates a target image according to the reference image and the additional image data.
[0213] In addition, based on the same inventive concept, the present application also provides a sending terminal, the structure of the sending terminal can be as shown in Figure 2
[0214] The camera 240 is configured to collect an image containing a target object.
[0215] The processor 280 is configured to identify a region where the target object is located in the image, generate additional image data of the image based on the identified region where the target object is located, and replace color image data of a target region of the image with the additional image data. The additional image data is used to represent transparency information of each pixel point in the image, and the target region is a region where the target object is not located in a preset position agreed by the sending terminal and the receiving terminal.
[0216] The transceiver is configured to send image data of the image after replacement to a server, so that the receiving terminal obtains the image data of the image from the server and performs image processing on the image according to the obtained image data.
[0217] It should be noted that the transceiver of the embodiment of the present application can include at least one of the RF circuit 210 and the Wi-Fi module 270.
[0218] Optionally, the processor 280 is specifically configured to:
[0219] identify a region where the target object is located in the image based on the trained image segmentation model;
[0220] determine transparency information corresponding to each pixel point in the image according to the region where the target object is located in the image and a background region other than the region where the target object is located;
[0221] generate additional image data of the image according to the transparency information corresponding to each pixel point in the image.
[0222] Optionally, the color image data includes color parameters of multiple color channels.
[0223] The processor 280 is specifically configured to:
[0224] divide the additional image data into multiple equal additional image sub-data according to the number of color channels, and the sending terminal deletes color parameters corresponding to the target region in the color parameters of each color channel; wherein the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data.
[0225] According to a preset replacement rule, the multiple equal additional image sub-data are added to positions corresponding to the target region in the color parameters of each color channel.
[0226] In addition, based on the same inventive concept, the application also provides a receiving terminal, the structure of the receiving terminal can be as shown in Figure 2 ;
[0227] The transceiver unit is configured to obtain image data of an image from a server.
[0228] The processor 280 is configured to determine additional image data for representing transparency information of each pixel point in the image from the obtained image data, and obtain color image data of other regions in the image data except a target region; generate the image according to the obtained color image data of other regions except the target region, and perform image processing on the image according to the additional image data; wherein the target region is a region where a non-target object is located in a preset position agreed by the sending terminal and the receiving terminal.
[0229] It should be noted that the transceiver unit of the embodiment of the application can include at least one of the RF circuit 210 and the Wi-Fi module 270.
[0230] Optionally, the color image data includes color parameters of multiple color channels.
[0231] The processor 280 is specifically configured to:
[0232] extract, according to a preset replacement rule, additional image sub-data from a position corresponding to the target region in the color parameters of each color channel;
[0233] compose the extracted multiple additional image sub-data into the additional image data;
[0234] The multiple additional image sub-data are obtained by dividing the additional image data into multiple equal parts according to the number of the color channels, and the multiple additional image sub-data are added to the positions corresponding to the target region in the color parameters of each color channel according to the preset replacement rule.
[0235] Optionally, the processor 280 is specifically configured to:
[0236] determine color parameters of other regions corresponding to each color channel from the color image data of the other regions;
[0237] for any one color channel, determine color parameters of all regions corresponding to the color channel according to the color parameters of other regions corresponding to the color channel and the preset color parameters of the target region corresponding to the color channel;
[0238] generate a reference image according to the color parameters of all regions corresponding to each color channel;
[0239] generate a target image according to the reference image and the additional image data.
[0240] As shown in Figure 14 The embodiment of the present application provides an image data transmission device, which comprises:
[0241] An acquisition module 1401 is configured to acquire an image containing a target object;
[0242] An identification module 1402 is configured to identify a region where the target object is located in the image, and generate additional image data of the image based on the identified region where the target object is located; wherein the additional image data is used to represent transparency information of each pixel point in the image;
[0243] A processing module 1403 is configured to replace color image data of a target region of the image with the additional image data, and send image data of the image after replacement to a server; wherein the target region is a part of the image agreed by a sending terminal and a receiving terminal in advance, and the target object is located outside the target region.
[0244] Optionally, the identification module 1402 is specifically configured to:
[0245] identify a region in which a target object in the image is located based on the trained image segmentation model;
[0246] determine transparency information corresponding to each pixel point in the image according to the region in which the target object in the image is located and a background region other than the region in which the target object is located;
[0247] generate additional image data of the image according to the transparency information corresponding to each pixel point in the image.
[0248] Optionally, the color image data includes color parameters of multiple color channels.
[0249] The processing module 1403 is specifically configured to:
[0250] divide the additional image data into multiple equal parts of additional image sub-data according to the number of the color channels; and the sending terminal deletes color parameters corresponding to the target region in the color parameters of each color channel; wherein a data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than a data amount of the additional image sub-data.
[0251] add the multiple equal parts of additional image sub-data to positions corresponding to the target region in the color parameters of each color channel respectively according to a preset replacement rule.
[0252] As shown in Figure 15 , another image data transmission apparatus is provided in an embodiment of the present application, which includes:
[0253] An acquisition module 1501 is configured to acquire image data from a server.
[0254] A determination module 1502 is configured to determine, from the acquired image data, additional image data used to represent transparency information of each pixel point in an image, and color image data of other regions in the image data other than a target region.
[0255] A generation module 1503 is configured to generate a target image according to the acquired color image data of the other regions and the additional image data; wherein the target region is a part of the image agreed upon in advance by a sending terminal and the receiving terminal.
[0256] Optionally, the color image data includes color parameters of multiple color channels.
[0257] The determination module 1502 is specifically configured to:
[0258] According to the preset replacement rule, additional image sub-data is extracted from a position corresponding to the target region in the color parameter of each color channel;
[0259] The extracted multiple additional image sub-data is combined into the additional image data;
[0260] The multiple additional image sub-data is obtained by dividing the additional image data into multiple equal parts according to the number of color channels, and the multiple additional image sub-data is added to the position corresponding to the target region in the color parameter of each color channel according to the preset replacement rule.
[0261] Optionally, the generation module 1503 is specifically configured to:
[0262] determine the color parameter of the other region corresponding to each color channel from the color image data of the other region;
[0263] for any one color channel, determine the color parameter of the entire region corresponding to the color channel according to the color parameter of the other region corresponding to the color channel and the preset color parameter of the target region corresponding to the color channel;
[0264] generate a reference image according to the color parameter of the entire region corresponding to each color channel;
[0265] generate a target image according to the reference image and the additional image data.
[0266] The embodiment of the present application also provides a computer readable storage medium, and the computer storage medium stores computer executable instructions, and the computer program is executed by a processor and can be used to implement the image data transmission method described in any embodiment of the present application.
[0267] In some possible implementation manners, each aspect of the image data transmission method provided by the present application can also be implemented in the form of a program product, which includes program codes, and when the program product is run on a computer device, the program codes are used to make the computer device execute the steps of the image data transmission method according to various exemplary embodiments of the present application described above in the specification, for example, the computer device can execute the flow of the image data transmission method as shown in Figure 12 , or the computer device can execute the flow of the image data transmission method as shown in Figure 13 .
[0268] Those skilled in the art will appreciate that embodiments of the present application can be devised for a variety of other systems which are currently developed or later developed. Therefore, the present application is intended to cover all such modifications and variations of this application that are within the scope of the appended claims and their equivalents. It is intended that each element of claim 1 and 2 is independent of one another. No element of claim 1 and 2, or any other claim, is implied to depend on any other element or limitation of claim 1 and 2 or any other claim except where expressly recited in that claim.
[0269] The present application is described in reference to the flowchart and / or block diagrams of the method, apparatus (system) and computer program product according to this application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram.
[0270] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram.
[0271] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram. Figure 1 one or more functions specified by one or more of the blocks in the flowchart and / or block diagram.
[0272] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.
Claims
1. An image data transmission method characterized by, The method comprises: The sending terminal collects an image containing a target object; The sending terminal identifies a region in the image where the target object is located, and generates additional image data of the image based on the identified region where the target object is located after determining that the target object is located outside a target region in the image; wherein the target region is a partial region in the image agreed upon in advance by the sending terminal and a receiving terminal, and the additional image data is used to represent transparency information of each pixel point in the image; The sending terminal divides the additional image data into multiple equal parts of additional image sub-data according to the number of color channels; and the sending terminal deletes color parameters corresponding to the target region in the color parameters of each color channel; wherein the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data; The sending terminal adds the multiple equal parts of additional image sub-data to positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; The image data of the image after replacement is sent to a server.
2. The method of claim 1, wherein, The sending terminal identifies a region in the image where the target object is located, and generates additional image data of the image based on the identified region where the target object is located, comprising: The sending terminal identifies a region in the image where the target object is located based on a trained image segmentation model; The sending terminal determines the transparency information corresponding to each pixel point in the image according to the region in the image where the target object is located and the background region other than the region where the target object is located; The sending terminal generates additional image data of the image according to the transparency information corresponding to each pixel point in the image.
3. An image data transmission method characterized by, The method comprises: The receiving terminal obtains image data from a server; The receiving terminal extracts additional image sub-data from positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; The receiving terminal assembles the multiple extracted additional image sub-data into the additional image data, and obtains color image data of other regions in the image data other than the target region; wherein the multiple additional image sub-data are obtained by the sending terminal by dividing the additional image data into multiple equal parts according to the number of color channels, and the multiple additional image sub-data are added by the sending terminal to positions corresponding to the target region in the color parameters of each color channel according to the preset replacement rule, and the target region is a partial region in the image agreed upon in advance by the sending terminal and the receiving terminal; The receiving terminal generates a target image according to the obtained color image data of the other regions and the additional image data; wherein the color image data comprises color parameters of multiple color channels.
4. The method of claim 3, wherein, The receiving terminal generates a target image according to the obtained color image data of the other regions and the additional image data, comprising: The receiving terminal determines other-region color parameters corresponding to each color channel from the color image data of the other region; For any one color channel, the receiving terminal determines all-region color parameters corresponding to the color channel according to the other-region color parameters corresponding to the color channel and preset color parameters of a target region corresponding to the color channel; The receiving terminal generates a reference image according to the all-region color parameters corresponding to each color channel; The receiving terminal generates a target image according to the reference image and the additional image data.
5. A transmitting terminal, characterized by comprising: The apparatus comprises a processor, a camera, and a transceiver unit; The camera is configured to capture an image containing a target object; The processor is configured to identify a region where the target object is located in the image, generate additional image data of the image based on the identified region where the target object is located after determining that the target object is located outside a target region in the image, divide the additional image data into multiple equal parts of additional image sub-data according to a number of color channels, and delete color parameters corresponding to the target region in color parameters of each color channel; wherein a data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than a data amount of the additional image sub-data; and add the multiple equal parts of additional image sub-data to positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; wherein the additional image data is used to represent transparency information of each pixel point in the image, and the target region is a region where a non-target object is located in a preset position agreed by the sending terminal and the receiving terminal; The transceiver unit is configured to send image data of the image after replacement to a server, so that the receiving terminal obtains the image data of the image from the server and performs image processing on the image according to the obtained image data.
6. A receiving terminal, characterized by The apparatus comprises a processor and a transceiver unit; The transceiver unit is configured to obtain image data of an image from a server; The processor is configured to extract additional image sub-data from positions corresponding to the target region in color parameters of each color channel according to a preset replacement rule, to group the extracted additional image sub-data into the additional image data, to obtain color image data of other regions except the target region in the image data, to generate the image according to the obtained color image data of other regions except the target region, and to perform image processing on the image according to the additional image data; the target region is a region where a non-target object located in a preset position agreed by a sending terminal and a receiving terminal, the additional image data is divided into multiple equal parts by the sending terminal according to the number of color channels, the additional image sub-data is added to positions corresponding to the target region in the color parameters of each color channel by the sending terminal according to the preset replacement rule, the target region is a partial region in the image agreed by the sending terminal and the receiving terminal in advance, and the color image data includes color parameters of multiple color channels.
7. An image data transmission apparatus characterized by comprising: The method comprises the following steps: The acquisition module is configured to acquire an image containing a target object; The identification module is configured to identify a region where the target object is located in the image, and to generate additional image data of the image based on the identified region where the target object is located after determining that the target object is located outside a target region in the image; the target region is a partial region in the image agreed by a sending terminal and a receiving terminal in advance, and the additional image data is used to represent transparency information of each pixel point in the image; The processing module is configured to divide the additional image data into multiple equal parts of additional image sub-data according to the number of color channels, and to delete color parameters corresponding to the target region in color parameters of each color channel; the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data; the multiple equal parts of additional image sub-data are added to positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; and image data of the image after replacement is sent to a server.
8. An image data transmission apparatus characterized by comprising: The method comprises the following steps: The acquisition module is configured to acquire an image containing a target object; The identification module is configured to identify a region where the target object is located in the image, and to generate additional image data of the image based on the identified region where the target object is located after determining that the target object is located outside a target region in the image; the target region is a partial region in the image agreed by a sending terminal and a receiving terminal in advance, and the additional image data is used to represent transparency information of each pixel point in the image; The processing module is configured to divide the additional image data into multiple equal parts of additional image sub-data according to the number of color channels, and to delete color parameters corresponding to the target region in color parameters of each color channel; the data amount of the color parameters corresponding to the target region in the color parameters of each color channel is not less than the data amount of the additional image sub-data; the multiple equal parts of additional image sub-data are added to positions corresponding to the target region in the color parameters of each color channel according to a preset replacement rule; and image data of the image after replacement is sent to a server. The method comprises the following steps: The acquisition module is configured to acquire an image containing a target object; The determining module is configured to extract additional image sub-data from positions corresponding to the target region in color parameters of each color channel according to a preset replacement rule; group the extracted additional image sub-data to form the additional image data, and determine color image data of other regions except the target region in the image data; wherein the additional image sub-data is obtained by dividing the additional image data into multiple equal parts according to the number of color channels by the sending terminal, and the additional image sub-data is added to the positions corresponding to the target region in the color parameters of each color channel by the sending terminal according to the preset replacement rule. The generating module is configured to generate a target image according to the obtained color image data of the other regions and the additional image data; wherein the color image data includes color parameters of multiple color channels.
Citation Information
Patent Citations
Method and apparatus for using image as a means of storing and moving supplementary data
KR1020150051509A