Video transmission method, device, terminal and storage medium

Through the pixel information processing and conversion of the first image frame of the transmission video, the problem of video transmission dependencies in the cloud computer mode rely on network rates, and achieves more efficient video transmission and lower costs.

CN115942002BActive Publication Date: 2025-01-28BEIJING SIFANG TONGDA TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202211566251.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-07
Publication Date
2025-01-28
Estimated Expiration
2042-12-07

AI Technical Summary

Technical Problem

The existing cloud computer model relies too much on the network transmission rate, resulting in untimely video transmission, especially when the network speed is slow, it may cause video stuttering and affect user experience.

Method used

By obtaining the first pixel information of the first image frame to be transmitted, based on the preset color range and/or pixel size, the first pixel information is processed, the feature pixel information of the image frame to be displayed, and the conversion will be converted In order to suitable for the second pixel information of the device, reduce the amount of data and improve transmission efficiency.

Benefits of technology

While ensuring the display effect, the data transmission volume is reduced, the transmission efficiency between the devices is improved, the configuration requirements for the device to be displayed, and the cost is reduced, and the traffic cost is saved when using the paid network transmission video.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115942002B_ABST
    Figure CN115942002B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a video transmission method, device, terminal and storage medium. The video transmission method includes: obtaining first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted; based on a preset color range and / or pixel size, the first pixel information is processed to obtain second pixel information of the image frame to be displayed; the second pixel information is sent to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information. The video transmission method provided in the embodiments of the present application can reduce the amount of transmitted data and improve the transmission efficiency between the cloud computer and the terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of information transmission, and in particular to a video transmission method, device, terminal and storage medium. Background Art

[0002] With the rapid development of network technology, the network transmission rate is sufficient to support the real-time transmission of data between cloud computers and terminals. By installing high-end processors and high-end graphics cards on cloud computers, large-scale computing tasks can be completed and the display results can be transmitted to the terminal through the network. In addition, the transmission of control signals between cloud computers and terminals enables low-configuration terminals to "process" large-scale computing tasks.

[0003] In addition, in this mode, the user's data is stored on the server, so it can prevent data loss due to terminal failure and improve data security. And the low-configuration terminal also meets people's requirements for thinness and portability. For various reasons, the use of cloud computers is becoming more and more popular.

[0004] Whether the terminal can display the display results of the cloud computer in time determines whether the cloud computer model is successful and also determines the user experience. The current cloud computer model is too dependent on network transmission speed. Summary of the invention

[0005] In view of the above problems, the embodiments of the present application provide a video transmission method, apparatus, terminal and storage medium, which can reduce the amount of transmitted data and thus improve the transmission efficiency between devices.

[0006] In a first aspect, an embodiment of the present application provides a video transmission method, the method comprising:

[0007] Acquire first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted;

[0008] Based on a preset color range and / or pixel size, the first pixel information is processed to obtain second pixel information of the image frame to be displayed; the second pixel information is data information after pixel conversion of the first pixel information;

[0009] The second pixel information is sent to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information.

[0010] In a possible implementation, processing the first pixel information to obtain the second pixel information of the image frame to be displayed includes:

[0011] Obtaining a display size of a device to be displayed and a first pixel size in first pixel information of a first image frame;

[0012] determining a pixel conversion ratio according to the first pixel size and the display size;

[0013] The first pixel size is converted according to the pixel conversion ratio to obtain a second pixel size of the image frame to be displayed, and the second pixel size is determined as the second pixel information.

[0014] In a possible implementation, processing the first pixel information to obtain the second pixel information of the image frame to be displayed includes:

[0015] Acquire a second image frame adjacent to the first image frame;

[0016] Obtaining difference pixel information according to first pixel information of the first image frame and third pixel information of the second image frame;

[0017] The first pixel information is processed according to the difference pixel information to obtain second pixel information of the image frame to be displayed.

[0018] In a possible implementation, processing the first pixel information to obtain the second pixel information of the image frame to be displayed includes:

[0019] According to a preset color range and a first color value in the first pixel information, the first image frame is divided into a plurality of regions; the first color value in the first pixel information of each region satisfies the same color range; the preset color range includes at least two color ranges;

[0020] Determine a corresponding second color value for each region respectively;

[0021] The second color value corresponding to each area is determined as the second pixel information of the image frame to be displayed.

[0022] In a possible implementation manner, determining the corresponding second color value for each region includes:

[0023] Obtaining a first color value corresponding to each pixel in the area;

[0024] Counting the number of pixels with the same first color value;

[0025] Determine the first color value with the largest number of pixels as the second color value of the region;

[0026] Alternatively, a color average value of the region is determined according to the first color value corresponding to each pixel in the region, and the color average value is determined as the second color value corresponding to the region.

[0027] In a possible implementation, after dividing the first image frame into a plurality of regions and before determining the corresponding second color value for each region, the method includes:

[0028] When the region includes a row or a column of pixels, the coordinate value of the starting position and the coordinate value of the ending position of the row or column are determined as the first coordinate information of the region;

[0029] When the region includes multiple rows or columns of pixels, the vertex coordinate values ​​of the region are determined as the second coordinate information of the region;

[0030] Determining the second color value corresponding to each area as the second pixel information of the image frame to be displayed includes:

[0031] The first coordinate information and / or the second coordinate information, and the second color value corresponding to each area are determined as the second pixel information of the image frame to be displayed.

[0032] In a possible implementation manner, the preset color range includes at least one of a preset grayscale range, a preset brightness range, and a preset color range.

[0033] In a second aspect, an embodiment of the present application provides a video transmission device, including:

[0034] An acquisition module, used for acquiring first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted;

[0035] A processing module, used for processing the first pixel information based on a preset color range and / or pixel size to obtain second pixel information of the image frame to be displayed;

[0036] The sending module is used to send the second pixel information to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information.

[0037] In a third aspect, an embodiment of the present application provides a terminal, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the steps of the video transmission method as described in any one of the first aspects are implemented.

[0038] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the video transmission method as described in any one of the first aspects are implemented.

[0039] The video transmission method, device, terminal and storage medium provided in the embodiments of the present application obtain the first pixel information of the first image frame of the video to be transmitted, adaptively adjust the first pixel information based on a preset color range, extract the characteristic pixel information of the image frame to be displayed, and convert the first pixel information into second pixel information adapted to the device to be displayed, thereby reducing the data transmission amount while ensuring the display effect, so that the second pixel information can be transmitted to the device to be displayed more quickly, so that the device to be displayed can display the image frame to be displayed in time, so that the video to be transmitted can be displayed in time, so that when the network speed is good, the scene currently captured by the on-site camera device can be displayed in real time on the device to be displayed, or when the network speed is slow, it can avoid untimely transmission due to excessive data volume, causing the video to be transmitted displayed by the device to be displayed to be stuck, and the processing step of the first image frame of the video to be transmitted is placed before sending it to the device to be displayed, which can reduce the dependence on network speed while reducing the configuration requirements of the device to be displayed, thereby reducing costs, and can further save traffic costs when using a paid network to transmit videos.

[0040] The above description is only an overview of the technical solution of the embodiment of the present application. In order to more clearly understand the technical means of the embodiment of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions of the embodiments of the present application, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 It is a schematic diagram of an application scenario provided in an embodiment of the present application.

[0043] Figure 2 It is a flowchart of a video transmission method provided in an embodiment of the present application.

[0044] Figure 3 These are two schematic diagrams of display effects provided in the embodiments of the present application.

[0045] Figure 4 This is a schematic diagram of the effect of pixel conversion provided in an embodiment of the present application.

[0046] Figure 5 It is a schematic diagram of a first image frame provided in an embodiment of the present application.

[0047] Figure 6It is a schematic diagram of a second image frame provided in an embodiment of the present application.

[0048] Figure 7 This is a pixel partitioning schematic diagram provided in an embodiment of the present application.

[0049] Figure 8 This embodiment of the present application provides a method for Figure 7 Schematic diagram of 16-segment color pixel partitioning.

[0050] Fig. 9 The corresponding embodiment of the present application provides Figure 8 A schematic diagram of a recording method.

[0051] Fig.10 It is a structural schematic diagram of a video transmission device provided in an embodiment of the present application.

[0052] Fig.11 It is a structural diagram of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field to which this application belongs; the terms used in the specification of the application are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification, claims and drawings of this application are intended to cover non-exclusive inclusions.

[0055] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase "embodiments" in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0056] The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists, A and B exist at the same time, and B exists. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0057] In addition, the terms "first", "second", etc. in the specification and claims of this application or the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order, and may explicitly or implicitly include one or more of the features.

[0058] In the description of the present application, unless otherwise specified, "plurality" means more than two (including two), and similarly, "multiple groups" means more than two groups (including two).

[0059] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense. For example, the "connection" or "connection" of a mechanical structure may refer to a physical connection. For example, the physical connection may be a fixed connection, such as a fixed connection through a fixing member, such as a fixed connection through a screw, bolt or other fixing member; the physical connection may also be a detachable connection, such as a mutual snap connection or snap connection; the physical connection may also be an integral connection, such as welding, bonding or integral molding to form a connection for connection. The "connection" or "connection" of a circuit structure may refer to an electrical connection or a signal connection in addition to a physical connection. For example, it may be a direct connection, that is, a physical connection, or it may be an indirect connection through at least one intermediate element, as long as the circuit is connected, or it may be the internal connection of two elements; the signal connection may refer to a signal connection through a media medium, such as a radio wave, in addition to a signal connection through a circuit. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0060] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0061] The video transmission method provided in the embodiment of the present application can be used for video transmission between two devices. Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1As shown, at the scene of emergency rescue, multiple trapped persons 200 are pressed under the ruins 100 and cannot escape from the disaster site by themselves. Rescue personnel are needed to find them and help them escape from the squeezing of the ruins 100. Therefore, near the ruins 100 at the scene, at least one camera device 0 is set to shoot the scene, and the video shot by the camera device 0 needs to be presented on a device with a display screen for human eye observation, so as to timely find the trapped persons or environmental changes. In some cases, it is necessary for the on-site personnel and the rear personnel who have not arrived at the scene to monitor the on-site danger together, and timely find the trapped persons who need to be rescued from the video, or find the possible next wave of danger, such as aftershocks. Therefore, the video of the scene shot by the camera can be transmitted to the on-site device for viewing by the on-site personnel, or can be transmitted to the rear device for viewing by the rear personnel, or can be transmitted to the on-site device and the rear device at the same time, or can be transmitted to the on-site device and then transmitted to the rear device by the on-site device.

[0062] For example, a video transmission system can be used to transmit the situation on site to the work place of the rear personnel. Figure 1 As shown, the video transmission system may include at least one camera device 0, at least one terminal 1, a network 2 and a device to be displayed 3. Among them, the terminal 1 is used to receive and process the target video captured by the camera device 0, the device to be displayed 3 is used to display the image frame to be displayed according to the second pixel information transmitted by the terminal to the device to be displayed, and the network 2 is used to provide a medium for the communication link between the terminal 1 and the device to be displayed 3. The network 2 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc. The terminal 1 interacts with the device to be displayed 3 through the network 2 to receive or send data or information, etc.

[0063] The network 2 includes, but is not limited to, the Internet, a mobile communication network, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless ad hoc network, etc. For example, the mobile communication network may be a 3G, 4G or 5G mobile communication system, for example, the mobile communication network may be a wideband code division multiple access (WCDMA) system, a frequency division multiple access (FDMA) system, an orthogonal frequency division multiple access (OFDMA) system, a single carrier FDMA (SC-FDMA) system, a general packet radio service (GPRS) system, a long term evolution (LTE) system or a 5G mobile communication network, and other such communication systems.

[0064] It is understandable that the scope of the scene can be large or small, and the camera needs to shoot multiple corners of the scene to prevent omissions. Therefore, the camera device 0 in the video transmission system may include multiple cameras, and the multiple cameras shoot the scene together. During the shooting process, the camera may be mobile or fixed in multiple positions. Optionally, the device to be displayed 3 may include multiple displays, one display presents the video of a camera, and observes the part of the scene shot by a camera alone; the device to be displayed 3 may also be a display of a larger size, and multiple videos are presented on one display together, and the entire scene composed of multiple videos is observed. The data volume of the video file shot by the camera is large. When transmitting between two devices, if the network transmission speed is low, it will cause a long transmission time. However, in some areas, such as the scene of emergency rescue, after a natural disaster or man-made disaster, the local base station may have been paralyzed, and it is difficult to provide a high-speed data transmission environment, resulting in a long video transmission time and untimely information transmission, so that the rear rescue personnel are difficult to find the required information from the video in time, and in severe cases, the danger is missed, resulting in irreversible consequences.

[0065] Therefore, being able to timely transmit the on-site video to the rear device is an important technology to further ensure the rescue effect. The video transmission method provided in the embodiment of the present application can reduce the amount of video data, thereby reducing the amount of data transmitted between two devices and improving the transmission efficiency between the two devices.

[0066] Optional, in Figure 1 In the application scenario shown, network 2 can be a communication network composed of a backpack base station, a satellite and an operator base station, wherein the backpack base station is a small base station that can establish a communication connection with a satellite and establish a communication cell at the rescue site. On the basis of establishing a communication connection with the backpack base station, the satellite can also establish a communication connection with the operator base station, thereby realizing the transmission and reception between the backpack base station and the operator base station through the satellite. The backpack base station provides a communication cell for the site, and the operator base station provides a communication cell for the device 3 to be displayed. The terminal 1 located at the site can send out a video through the communication cell provided by the backpack base station, and transmit it to the device 3 to be displayed located in the communication cell of the operator base station through the communication cell provided by the satellite and the operator base station. Similarly, if the device 3 to be displayed wants to send a video to the terminal 1, it will pass through the communication cell of the operator base station, the satellite and the communication cell of the backpack base station in turn, and finally be transmitted to the terminal 1. Thereby, the video transmission between the terminal 1 and the device 3 to be displayed is realized.

[0067] It should be noted that when backpack base stations use the communication function provided by satellites, they need to pay according to the size of the transmitted data. Satellites usually have small bandwidth and expensive traffic. If you want to transmit the original video files shot by satellite, the original video files are too large or it takes a long time to transmit the video. Figure 1 When the application scenario shown requires real-time transmission of live video, a large amount of traffic is consumed, and the cost of video transmission is high. Therefore, when using satellites with expensive traffic to transmit videos, the video transmission method provided in the embodiment of the present application can also reduce the traffic cost of video transmission by reducing the amount of video data.

[0068] The technical solution in this application will be described in detail below in conjunction with the accompanying drawings. It should be noted that different technical features in this application can be combined with each other without conflict.

[0069] Figure 2 FIG. 1 is a flow chart of a video transmission method provided by an embodiment of the present application. Figure 2 As shown, the video transmission method provided in the embodiment of the present application may include:

[0070] S101. Obtain first pixel information of a first image frame, where the first image frame is any image frame in a video to be transmitted.

[0071] It is understandable that the video to be transmitted is captured by a camera device, the pixels of which vary according to the device parameters, and the pixels of the camera device determine the number of pixels in each frame of the captured image, thereby determining the data size of the captured image file or the video file composed of multiple frames of images.

[0072] In one implementation, after the camera captures the video, the terminal can directly obtain the image frame of the video, thereby retaining the pixel information of the original image frame to retain more details of the target video. For example, the camera has 5 million pixels and shoots at an aspect ratio of 4:3. The resolution of each frame of the captured video is 2592 pixels × 1944 pixels, about 5.04 million pixels. When the terminal directly obtains the image frame of the video, the pixel information of the image frame has 5.04 million pixels of color information, which fully retains all details.

[0073] In another implementation, after the camera captures the video, the terminal can directly present the image frame of the video on the display screen, and then collect the image frame currently displayed on the display screen as the first image frame, and obtain the first pixel information of the first image frame. By intercepting the image frame on the display screen as the first image frame, the data volume of the first image frame can be directly reduced while ensuring the display effect. Exemplarily, the resolution of the 4:3 display screen is 800 pixels × 600 pixels, 1024 pixels × 768 pixels, 1280 pixels × 960 pixels, 1400 pixels × 1050 pixels, 2592 pixels × 1944 pixels, etc. When the camera is the above-mentioned 5 million pixels, and the terminal collects the image frame currently displayed on the display screen with a resolution of 1024 pixels × 768 pixels as the first image frame, the first pixel information of the image frame obtained is about 800,000 pixels, which reduces the data volume of more than 4.2 million pixels while ensuring the display effect.

[0074] S102: Based on a preset color range and / or pixel size, the first pixel information is processed to obtain second pixel information of the image frame to be displayed, wherein the second pixel information is data information after pixel conversion of the first pixel information.

[0075] In one implementation, the first pixel information is processed based on a preset color range to obtain the second pixel information of the image frame to be displayed.

[0076] It is understandable that when the image frame to be displayed is transmitted from one display device to another display device for display, due to the difference in display devices, the first pixel information of the image frame to be displayed needs to be adaptively adjusted. The adaptive adjustment may include: performing color screening or color classification according to a preset color range, extracting characteristic pixel information of the image frame to be displayed, thereby expressing the picture of the image frame to be displayed with a smaller amount of pixel information data, so as to increase the transmission rate of the second pixel information while retaining the picture information of the image frame to be displayed.

[0077] In another implementation, the first pixel information is processed based on the pixel size to obtain the second pixel information of the image frame to be displayed.

[0078] It is understandable that the video file captured by the camera device needs to be presented on the display screen so that people can see the picture information carried by the video file. Different display screens have different sizes, resolutions, pixel densities, etc., and the resolutions, widths, heights, etc. of the image frames in the videos captured by different camera devices are also different. In order to ensure the display effect, it is necessary to process the first pixel information of the first image frame before the video file reaches the human eye, so that the processed second pixel information is suitable for the display requirements of the device to be displayed in terms of resolution, width, height, color, etc., and can accurately convey the picture information of the first image frame.

[0079] For example, the parameters of the display screen determine the presentation effect of the video file, including the size, brightness, aspect ratio, contrast, etc. of the display screen. When the video to be transmitted is presented on the display screen of the device to be displayed, due to the difference in display parameters such as resolution or width and height between the video to be transmitted and the display screen of the device to be displayed, in order to achieve a better display effect, the first pixel information needs to be processed to convert the first pixel information into second pixel information that meets the display requirements of the device to be displayed, so that the video to be transmitted can be displayed on the device to be displayed more clearly or in accordance with the requirements.

[0080] For example, Figure 3 Schematic diagrams of two display effects provided in the embodiments of the present application are shown in FIG. Figure 3 As shown in the figure, the dotted frame is the display area of ​​the video to be transmitted, and the solid frame is the display area of ​​the device to be displayed. Assuming that the pixel aspect ratio of the video to be transmitted is 4:3, and the screen aspect ratio of the display of the device to be displayed is 16:9, in this case, if pixel conversion is not performed to adapt the resolution of the video to be transmitted to the device to be displayed, the following will occur: Figure 3 As shown, when the video to be transmitted is directly displayed on the display screen of the device to be displayed according to the width and height pixel dimensions of the video to be transmitted, there will be parts of the display screen of the device to be displayed where no picture exists, that is, the video to be transmitted does not cover the entire display screen of the device to be displayed, for example, area a is a black screen. Alternatively, when the pixel dimension in the width direction of the video to be transmitted is changed to be consistent with the pixel dimension in the width direction of the display screen of the device to be displayed, there will be omissions of the picture in the height direction on the display screen of the device to be displayed, for example, area b. In this step, the first pixel information is processed, and the pixel information of the first image frame is converted into display information suitable for the device to be displayed, so that when the device to be displayed displays the image frame to be displayed according to the second pixel information, the image frame to be displayed can occupy a larger display area on the display screen of the device to be displayed, and the picture is not omitted, thereby maximizing the use of the display screen while retaining more picture information.

[0081] In addition, the above two implementation methods can also be combined to process the first pixel information. For example, the first pixel information of the image frame to be displayed is adaptively adjusted based on a preset color range, and the characteristic pixel information obtained after the adjustment is pixel-converted based on the pixel size to obtain the second pixel information. Alternatively, the first pixel information is processed based on the pixel size, and the processed pixel information is adaptively adjusted according to the preset color range to obtain the second pixel information of the image frame to be displayed. By processing the first pixel information by using a preset color range and pixel size, the visual difference caused by the different sizes of the display devices can be improved when the image frame to be displayed is transmitted from one display device to another display device for display, and the characteristic pixel information of the image frame to be displayed can be obtained according to the preset color range, so as to express the picture of the image frame to be displayed with a smaller amount of pixel information data, so as to increase the transmission rate of the second pixel information while retaining the picture information of the image frame to be displayed.

[0082] S103: Send the second pixel information to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information.

[0083] The converted second pixel information has a smaller amount of data than the first pixel information of the video to be transmitted. Therefore, sending the converted second pixel information to the device to be displayed for display can reduce the amount of transmitted data and reduce the requirements for the transmission line. This can ensure that the first image frame is transmitted to the device to be displayed for display in a timely manner when the network transmission rate is low, thereby reducing the dependence of data transmission between devices on network speed.

[0084] In addition, since the converted second pixel information is adapted to the resolution of the device to be displayed, the device to be displayed can directly display the first image frame of the video to be transmitted after receiving the second pixel information without any other processing. Therefore, the device to be displayed only needs to have a data receiving port and a display screen, which reduces the configuration requirements of the device to be displayed.

[0085] For example, in some cases, the video obtained by shooting the rescue scene may be viewed on multiple devices to be displayed, such as at least one display device at the rear rescue work site, and / or at least one display device located at the scene. In this case, the video to be transmitted needs to be presented on multiple devices to be displayed. Therefore, the first image frame is processed first, and after the data amount of the first image frame is reduced, the processed second pixel information is transmitted to the device to be displayed for display, which can improve the transmission efficiency of the video to be transmitted to the device to be displayed, reduce the configuration requirements of the device to be displayed, and reduce cost expenditure.

[0086] The video transmission method provided by the embodiment of the present application obtains the first pixel information of the first image frame of the video to be transmitted, adaptively adjusts the first pixel information based on the preset color range, extracts the characteristic pixel information of the image frame to be displayed, and converts the first pixel information into the second pixel information adapted to the device to be displayed, thereby reducing the data transmission amount while ensuring the display effect, so that the second pixel information can be transmitted to the device to be displayed faster, so that the device to be displayed can display the image frame to be displayed in time, so that the video to be transmitted can be displayed in time, so that when the network speed is good, the scene currently captured by the on-site camera device can be displayed in real time on the device to be displayed, or when the network speed is slow, it can avoid untimely transmission due to excessive data volume, causing the video to be transmitted displayed by the device to be displayed to be stuck, and the processing step of the first image frame of the video to be transmitted is placed before sending it to the device to be displayed, which can reduce the dependence on network speed while reducing the configuration requirements of the device to be displayed, thereby reducing costs. In addition, when using a paid network to transmit videos, traffic costs can be further saved.

[0087] It should be noted that the video transmission method provided in the embodiment of the present application does not limit the distance between the camera device and the terminal, the distance between the camera device and the device to be displayed, the distance between the terminal and the device to be displayed, and the transmission mode between the camera device and the terminal, the transmission mode between the camera device and the device to be displayed, and the transmission mode between the terminal and the device to be displayed. Among them, the transmission mode refers to wired communication transmission and wireless communication transmission.

[0088] Optionally, S102 may include:

[0089] The display size of the device to be displayed and the first pixel size of the first image frame are obtained. A pixel conversion ratio is determined according to the first pixel size and the display size. The first pixel size is converted according to the pixel conversion ratio to obtain a second pixel size of the image frame to be displayed, and the second pixel size is determined as the second pixel information.

[0090] It should be understood that the pixel size of the first image frame is related to the parameters of the camera device. The pixel sizes of the first image frames captured by different cameras are different, and there may be differences between the parameters of the camera device and the display parameters of the device to be displayed. Therefore, before the device to be displayed displays the image frame to be displayed, the first pixel information of the first image frame needs to be converted so that the obtained second pixel information is suitable for the device to be displayed.

[0091] Optionally, the display parameters include resolution, pixel density, etc. The first pixel size and the display size may be the number of width and height pixels of the resolution, or the width and height sizes calculated according to the resolution and pixel density.

[0092] For example, Figure 4is a schematic diagram of a pixel conversion effect provided by an embodiment of the present application, such as Figure 4 As shown, the first pixel size of the first image frame is w1×h1, and the display size of the device to be displayed is w2×h2, then the width ratio of the two is w1 / w2, and the length ratio is h1 / h2. The smaller ratio of the width ratio and the length ratio can be determined as the pixel conversion ratio to ensure that the image frame to be displayed occupies the largest area on the device to be displayed while retaining all the pictures of the first image frame.

[0093] The video transmission method provided in the embodiment of the present application determines the pixel conversion ratio by the pixel size of the first image frame and the display size of the device to be displayed, so as to improve the display effect of the video to be transmitted on the device to be displayed, so that the first image frame of the video to be transmitted can be clearly presented on the display screen of the device to be displayed, which is convenient for people to watch.

[0094] Optionally, S102 may include: acquiring a second image frame adjacent to the first image frame; obtaining difference pixel information based on first pixel information of the first image frame and third pixel information of the second image frame; and processing the first pixel information based on the difference pixel information to obtain second pixel information of the image frame to be displayed.

[0095] Adjacent to the first image frame refers to being adjacent on the time axis of the video to be transmitted.

[0096] When using a fixed camera to monitor a place for a long time, the roads, hills, buildings, etc. in the lens are mostly unchanging elements, and passers-by, animals, etc. are often the main changing elements. Generally speaking, the main monitoring objects are elements with changes. In some special occasions, such as earthquake or flood monitoring, by paying attention to the changes in hills, roads, rivers, etc. that do not often change, it is determined whether a disaster will occur.

[0097] In a video to be transmitted, most of the pictures are unchanged. If all the pixel information of each picture is transmitted to the device for display, it will contain a lot of unnecessary transmission data, affecting the transmission efficiency. Therefore, when transmitting multiple frames, the earlier frame can be used as the basic image frame for picture display. The subsequent captured image frames use this basic image frame as the standard to determine the pixel area that has changed. When transmitting, only the pixel information of the changed pixel area needs to be transmitted, thereby reducing the amount of transmission data and improving transmission efficiency.

[0098] For example, Figure 5 is a schematic diagram of a first image frame provided in an embodiment of the present application, Figure 6 is a schematic diagram of a second image frame provided in an embodiment of the present application, such as Figure 5 and Figure 6As shown, in the time period corresponding to the first image frame and the second image frame, only the image in the box s of the video to be transmitted changes. Therefore, after transmitting the second pixel information after the conversion of the first image frame and before transmitting the pixel information of the second image frame, the pixel information of the first image frame and the second image frame are compared or subtracted, and the difference pixel information between the two image frames is determined to be the pixel information of the box s, and the pixel information and positioning information of the box s are used as the display information of the second image frame. For example, the display information of the second image frame can be the coordinates (x1, y1) of the upper left vertex of the box s based on the coordinate system of the first image frame and the pixel information in the box s.

[0099] The video transmission method provided in the embodiment of the present application obtains the difference pixel information between the second image frame and the first image frame by taking the difference of the pixel information in adjacent image frames. According to the pixel information and the difference pixel information of the first image frame, the pixel information of the unchanged area can be removed, and only the pixel information of the changed area is transmitted, so that the data amount of the obtained second pixel information is much smaller than the data amount of the third pixel information of the second image frame, and the data transmission amount of the pixel information of the second image frame is reduced, thereby improving the transmission efficiency of the video to be transmitted, and can further save traffic costs when using a paid network to transmit the video.

[0100] Optionally, S102 may include:

[0101] S1001, dividing a first image frame into a plurality of regions according to a preset color range and a first color value in first pixel information, wherein the first color value in the first pixel information of each region satisfies the same color range, wherein the preset color range includes at least two color ranges.

[0102] Optionally, the preset color range includes at least one of a preset grayscale range, a preset brightness range and a preset color range.

[0103] Grayscale and brightness can both indicate the degree of brightness of a color. For example, if the preset grayscale range is 2, a 256-level grayscale image can be converted into a grayscale binary image. The larger the preset grayscale range, the more grayscale details the image has, and the larger the amount of data required. For example, if the preset grayscale range is 50, the grayscale information of the video to be transmitted can be compressed and sufficient picture details can be retained.

[0104] The preset color range can be divided into RGB mode, NTSC mode, sRGB mode, etc. according to the display parameters of the display screen. Different modes correspond to different color gamuts, and the set color ranges are also different. By compressing the first pixel information from multiple angles through the preset color range, the data volume of the displayed information can be reduced from multiple angles, thereby improving the transmission efficiency.

[0105] Exemplarily, there are many kinds of color values ​​that can be recorded by the camera. For example, for the RGB display mode, each color ranges from 0 to 255, with a total of 256 colors. By arranging and combining the three primary colors, about 16 million colors can be obtained. In some specific occasions, such a rich color level is not required to obtain the desired information from the picture. Therefore, the color value can be segmented by a preset color range. For example, 0 to 15 is used as the first color range, 16 to 31 is used as the second color range, and so on. The 256 color values ​​of each color can be divided into 16 segments, so that the color values ​​that can be displayed by the three primary colors become 4096, so that the pixels corresponding to multiple color values ​​are represented by the same value, which reduces the number of pixel partitions of the picture and greatly reduces the amount of color value data.

[0106] S1002, determining a corresponding second color value for each region.

[0107] It is understandable that each region corresponds to a second color value. The image is divided into multiple regions by using multiple preset color ranges, and the color values ​​of the pixels in each region are within the preset range with small differences, so one value can be used to represent the color of the region.

[0108] For example, Figure 7 is a schematic diagram of pixel partitioning provided by an embodiment of the present application, and the pixel information of a part of the first image frame is as follows: Figure 7 As shown, each number represents the RGB color value of a pixel. Figure 8 This embodiment of the present application provides a method for Figure 7 Schematic diagram of 16-segment color pixel partitioning, such as Figure 8 As shown, when the RGB color value is divided into 16 segments, Figure 7 Pixels with color values ​​between 0 and 15 are divided into the first color area, and the second color value within the first color area is recorded as A. Pixels with color values ​​between 16 and 31 are divided into the second color area, and the second color value within the second color area is recorded as B. Pixels with color values ​​between 326 and 47 are divided into the third color area, and the second color value within the third color area is recorded as C. And so on, pixels with color values ​​between 240 and 255 are divided into the sixteenth color area, and the second color value within the sixteenth color area is recorded as P.

[0109] In some scenarios, multiple color ranges can be set unevenly as needed. For example, colors between color values ​​0 and 200 have been determined to not need to be observed, and 0 to 200 can be directly classified as one color range to further reduce the amount of data.

[0110] S1003: Determine the second color value corresponding to each area as the second pixel information of the image frame to be displayed.

[0111] Combination Figure 7 and Figure 8 It can be seen that before the first image frame is partitioned by color range, 256 types of color information need to be recorded. After partitioning, only 16 types of color information need to be recorded at most, which greatly reduces the amount of color information data. By segmenting the pixel information by color range, the color level of the image can be reduced, so that multiple adjacent color values ​​can be recorded as the same color value, thereby partitioning the pixel information of the first image frame, and the pixel information can be recorded in the partitions, thereby reducing the amount of data of the second pixel information, improving the transmission efficiency of the second pixel information, and allowing the image frame to be displayed to be displayed on the display device more timely.

[0112] Optionally, S1002 may include: obtaining a first color value corresponding to each pixel in the region, counting the number of pixels with the same first color value, and determining the first color value with the largest number of pixels as the second color value of the region. Alternatively, determining a color average value of the region based on the first color value corresponding to each pixel in the region, and determining the color average value as the second color value corresponding to the region.

[0113] Exemplary, combined Figure 7 and Figure 8 , taking region P as an example, the number of pixels with a color value of 250 in region P is 12, and the total number of pixels in region P is 17. The number of pixels with a color value of 250 is greater than half of the total number of pixels in region P. It can be determined that the color value with the largest number of pixels in region P is color value 250. Therefore, color value 250 is used as the second color value of region P, which can better represent the color of region P. Alternatively, taking region B as an example, the color values ​​in region B are relatively dispersed, and the average value of the color values ​​in region B can be selected as the second color value, that is, (16+20+29+17+22+28+22)÷7=22. The second color value of region B is 22. Using the average value as the second color value of the pixel region with relatively dispersed color values ​​is more representative.

[0114] Optionally, after S1001 and before S1002, the following may be included: when the region includes a row or a column of pixels, the coordinate value of the starting position and the coordinate value of the ending position of the row or column are determined as the first coordinate information of the region. When the region includes multiple rows or columns of pixels, the vertex coordinate values ​​of the region are determined as the second coordinate information of the region.

[0115] S1003 may include: determining the first coordinate information and / or the second coordinate information, and the second color value corresponding to each area as the second pixel information of the image frame to be displayed.

[0116] Understandably, Figure 7There are 256 RGB color values, and the color values ​​of adjacent pixels are not necessarily the same. Therefore, when recording, more pixel coordinate information and color information need to be recorded. For example, the geometric center and radius or diameter of the area, or the vertex or midpoint of the side of the area can achieve the purpose of using less coordinate data to represent the pixel position of the area.

[0117] And in Figure 8 In , since the 256 color values ​​are segmented, there are at most 16 color values ​​in one image frame. Figure 8 In the partial pixel area shown, there are three second color values, and the partial pixel area is divided into three pixel areas ABP. When recording the color values ​​and corresponding coordinate values ​​of the pixels in the partial pixel area, only the second color values ​​and the coordinate information of the corresponding area need to be recorded, so that less pixel information is used to represent the color and coordinates in the entire pixel area. Fig. 9 The corresponding embodiment of the present application provides Figure 8 A schematic diagram of a recording method, such as Fig. 9 As shown, the A pixel area is recorded as the second color value A and the coordinate values ​​A1, A2, A3, A4, A5, and A6, so that the coordinate value information between A1 and A2, between A3 and A4, between A4 and A5, and between A5 and A6 can be omitted, thereby reducing the data amount of the second pixel information.

[0118] Exemplary, combined Figure 8 and Fig. 9 , taking region C as an example, region C is a column of pixels with a second color value of C, so the position information of 7 pixels from C1 to C2 can be represented by two coordinate values ​​of C1 and C2, eliminating the data volume of 5 coordinate values ​​between C1 and C2. Or, taking region P as an example, region P is a pixel region of multiple rows and columns, and the information of 17 coordinate values ​​in region P can be represented by coordinate values ​​P1, P2, P3, P4, P5, and P6, a total of 6 coordinate values, eliminating the data volume of 11 coordinate values. Therefore, by representing the pixel coordinates of the divided area by the coordinate values ​​of the special position, the data volume of the second pixel information can be reduced, thereby improving the transmission efficiency of the video to be transmitted.

[0119] The embodiment of the present application performs segmented compression on the pixel information in the image frame to be displayed by using a preset color range, and uses the coordinate value of a special position and the second color value to represent the pixel information in the segmented area, which can reduce the data amount of the second pixel information obtained based on the pixel information, thereby using smaller data to represent more picture pixel information, greatly reducing the amount of data transmitted between devices, and improving the transmission efficiency of the video to be transmitted between devices. When using a paid network to transmit video, it can further save traffic costs.

[0120] In summary, the video transmission method provided in the embodiment of the present application can be applied to the transmission of the video to be transmitted between two devices. Since the video to be transmitted is transmitted between the two devices by transmitting image frames multiple times, the video transmission method provided in the embodiment of the present application can also be used for the transmission of a single image frame. In addition, in the video transmission method provided in the embodiment of the present application, after the terminal performs pixel conversion on the first image frame, the second pixel information obtained by the pixel conversion can be transmitted to the device to be displayed, so that the device to be displayed displays the image frame to be displayed corresponding to the second pixel information, thereby completing the transmission of the video to be transmitted between the terminal and the device to be displayed. Among them, the terminal has computing power, and the device to be displayed may not have computing power, but the device to be displayed requires a display screen, and the terminal may include a display screen or may not include a display screen.

[0121] Fig.10 is a structural diagram of a video transmission device provided in an embodiment of the present application, such as Fig.10 As shown, the video transmission device 4 provided in the embodiment of the present application may include:

[0122] The acquisition module 1001 is used to acquire first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted;

[0123] The processing module 1002 is used to process the first pixel information based on a preset color range and / or pixel size to obtain second pixel information of the image frame to be displayed.

[0124] The sending module 1003 is used to send the second pixel information to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information.

[0125] Optionally, the processing module 1002 is further configured to:

[0126] Obtaining a display size of a device to be displayed and a first pixel size of a first image frame;

[0127] determining a pixel conversion ratio according to the first pixel size and the display size;

[0128] The first pixel size is converted according to the pixel conversion ratio to obtain a second pixel size of the image frame to be displayed, and the second pixel size is determined as the second pixel information.

[0129] Optionally, the processing module 1002 is further configured to:

[0130] Acquire a second image frame adjacent to the first image frame;

[0131] Obtaining difference pixel information according to first pixel information of the first image frame and third pixel information of the second image frame;

[0132] The first pixel information is processed according to the difference pixel information to obtain second pixel information of the image frame to be displayed.

[0133] Optionally, the processing module 1002 is further configured to:

[0134] According to a preset color range and a first color value in the first pixel information, the first image frame is divided into a plurality of regions; the first color value in the first pixel information of each region satisfies the same color range; the preset color range includes at least two color ranges;

[0135] Determine a corresponding second color value for each region respectively;

[0136] The second color value corresponding to each area is determined as the second pixel information of the image frame to be displayed.

[0137] Optionally, the processing module 1002 is specifically configured to:

[0138] Obtaining a first color value corresponding to each pixel in the area;

[0139] Counting the number of pixels with the same first color value;

[0140] Determine the first color value with the largest number of pixels as the second color value of the region;

[0141] Alternatively, a color average value of the region is determined according to the first color value corresponding to each pixel in the region, and the color average value is determined as the second color value corresponding to the region.

[0142] Optionally, the processing module 1002 is specifically configured to:

[0143] When the region includes a row or a column of pixels, the coordinate value of the starting position and the coordinate value of the ending position of the row or column are determined as the first coordinate information of the region;

[0144] When the region includes multiple rows or columns of pixels, the vertex coordinate values ​​of the region are determined as the second coordinate information of the region;

[0145] Determining the second color value corresponding to each area as the second pixel information of the image frame to be displayed includes:

[0146] The first coordinate information and / or the second coordinate information, and the second color value corresponding to each area are determined as the second pixel information of the image frame to be displayed.

[0147] Optionally, the preset color range includes at least one of a preset grayscale range, a preset brightness range and a preset color range.

[0148] Fig.11is a schematic diagram of the structure of a terminal provided in an embodiment of the present application, such as Fig.11 As shown, the terminal 1 provided in the embodiment of the present application may include a memory 10 and a processor 11, wherein the memory 10 stores a computer program 12, and when the processor 11 executes the computer program 12, the steps in any of the above method embodiments are implemented.

[0149] The memory 10 may include a high-speed random access memory, and may also include a non-volatile memory (non-volatile memory) or a volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory, for example, flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (random access memory, RAM), read-only memory (read-only memory, ROM), erasable programmable read-only memory (erasable programmable read-only memory, EPROM), electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), programmable read-only memory (programmable read-only memory, PROM), magnetic memory, magnetic disk, optical disk, etc., and RAM may include static RAM or dynamic RAM. In some embodiments, the memory 10 may be an internal storage unit of the terminal 1, for example, a hard disk or memory of the terminal 1. In other embodiments, the memory 10 may also be an external storage device of the terminal 1, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, or a flash card (Flash Card) equipped on the terminal 1. In some examples, the memory 10 may further include a memory remotely arranged relative to the terminal 1, and these remote memories may be connected to the terminal 1 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0150] The processor 11 is generally used to perform the overall operation of the terminal 1, and the processor 11 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 11 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, such as a single-chip microcomputer, etc.

[0151] Optionally, the terminal 1 provided in the embodiment of the present application may further include a wired communication module 13 and / or a wireless communication module 14. The wired communication module 13 and / or the wireless communication module 14 are used to communicate with a camera or a device to be displayed.

[0152] Terminal 1 can be various electronic devices with display screens, including but not limited to smart terminals, network devices, or devices formed by integrating smart terminals and network devices through a network. Smart terminals include but are not limited to any mobile electronic products that can interact with users through keyboards, mice, remote controls, touchpads or voice control devices, such as desktop computers, notebooks, PDAs, smart phones, tablet computers, etc. Smart terminals can use any operating system, such as Google's Android operating system, Apple's iOS operating system, Microsoft's Windows Phone operating system, Nokia's Symbian operating system, BlackBerry's BlackBerryOS operating system, web os operating system, Microsoft's Windows Mobile operating system, Huawei's Harmony operating system, etc. Among them, network devices include an electronic device that can automatically perform numerical calculations and information processing according to pre-set or stored instructions. For example, the hardware of network devices includes but is not limited to microprocessors, application specific integrated circuits (ASIC), programmable gate arrays (FPGA), digital signal processors (DSP), embedded devices, etc. Network devices include but are not limited to computers, network hosts, single network servers, multiple network server sets or a cloud consisting of multiple servers. The cloud is composed of a large number of computers or network servers based on cloud computing, where cloud computing is a type of distributed computing, a virtual supercomputer composed of a group of loosely coupled computer sets.

[0153] Of course, those skilled in the art should understand that the above terminals are only examples, and other existing or future terminals that are applicable to the present application should also be included in the protection scope of the present application and are included here by reference.

[0154] The embodiment of the present application also provides a computer-readable medium, which may be a computer-readable signal medium or a computer-readable medium. The processor in the computer reads the computer-readable program code stored in the computer-readable medium, so that the processor can execute the functional actions specified in each step or the combination of steps in the above method embodiment; and generate a device for implementing the functional actions specified in each block or the combination of blocks in the block diagram.

[0155] Computer-readable media include but are not limited to electronic, magnetic, optical, electromagnetic, infrared memory or semiconductor systems, devices or apparatuses, or any appropriate combination of the foregoing, the memory is used to store program codes or instructions, the program codes include computer operating instructions, and the processor is used to execute the program codes or instructions of the video transmission method stored in the memory.

[0156] For the definitions of memory and processor, please refer to the description of the aforementioned computer device embodiment and will not be repeated here.

[0157] In summary, the video transmission method, device, terminal and storage medium provided in the embodiments of the present application can reduce the amount of data transmission while ensuring the display effect, thereby transmitting the display information to the device to be displayed more quickly, so that the device to be displayed can display the image frames to be displayed in time, thereby displaying the target video in time, so that when the network speed is good, the scene currently captured by the on-site camera can be displayed in real time on the device to be displayed, or when the network speed is slow, it can avoid untimely transmission due to excessive data volume, causing the target video displayed by the device to be displayed to be stuck, and placing the processing step of the image frames to be displayed of the target video before sending them to the device to be displayed, which can reduce the dependence on network speed and reduce the configuration requirements of the device to be displayed, thereby reducing costs, and can further save traffic costs when using a paid network to transmit videos.

[0158] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0159] Each functional unit or module in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0160] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.

[0161] In the claims, any reference symbols placed between brackets shall not be construed as limiting the claims. The word "comprising" described in the present application does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present application can be implemented with the aid of hardware comprising several different elements and with the aid of a suitably programmed computer. In a unit claim that lists a number of devices, several units of these devices may be embodied by the same hardware item. The use of first, second, and third, etc. does not indicate any order, and these words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.

[0162] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A video transmission method, characterized in that: The method is applied to a terminal, and the terminal sends out a video through a communication cell provided by a backpack base station, and transmits the video to a device to be displayed in the communication cell of the operator via a satellite and a communication cell provided by the operator. The method includes: Acquire first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted; Based on a preset color range and / or pixel size, the first pixel information is processed to obtain second pixel information of the image frame to be displayed; the second pixel information is data information after pixel conversion of the first pixel information; Sending the second pixel information to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information; The processing of the first pixel information based on the preset color range to obtain the second pixel information of the image frame to be displayed includes: According to the preset color range and the first color value in the first pixel information, the first image frame is divided into a plurality of regions; the first color value in the first pixel information of each region satisfies the same color range; the preset color range includes at least two color ranges; Determine a corresponding second color value for each of the regions respectively; wherein determining a corresponding second color value for a region includes: obtaining a first color value corresponding to each pixel in the region; counting the number of pixels with the same first color value; determining the first color value with the largest number of pixels as the second color value of the region; or determining a color average value of the region according to the first color value corresponding to each pixel in the region, and determining the color average value as the second color value corresponding to the region; Determine the second color value corresponding to each of the regions as the second pixel information of the image frame to be displayed; After dividing the first image frame into a plurality of regions and before respectively determining a corresponding second color value for each of the regions, the method further includes: When the area includes a row or a column of pixels, the coordinate value of the starting position and the coordinate value of the ending position of the row or the column of pixels are determined as the first coordinate information of the area; When the region includes multiple rows or columns of pixels, determining the vertex coordinate values ​​of the region as the second coordinate information of the region; The step of determining the second color value corresponding to each of the regions as the second pixel information of the image frame to be displayed includes: The first coordinate information and / or the second coordinate information, and the second color value corresponding to each of the regions are determined as the second pixel information of the image frame to be displayed.

2. The method according to claim 1, characterized in that The processing of the first pixel information to obtain second pixel information of the image frame to be displayed includes: Acquire the display size of the device to be displayed and the first pixel size of the first image frame; determining a pixel conversion ratio according to the first pixel size and the display size; The first pixel size is converted according to the pixel conversion ratio to obtain a second pixel size of the image frame to be displayed, and the second pixel size is determined as the second pixel information.

3. The method according to claim 1, characterized in that: The processing of the first pixel information to obtain second pixel information of the image frame to be displayed includes: Acquire a second image frame adjacent to the first image frame; Obtaining difference pixel information according to first pixel information of the first image frame and third pixel information of the second image frame; The first pixel information is processed according to the difference pixel information to obtain second pixel information of the image frame to be displayed.

4. The method according to claim 1, characterized in that: The preset color range includes at least one of a preset grayscale range, a preset brightness range, and a preset color range.

5. A video transmission device, characterized in that: The device is applied to a terminal, and the terminal sends out a video through a communication cell provided by a backpack base station, and transmits the video to a device to be displayed in the communication cell of the operator via a satellite and a communication cell provided by the operator. The device includes: An acquisition module, used to acquire first pixel information of a first image frame; the first image frame is any image frame in the video to be transmitted; A processing module, for processing the first pixel information based on a preset color range and / or pixel size to obtain second pixel information of an image frame to be displayed; the processing of the first pixel information based on the preset color range to obtain second pixel information of an image frame to be displayed includes: dividing the first image frame into a plurality of regions according to the preset color range and the first color value in the first pixel information; the first color value in the first pixel information of each region satisfies the same color range; the preset color range includes at least two color ranges; determining a corresponding second color value for each region respectively; determining the second color value corresponding to each region as the second pixel information of the image frame to be displayed; wherein determining the corresponding second color value for one region includes: obtaining the first color value corresponding to each pixel point in the region; counting the number of pixels with the same first color value; determining the first color value with the largest number of pixels as the second color value of the region; or determining a color average value of the region according to the first color value corresponding to each pixel point in the region, and determining the color average value as the second color value corresponding to the region; The processing module is specifically used to, when the area includes a row or a column of pixels, determine the coordinate value of the starting position and the coordinate value of the ending position of the row or the column of pixels as the first coordinate information of the area; when the area includes multiple rows or columns of pixels, determine the vertex coordinate value of the area as the second coordinate information of the area; determine the first coordinate information and / or the second coordinate information, and the second color value corresponding to each of the areas as the second pixel information of the image frame to be displayed; A sending module is used to send the second pixel information to the device to be displayed, so that the device to be displayed displays the image frame to be displayed based on the second pixel information.

6. A terminal, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the video transmission method according to any one of claims 1 to 4 when executing the computer program.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the video transmission method according to any one of claims 1 to 4 are implemented.

Citation Information

Patent Citations

  • Screen projection method and device and storage medium

    CN112114765A

  • Display content sharing method and device, equipment and readable storage medium

    CN112291588A

  • Image processing method, device, system, equipment and medium

    CN112767558A